Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/uf.811467.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size8155
Compressed Size1588
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 8147
Compressed Size1599
Max. Term Depth14
Asserts 68
Declared Functions32
Declared Constants28
Declared Sorts 19
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true10 false5 ite5 not22
=>42 =144 forall48

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 1.94707 1.94670
CVC4 CVC4 f7118b2 default sat ✅ 40.93860 40.92980
veriT veriT-smtcomp2014 default unknown ❌ 2399.02000 2400.02000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.21000 2400.04000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 1.68960 1.68674
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.46300 20.46290
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.46990 20.47390
veriT veriT default unknown ❌ 501.42500 501.52300
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.97000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 312.09300 302.04600
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 10.38430 10.43430
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.74437 2.63000
veriT veriT-dev default unknown ❌ 2400.03000 2401.48000
Z3 z3-4.4.1 default unknown ❌ 2400.03000 2401.42000
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 452.19600 451.14000
Vampire vampire4.2-smt vampire sat ✅ 0.39317 0.43179
veriT veriT-2017-06-17 default unknown ❌ 600.08200 599.96000
Z3 z3-4.5.0 default unknown ❌ 600.10800 600.06000
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 481.81800 481.21700
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 1.29890 5.02000
veriT veriT_default unknown ❌ 1200.03000 1199.98000
Z3 z3-4.7.1_default unknown ❌ 1200.11000 1200.01000
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 0.57871 2.11069
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 964.63600 961.81300
master-2018-06-10-b19c840-competition-default_default sat ✅ 481.88100 481.28300
Par4 Par4-wrapped-sq_default sat ✅ 481.79100 1443.56000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2415.31000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.27807 3.39557
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.18342 3.36671
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.43871 3.41399
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 38.86080 153.91000
vampire-4.3-smt_vampire_smtcomp sat ✅ 2.98443 11.56000
veriT veriT-wrapped-sq_default unknown ❌ 2400.01000 2399.85000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.08000 2399.86000
SMT-COMP 2021 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 482.42900 481.36300
iProver iProver-v3.5-final-fix2_iProver_SMT sat ✅ 55.39370 145.89600
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.03000 1396.79000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.75302 4.66851
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 0.84750 2.62000
vampire_smt_4.5_vampire_smtcomp sat ✅ 0.59984 2.26000
veriT veriT_default unknown ❌ 1200.02000 1199.88000
Z3 z3-4.8.11_default unknown ❌ 1200.11000 1199.81000
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 482.93000 481.43900
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 512.84600 511.41800
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.77843 4.66436
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp sat ✅ 0.66650 2.37000
veriT veriT_default unknown ❌ 1200.04000 1199.83000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.09000 1199.94000
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.75000
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 525.42700 511.75800
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 513.54500 511.58200
iProver iProver-3.8-fix_iprover_SMT sat ✅ 365.92100 1439.25000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.04000 1242.01000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.70338 4.77619
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.64144 2.39687
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.11000 1200.12000
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 sat ✅ 540.59911 540.35628
iProver iProver v3.9.3 sat ✅ 42.94652 163.61205
SMTInterpol SMTInterpol unknown ❌ 1201.76915 1237.66188
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.93252 3.85102
Yices2 Yices2 unknown ❌ 1201.59260 1201.30406