Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/smtlib.651469.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size51314
Compressed Size7280
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 51306
Compressed Size7292
Max. Term Depth15
Asserts 260
Declared Functions184
Declared Constants22
Declared Sorts 121
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false133 ite6 not15 or15
and25 =>362 =661 forall355
exists23 let36

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 279.86200 279.83300
CVC4 CVC4 f7118b2 default unsat ✅ 61.82630 61.80560
veriT veriT-smtcomp2014 default unknown ❌ 2399.12000 2400.03000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.62953 0.62191
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 116.20800 116.23900
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.95480 0.95285
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.95656 0.95385
veriT veriT default unknown ❌ 2400.01000 2400.72000
Z3 z3 4.4.0 default unsat ✅ 0.23074 0.23096
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 5.28581 5.28947
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.24243 0.24364
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.09115 0.08644
veriT veriT-dev default unsat ✅ 13.03250 13.03570
Z3 z3-4.4.1 default unknown ❌ 2400.03000 2401.27000
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 6.13464 6.13384
Vampire vampire4.2-smt vampire unsat ✅ 0.06993 0.06775
veriT veriT-2017-06-17 default unsat ✅ 510.34900 510.34700
Z3 z3-4.5.0 default unknown ❌ 600.02200 599.89000
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.89367 5.89354
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.37470 0.20525
veriT veriT_default unsat ✅ 540.08700 540.03300
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.72000
SMT-COMP 2019 0.50 (4/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.06000 9534.49000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.30667 10.50640
master-2018-06-10-b19c840-competition-default_default unsat ✅ 6.31076 6.31095
Par4 Par4-wrapped-sq_default unsat ✅ 0.16806 0.00574
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2633.43000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.43531 3.81775
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.23309 3.52925
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.29719 3.75589
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.47624 0.26961
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.15908 0.15861
veriT veriT-wrapped-sq_default unsat ✅ 523.04200 522.98600
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 292.20800 292.14300
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.06000 4757.52000
CVC4 CVC4-sq-final_default unsat ✅ 4.23090 4.23035
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.31307 4.31292
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.04000 1257.93000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.29750 3.89091
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.09439 0.09421
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.16986 0.16975
veriT veriT_default unsat ✅ 0.14336 0.14366
veriT+vite_default unsat ✅ 0.17290 0.17323
Z3 z3-4.8.8_default unsat ✅ 0.22583 0.22575
SMT-COMP 2021 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 3.63245 3.63277
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 0.78902 2.04679
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 13.37890 24.90480
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.16176 5.75738
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.11594 0.11581
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.09883 0.09640
veriT veriT_default unsat ✅ 0.06287 0.06325
Z3 z3-4.8.11_default unsat ✅ 0.15431 0.15427
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.69421 0.59471
iProver iProver v3.9 unsat ✅ 1.34748 3.59870
SMTInterpol SMTInterpol unsat ✅ 30.16764 43.28873
Yices2 Yices2 unsat ✅ 1.64064 1.53937