Benchmark

non-incremental/UFLIA/sledgehammer/Hoare/smtlib.775265.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size7908
Compressed Size1775
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 7900
Compressed Size1785
Max. Term Depth15
Asserts 39
Declared Functions22
Declared Constants22
Declared Sorts 25
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false7 not11 and9 =>51
=97 forall48 exists1 let6
Int2 +7 <1 <=2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.01665 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 1.25629 1.24581
veriT veriT-smtcomp2014 default unknown ❌ 2399.01000 2400.03000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.61000 2400.03000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.00927 0.00900
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.07628 0.07399
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.07715 0.07399
veriT veriT default unknown ❌ 2370.31000 2370.90000
Z3 z3 4.4.0 default unknown ❌ 1457.87000 1457.95000
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 40.13010 40.14300
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 2.40287 2.41476
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.07595 0.06870
veriT veriT-dev default unsat ✅ 16.07640 16.08560
Z3 z3-4.4.1 default unknown ❌ 1637.38000 1637.39000
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 20.17940 20.17940
Vampire vampire4.2-smt vampire unsat ✅ 0.06555 0.06468
veriT veriT-2017-06-17 default unsat ✅ 510.39500 510.23000
Z3 z3-4.5.0 default unknown ❌ 600.03100 599.81000
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 31.01720 31.01650
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.27212 0.17016
veriT veriT_default unsat ✅ 512.13200 512.12700
Z3 z3-4.7.1_default unknown ❌ 839.88700 839.52500
SMT-COMP 2020 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.22000 0.21906
CVC4 CVC4-sq-final_default unsat ✅ 0.06245 0.06275
Par4 Par4-wrapped-sq_default unsat ✅ 0.06744 0.00671
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.02000 1253.79000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.41604 3.53869
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.12975 0.07936
veriT veriT_default unsat ✅ 535.66500 535.57400
veriT+vite_default unsat ✅ 21.28970 21.28670
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.77000
SMT-COMP 2021 0.25 (6/8) CVC4 CVC4-sq-final_default unsat ✅ 0.06389 0.06425
cvc5 cvc5-fixed_default unsat ✅ 0.06661 0.06704
Par4 Par4-wrapped-sq_default unsat ✅ 0.07001 0.00859
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 74.17480 91.05090
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 4.76610 11.95190
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.19642 0.13378
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.13556 0.08500
veriT veriT_default unsat ✅ 0.01763 0.01802
Z3 z3-4.8.11_default unknown ❌ 1069.49000 1069.40000
z3-4.8.8_default unknown ❌ 1200.10000 1199.71000
SMT-COMP 2025 0.25 (3/4) cvc5 cvc5 unsat ✅ 0.31802 0.19554
iProver iProver v3.9.3 unsat ✅ 0.86357 1.96361
SMTInterpol SMTInterpol unsat ✅ 44.91688 56.87636
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.87569 3.82129