Benchmark

non-incremental/UFLIA/sledgehammer/Hoare/smtlib.1053284.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size84553
Compressed Size13038
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 84545
Compressed Size13106
Max. Term Depth15
Asserts 510
Declared Functions121
Declared Constants135
Declared Sorts 130
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true4 false115 ite13 not98
or25 and68 =>428 =1251
forall567 exists37 let119 Int2
+6 <1 <=2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.01779 0.01000
CVC4 CVC4 f7118b2 default unsat ✅ 92.19150 92.14100
veriT veriT-smtcomp2014 default unsat ✅ 363.95800 364.00200
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.14136 0.13298
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.01034 0.01000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.38100 0.37794
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.38188 0.37894
veriT veriT default unsat ✅ 11.97800 11.98220
Z3 z3 4.4.0 default unsat ✅ 1.33706 1.33780
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.43426 0.43495
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 194.89800 195.82000
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 37.09960 147.02000
veriT veriT-dev default unsat ✅ 7.41882 7.42364
Z3 z3-4.4.1 default unsat ✅ 0.16583 0.16718
SMT-COMP 2017 0.50 (2/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 7.95805 7.95697
Vampire vampire4.2-smt vampire unknown ❌ 600.07600 2330.01000
veriT veriT-2017-06-17 default unsat ✅ 26.27310 26.27090
Z3 z3-4.5.0 default unknown ❌ 600.05100 589.62000
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.38378 0.38394
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.05000 4769.44000
veriT veriT_default unsat ✅ 20.28790 20.28550
Z3 z3-4.7.1_default unsat ✅ 455.33300 455.16300
SMT-COMP 2020 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 78.21310 310.23000
CVC4 CVC4-sq-final_default unsat ✅ 10.62960 10.62980
Par4 Par4-wrapped-sq_default unsat ✅ 0.23090 0.00596
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.02000 1232.12000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.43771 3.77977
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 167.23900 662.31000
veriT veriT_default unsat ✅ 75.33030 75.31370
veriT+vite_default unsat ✅ 2.76979 2.76985
Z3 z3-4.8.8_default unsat ✅ 0.19967 0.19961
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 8.04807 7.92129
iProver iProver v3.9.3 unknown ❌ 1201.79580 4759.46178
SMTInterpol SMTInterpol unknown ❌ 1201.88782 4595.00396
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.99853 4.24770