Benchmark

non-incremental/UFLIA/sledgehammer/QEpres/smtlib.1057957.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size68327
Compressed Size12149
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 68319
Compressed Size12197
Max. Term Depth13
Asserts 384
Declared Functions247
Declared Constants195
Declared Sorts 216
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false24 ite13 not96
or5 and40 =>193 =780
forall438 exists20 let65 Int128
+10 <5 <=5

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.02087 0.00900
CVC4 CVC4 f7118b2 default unsat ✅ 20.66940 20.67190
veriT veriT-smtcomp2014 default unsat ✅ 0.09881 0.08998
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 966.82800 966.98900
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01019 0.01000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.26704 0.26296
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.26573 0.26196
veriT veriT default unsat ✅ 0.15135 0.14998
Z3 z3 4.4.0 default unknown ❌ 596.03500 596.27900
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.32691 0.32732
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 2.60834 2.62027
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.20488 0.19737
veriT veriT-dev default unsat ✅ 0.07078 0.07100
Z3 z3-4.4.1 default unknown ❌ 0.08044 0.08172
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.29006 0.28981
Vampire vampire4.2-smt vampire unsat ✅ 0.35469 0.34613
veriT veriT-2017-06-17 default unsat ✅ 0.39494 0.39451
Z3 z3-4.5.0 default unknown ❌ 470.11400 470.06600
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.29513 0.29535
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 238.56100 948.71000
veriT veriT_default unsat ✅ 0.23234 0.23260
Z3 z3-4.7.1_default unknown ❌ 568.86200 568.74700
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.92277 3.52000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.31117 0.31148
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.31563 0.31596
Par4 Par4-wrapped-sq_default unsat ✅ 0.33519 0.00553
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.08000 2402.70000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.59578 3.87215
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.37559 3.57613
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.43068 3.84743
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 1.93620 7.36000
veriT veriT-wrapped-sq_default unsat ✅ 0.37362 0.37354
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 381.99400 381.89000
SMT-COMP 2021 0.38 (5/8) CVC4 CVC4-sq-final_default unsat ✅ 0.33293 0.33327
cvc5 cvc5-fixed_default unsat ✅ 0.34701 0.34760
Par4 Par4-wrapped-sq_default unsat ✅ 0.33718 0.00649
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.04000 2897.20000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.96594 5.25189
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.99596 3.67000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.81386 3.04000
veriT veriT_default unsat ✅ 0.08873 0.08903
Z3 z3-4.8.11_default unknown ❌ 1200.09000 1199.99000
z3-4.8.8_default unknown ❌ 180.10000 180.09300
SMT-COMP 2022 0.33 (4/6) CVC4 CVC4-sq-final_default unsat ✅ 0.34440 0.34467
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.39489 0.39531
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.98033 5.20910
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.79623 2.93000
veriT veriT_default unsat ✅ 0.08556 0.08591
Z3 z3-4.8.17_default unknown ❌ 361.83700 361.78400
SMT-COMP 2023 0.60 (2/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.36357 0.36404
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.37792 0.37845
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.05000 4679.32000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.09000 2994.85000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.12269 5.14886
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.72314 2.61000
SMT-COMP 2025 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.48867 0.36062
iProver iProver v3.9.3 unsat ✅ 733.69326 2899.34817
SMTInterpol SMTInterpol unknown ❌ 1047.70011 2812.47298
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.02755 4.36992