Benchmark

non-incremental/UFLIA/sledgehammer/QEpres/smtlib.718505.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size55525
Compressed Size9451
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status None
Size 55517
Compressed Size9486
Max. Term Depth13
Asserts 361
Declared Functions143
Declared Constants169
Declared Sorts 167
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true4 false53 ite15 not107
or20 and33 =>170 =784
forall377 exists18 let46 Int177
-1 <3 <=1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.75 (1/4) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.02400 575.56700
Vampire vampire4.2-smt vampire unsat ✅ 479.83100 1853.60000
veriT veriT-2017-06-17 default unknown ❌ 600.10400 600.03000
Z3 z3-4.5.0 default unknown ❌ 600.03000 599.96000
SMT-COMP 2018 0.75 (1/4) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.10000 1177.40000
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 941.03900 3742.98000
veriT veriT_default unknown ❌ 1200.02000 1199.97000
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.98000
SMT-COMP 2019 0.88 (1/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.06000 9512.67000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.02000 2363.31000
master-2018-06-10-b19c840-competition-default_default unknown ❌ 2400.09000 2380.28000
Par4 Par4-wrapped-sq_default unknown ❌ 2400.08000 7170.58000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2414.64000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.28746 3.86280
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.08535 3.45425
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.43947 3.80397
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 2336.61000 9331.14000
veriT veriT-wrapped-sq_default unknown ❌ 2400.06000 2399.76000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 28.94250 28.94400
SMT-COMP 2020 0.88 (1/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.02000 4766.91000
CVC4 CVC4-sq-final_default unknown ❌ 1200.06000 1179.67000
Par4 Par4-wrapped-sq_default unknown ❌ 1200.15000 3581.56000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1234.50000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.48978 3.88968
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 1065.81000 4209.85000
veriT veriT_default unknown ❌ 1200.02000 1199.92000
veriT+vite_default unknown ❌ 1200.01000 1199.84000
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.76000
SMT-COMP 2021 0.88 (1/8) CVC4 CVC4-sq-final_default unknown ❌ 1200.11000 1179.21000
cvc5 cvc5-fixed_default unknown ❌ 1200.09000 662.01900
Par4 Par4-wrapped-sq_default unknown ❌ 1200.07000 3587.52000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.03000 1614.81000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.91540 5.09945
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.04000 4752.38000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 1063.79000 4206.46000
veriT veriT_default unknown ❌ 1200.10000 1199.85000
Z3 z3-4.8.11_default unknown ❌ 1200.07000 1199.94000
z3-4.8.8_default unknown ❌ 1200.06000 1200.10000
SMT-COMP 2025 1.00 (0/4) cvc5 cvc5 unknown ❌ 1201.78862 1201.00630
iProver iProver v3.9.3 unknown ❌ 1201.78166 4762.49313
SMTInterpol SMTInterpol unknown ❌ 153.44467 439.08433
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.93386 4.16987