Benchmark

non-incremental/UFLIA/sledgehammer/QEpres/smtlib.602493.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size24062
Compressed Size4270
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK—
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 24054
Compressed Size4281
Max. Term Depth13
Asserts 167
Declared Functions53
Declared Constants41
Declared Sorts 45
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false10 ite5 not33
or6 and19 =>72 =271
forall162 exists6 let44 Int191
+29 -27 *6 <27
<=24

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.02275 0.00900
CVC4 CVC4 f7118b2 default unknown ❌ 2400.01000 2399.98000
veriT veriT-smtcomp2014 default unknown ❌ 2399.02000 2400.02000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.04313 0.03399
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00902 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.07639 0.07399
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.07756 0.07499
veriT veriT default unknown ❌ 2400.01000 2400.93000
Z3 z3 4.4.0 default unsat ✅ 0.05688 0.05699
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.24978 0.25030
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 6.77146 6.80304
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 10.53100 41.61000
veriT veriT-dev default unknown ❌ 2400.05000 2401.40000
Z3 z3-4.4.1 default unsat ✅ 0.05935 0.06060
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 109.10900 106.27100
Vampire vampire4.2-smt vampire unsat ✅ 0.16853 0.16728
veriT veriT-2017-06-17 default unsat ✅ 12.03580 12.03590
Z3 z3-4.5.0 default unsat ✅ 0.06352 0.06293
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 112.32800 111.07600
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 236.77900 941.69300
veriT veriT_default unsat ✅ 12.03720 12.03730
Z3 z3-4.7.1_default unsat ✅ 0.07044 0.07033
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.05000 9537.71000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 208.04200 205.14100
master-2018-06-10-b19c840-competition-default_default unsat ✅ 113.54400 110.92500
Par4 Par4-wrapped-sq_default unsat ✅ 0.07995 0.00659
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.06000 2652.12000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.47183 3.43952
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.09329 3.37913
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.46217 3.52655
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 84.77910 336.53000
veriT veriT-wrapped-sq_default unsat ✅ 12.04590 18.03590
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.07471 0.07469
SMT-COMP 2020 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.03000 4766.46000
CVC4 CVC4-sq-final_default unsat ✅ 184.42400 181.00900
Par4 Par4-wrapped-sq_default unsat ✅ 0.07938 0.00617
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.10000 1216.72000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.40697 3.57525
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.39670 0.20997
veriT veriT_default unsat ✅ 107.05300 107.04300
veriT+vite_default unsat ✅ 11.03910 11.04020
Z3 z3-4.8.8_default unsat ✅ 0.08785 0.08783
SMT-COMP 2021 0.25 (6/8) CVC4 CVC4-sq-final_default unsat ✅ 185.74100 181.17800
cvc5 cvc5-fixed_default unsat ✅ 151.03700 149.40500
Par4 Par4-wrapped-sq_default unsat ✅ 0.08202 0.00696
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.08000 3950.64000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.84935 4.68491
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.45899 0.25009
vampire_smt_4.5_vampire_smtcomp unsat ✅ 36.02300 142.45000
veriT veriT_default unsat ✅ 13.58850 13.57650
Z3 z3-4.8.11_default unsat ✅ 0.07760 0.07754
z3-4.8.8_default unsat ✅ 0.08931 0.08926
SMT-COMP 2022 0.33 (4/6) CVC4 CVC4-sq-final_default unsat ✅ 108.78700 105.34100
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 212.19800 211.05900
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.78784 4.76096
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 0.62538 1.76000
veriT veriT_default unsat ✅ 9.05645 9.05685
Z3 z3-4.8.17_default unsat ✅ 0.06196 0.06376
SMT-COMP 2023 0.40 (3/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 215.61000 211.05400
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 212.72900 211.14900
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 228.37100 892.18000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 4230.17000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.82017 4.91874
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.38450 0.33345
SMT-COMP 2024 0.33 (2/3) cvc5 cvc5 unsat ✅ 210.47600 210.29481
iProver iProver v3.9 unsat ✅ 29.45192 105.81729
SMTInterpol SMTInterpol unknown ❌ 1202.72097 4495.60775
SMT-COMP 2025 0.50 (2/4) cvc5 cvc5 unsat ✅ 137.86091 137.72391
iProver iProver v3.9.3 unsat ✅ 8.41876 26.59997
SMTInterpol SMTInterpol unknown ❌ 1201.86805 2834.03739
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.89967 3.85481