Benchmark

non-incremental/UFLIA/sledgehammer/Arrow_Order/smtlib.724248.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size75105
Compressed Size11814
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 75097
Compressed Size11827
Max. Term Depth15
Asserts 478
Declared Functions140
Declared Constants80
Declared Sorts 91
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true14 false92 ite34 not101
or35 and96 =>360 =1174
distinct4 forall508 exists41 let96
Int2 +22 -9 <15
<=6

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.01894 0.00900
CVC4 CVC4 f7118b2 default unsat ✅ 110.43900 110.42300
veriT veriT-smtcomp2014 default unknown ❌ 2399.12000 2400.10000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2400.01000 2399.96000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01030 0.01000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 5.97261 5.97209
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 5.93747 5.93610
veriT veriT default unknown ❌ 2400.01000 2401.03000
Z3 z3 4.4.0 default unsat ✅ 441.53500 441.75700
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.59475 2.59679
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 907.73900 912.61100
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 172.21900 684.12000
veriT veriT-dev default unsat ✅ 20.13240 20.14460
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.15000
SMT-COMP 2017 0.50 (2/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 68.88430 68.87190
Vampire vampire4.2-smt vampire unknown ❌ 600.04600 2333.31000
veriT veriT-2017-06-17 default unknown ❌ 600.03200 599.90000
Z3 z3-4.5.0 default unsat ✅ 0.71856 0.71812
SMT-COMP 2018 0.75 (1/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 78.63100 78.53770
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.10000 4773.78000
veriT veriT_default unknown ❌ 1200.12000 1230.01000
Z3 z3-4.7.1_default unknown ❌ 1200.06000 1200.00000
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 1487.82000 5906.76000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 45.77020 45.75000
master-2018-06-10-b19c840-competition-default_default unsat ✅ 66.87430 66.87000
Par4 Par4-wrapped-sq_default unsat ✅ 67.59270 202.35700
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.07000 2403.86000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.40717 3.65166
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.10584 3.38365
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.42356 3.66768
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.07000 9533.71000
veriT veriT-wrapped-sq_default unknown ❌ 2400.02000 2399.81000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.03000 2399.15000
SMT-COMP 2020 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 1064.61000 4213.98000
CVC4 CVC4-sq-final_default unsat ✅ 90.68510 90.58470
Par4 Par4-wrapped-sq_default unsat ✅ 0.41392 0.01383
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.02000 1226.53000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.41802 3.88204
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 1121.53000 4428.88000
veriT veriT_default unsat ✅ 0.28181 0.28214
veriT+vite_default unsat ✅ 7.38659 7.38503
Z3 z3-4.8.8_default unknown ❌ 1200.03000 1199.88000
SMT-COMP 2022 0.33 (4/6) CVC4 CVC4-sq-final_default unsat ✅ 17.42590 17.42550
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 18.13220 18.12840
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.99233 4.90904
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 580.28300 2326.72000
veriT veriT_default unknown ❌ 1200.02000 1199.84000
Z3 z3-4.8.17_default unsat ✅ 0.62910 0.63103
SMT-COMP 2023 0.60 (2/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 22.36100 22.35900
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 120.79800 120.64800
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.05000 4738.34000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.05000 3335.04000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.84370 4.83369
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 726.02000 2885.78000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 14.98827 14.88318
iProver iProver v3.9 unknown ❌ 1201.73242 4745.92709
SMTInterpol SMTInterpol unknown ❌ 1202.71798 1267.33986
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 120.50406 120.36418
iProver iProver v3.9.3 unknown ❌ 1201.75718 4761.80095
SMTInterpol SMTInterpol unknown ❌ 1201.77149 1278.09505
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.96104 3.95557