Benchmark

non-incremental/UFLIA/sledgehammer/Arrow_Order/smtlib.692554.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size112552
Compressed Size16135
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 112544
Compressed Size16149
Max. Term Depth15
Asserts 516
Declared Functions375
Declared Constants231
Declared Sorts 417
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true13 false159 ite11 not71
or3 and18 =>713 =1290
forall647 exists22 let34 Int2
<3 <=2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.01950 0.01100
CVC4 CVC4 f7118b2 default unsat ✅ 67.04360 65.29110
veriT veriT-smtcomp2014 default unsat ✅ 24.39320 24.40230
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 2312.32000 2312.75000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01252 0.01200
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.27576 0.27296
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.28080 0.27796
veriT veriT default unsat ✅ 4.41870 4.41833
Z3 z3 4.4.0 default unknown ❌ 1470.79000 1471.08000
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.29237 0.29272
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 186.20300 187.04700
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 21.43690 84.86000
veriT veriT-dev default unsat ✅ 0.56405 0.56455
Z3 z3-4.4.1 default unknown ❌ 1297.12000 1297.36000
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.28207 0.28086
Vampire vampire4.2-smt vampire unsat ✅ 109.69200 435.51000
veriT veriT-2017-06-17 default unsat ✅ 10.23860 10.23640
Z3 z3-4.5.0 default unknown ❌ 600.06100 599.87000
SMT-COMP 2018 0.50 (2/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 61.57030 61.37740
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.09000 4770.00000
veriT veriT_default unsat ✅ 9.69380 9.69278
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.47000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 732.53200 2910.19000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.30741 0.30772
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.31341 0.31376
Par4 Par4-wrapped-sq_default unsat ✅ 0.33460 0.00584
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2403.23000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.61466 4.09060
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.39163 3.58071
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.39060 4.05418
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 170.03400 675.05000
veriT veriT-wrapped-sq_default unsat ✅ 8.21701 8.21544
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 1787.91000 1787.75000
SMT-COMP 2020 0.50 (4/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.03000 4754.65000
CVC4 CVC4-sq-final_default unsat ✅ 0.36173 0.36201
Par4 Par4-wrapped-sq_default unsat ✅ 0.33618 0.00601
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.09000 1214.49000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.52740 4.05022
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 263.03200 1043.21000
veriT veriT_default unsat ✅ 1.88646 1.88674
veriT+vite_default unsat ✅ 2.00783 2.00791
Z3 z3-4.8.8_default unknown ❌ 1077.22000 1076.99000
SMT-COMP 2021 0.38 (5/8) CVC4 CVC4-sq-final_default unsat ✅ 26.30120 26.29940
cvc5 cvc5-fixed_default unsat ✅ 120.80200 120.67700
Par4 Par4-wrapped-sq_default unsat ✅ 8.30958 24.69000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.11000 1482.05000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.11687 5.64006
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 10.81290 42.60000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 8.97096 35.39000
veriT veriT_default unsat ✅ 9.82168 9.82189
Z3 z3-4.8.11_default unknown ❌ 712.32500 712.16900
z3-4.8.8_default unknown ❌ 1106.04000 1105.77000
SMT-COMP 2022 0.33 (4/6) CVC4 CVC4-sq-final_default unsat ✅ 1.86932 1.86975
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.50187 0.50120
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.07405 5.35450
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 510.38300 2026.09000
veriT veriT_default unsat ✅ 10.58450 10.58450
Z3 z3-4.8.17_default unknown ❌ 731.65300 731.54600
SMT-COMP 2023 0.60 (2/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.28843 0.28829
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.36929 0.36889
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.07000 4723.41000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.12000 1250.67000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.87650 5.17830
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 132.17000 522.97000
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 0.56893 0.45041
iProver iProver v3.9.3 unknown ❌ 1201.79091 4761.93098
SMTInterpol SMTInterpol unknown ❌ 1201.75132 1413.68976
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.01968 4.42944