Benchmark

non-incremental/UFLIA/sledgehammer/Arrow_Order/smtlib.810726.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size90428
Compressed Size13939
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 90420
Compressed Size13956
Max. Term Depth15
Asserts 520
Declared Functions180
Declared Constants191
Declared Sorts 199
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true13 false46 ite9 not81
or13 and46 =>651 =1463
forall571 exists51 let51 Int78
+11 -1 <21 <=36

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.01827 0.01000
CVC4 CVC4 f7118b2 default unsat ✅ 121.09900 120.92300
veriT veriT-smtcomp2014 default unknown ❌ 2398.81000 2400.00000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.41000 2400.05000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.01019 0.01000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 14.27630 14.27880
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 14.08720 14.08790
veriT veriT default unknown ❌ 2400.01000 2400.60000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.59000
SMT-COMP 2016 0.75 (1/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 2400.12000 2368.08000
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 39.38310 39.57690
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 3.48586 13.37000
veriT veriT-dev default unknown ❌ 2400.11000 2401.67000
Z3 z3-4.4.1 default unknown ❌ 2400.03000 2400.54000
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.92501 0.92419
Vampire vampire4.2-smt vampire unsat ✅ 0.80922 2.99000
veriT veriT-2017-06-17 default unsat ✅ 73.35770 73.33330
Z3 z3-4.5.0 default unknown ❌ 600.10600 599.87000
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 466.27100 459.44900
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 3.47394 13.54000
veriT veriT_default unsat ✅ 75.88600 75.88420
Z3 z3-4.7.1_default unknown ❌ 1200.12000 1200.10000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 864.15800 3426.33000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 2.84902 2.84935
master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.98060 2.98059
Par4 Par4-wrapped-sq_default unsat ✅ 3.28851 9.75594
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.02000 2407.73000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.54804 3.84511
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.25658 3.61344
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.44227 3.90011
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 2.75329 10.54000
veriT veriT-wrapped-sq_default unsat ✅ 206.58000 206.56500
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 1647.68000 1646.39000
SMT-COMP 2020 0.50 (4/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.02000 4766.37000
CVC4 CVC4-sq-final_default unsat ✅ 470.09200 462.65300
Par4 Par4-wrapped-sq_default unsat ✅ 75.53950 225.63000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.02000 1218.65000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.51854 3.96951
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 1.80427 6.98000
veriT veriT_default unsat ✅ 7.12024 7.12089
veriT+vite_default unknown ❌ 1200.04000 1199.87000
Z3 z3-4.8.8_default unknown ❌ 1200.11000 1199.50000
SMT-COMP 2021 0.38 (5/8) CVC4 CVC4-sq-final_default unsat ✅ 467.94900 460.64900
cvc5 cvc5-fixed_default unsat ✅ 58.71400 58.67030
Par4 Par4-wrapped-sq_default unsat ✅ 176.61800 527.70000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.02000 1314.94000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.83490 5.18088
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 2.72655 10.60000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 1.80366 6.80000
veriT veriT_default unsat ✅ 153.19600 153.18500
Z3 z3-4.8.11_default unknown ❌ 1200.06000 1199.73000
z3-4.8.8_default unknown ❌ 1200.08000 1199.84000
SMT-COMP 2022 0.33 (4/6) CVC4 CVC4-sq-final_default unsat ✅ 484.20200 461.97900
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 44.99780 42.87190
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.99234 5.25576
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 2.28960 8.78000
veriT veriT_default unsat ✅ 154.64800 154.61000
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.76000
SMT-COMP 2023 0.60 (2/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.62397 0.62455
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.02073 1.01807
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.12000 4681.52000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 1325.96000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.08050 5.14398
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 2.73559 10.50000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 1.43061 1.33085
iProver iProver v3.9 unknown ❌ 1201.72745 4749.94690
SMTInterpol SMTInterpol unknown ❌ 1202.74328 1410.89484