Benchmark

non-incremental/UFIDL/sledgehammer/TypeSafe/smtlib.683530.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size111871
Compressed Size16530
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK—
strict Dolmen OK—
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 111863
Compressed Size16522
Max. Term Depth16
Asserts 464
Declared Functions265
Declared Constants143
Declared Sorts 299
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3 false149 ite9 not82
or6 and39 =>549 =1145
forall563 exists24 let143 Int9
+1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.33 (2/3) CVC3 CVC3 default unknown ❌ 0.01998 0.01200
CVC4 CVC4 f7118b2 default unsat ✅ 81.04830 81.04570
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.12591 0.11498
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01283 0.01200
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.49529 1.49377
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.48341 1.48077
veriT veriT default unknown ❌ 2400.01000 2401.03000
Z3 z3 4.4.0 default unsat ✅ 0.13324 0.13298
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 11.38440 11.39150
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 2.52764 2.53975
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 1.06375 3.44000
veriT veriT-dev default unknown ❌ 1309.53000 1308.12000
Z3 z3-4.4.1 default unsat ✅ 0.13901 0.14075
SMT-COMP 2017 0.50 (2/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.18050 0.53753
Vampire vampire4.2-smt vampire unknown ❌ 600.06700 2383.42000
veriT veriT-2017-06-17 default unknown ❌ 600.09000 605.92000
Z3 z3-4.5.0 default unsat ✅ 0.14442 0.14400
SMT-COMP 2018 0.50 (2/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.53922 0.53914
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.06000 4773.65000
veriT veriT_default unknown ❌ 1200.03000 1199.77000
Z3 z3-4.7.1_default unsat ✅ 0.14491 0.14482
SMT-COMP 2019 0.57 (3/7) CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.48546 0.48578
Par4 Par4-wrapped-sq_default unsat ✅ 0.15368 0.00590
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2447.09000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.46331 4.00042
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.05040 3.59528
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.50366 3.96352
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.13000 9389.69000
veriT veriT-wrapped-sq_default unknown ❌ 2400.04000 2399.49000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.15016 0.15017
z3-4.7.1_default unsat ✅ 0.14777 0.14770
SMT-COMP 2020 0.57 (3/7) CVC4 CVC4-sq-final_default unsat ✅ 0.57547 0.57571
Par4 Par4-wrapped-sq_default unsat ✅ 0.15482 0.00634
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1270.70000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.49509 3.93600
Vampire vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.07000 4762.31000
veriT veriT_default unknown ❌ 1200.02000 1199.94000
veriT+vite_default unknown ❌ 1200.11000 1199.82000
Z3 z3-4.8.8_default unsat ✅ 0.15664 0.15656
SMT-COMP 2021 0.50 (4/8) CVC4 CVC4-sq-final_default unsat ✅ 0.58344 0.58368
cvc5 cvc5-fixed_default unsat ✅ 0.49003 0.49058
Par4 Par4-wrapped-sq_default unsat ✅ 0.15425 0.00660
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.07000 1241.90000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.85554 5.20351
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.03000 4760.87000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.08000 4763.52000
veriT veriT_default unknown ❌ 298.87600 298.86100
Z3 z3-4.8.11_default unsat ✅ 0.15432 0.15424
z3-4.8.8_default unsat ✅ 0.16501 0.16495
SMT-COMP 2022 0.50 (3/6) CVC4 CVC4-sq-final_default unsat ✅ 0.59652 0.59667
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.55167 0.55214
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.84914 5.16292
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 1200.10000 4781.05000
veriT veriT_default unknown ❌ 186.57100 186.55900
Z3 z3-4.8.17_default unsat ✅ 0.15408 0.15588
SMT-COMP 2023 0.80 (1/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.53563 0.53617
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.52314 0.52376
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1201.69000 4692.25000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.05000 1245.39000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.19719 5.64041
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1200.10000 4783.16000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 0.51496 0.41560
iProver iProver v3.9 unknown ❌ 1201.76001 4744.36431
SMTInterpol SMTInterpol unknown ❌ 1201.77772 1277.96490
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 0.58030 0.46311
iProver iProver v3.9.3 unknown ❌ 1201.76639 4762.11522
SMTInterpol SMTInterpol unknown ❌ 1201.74896 1595.62766
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.02479 4.12847