Benchmark

non-incremental/UFIDL/sledgehammer/TypeSafe/smtlib.697341.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size111907
Compressed Size16582
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK—
strict Dolmen OK—
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 111899
Compressed Size16561
Max. Term Depth16
Asserts 464
Declared Functions265
Declared Constants144
Declared Sorts 299
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3 false149 ite9 not82
or6 and39 =>549 =1145
forall563 exists24 let143 Int9
+1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.02032 0.01200
CVC4 CVC4 f7118b2 default unknown ❌ 2399.61000 2400.07000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.12661 0.11898
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01696 0.01600
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.34466 1.34280
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.34309 1.34080
veriT veriT default unknown ❌ 2400.01000 2400.99000
Z3 z3 4.4.0 default unsat ✅ 0.14544 0.14498
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.30466 1.30593
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 2.59701 2.60651
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 1.15624 3.56000
veriT veriT-dev default unknown ❌ 1300.73000 1299.22000
Z3 z3-4.4.1 default unsat ✅ 0.13439 0.13573
SMT-COMP 2017 0.50 (2/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.48408 0.48336
Vampire vampire4.2-smt vampire unknown ❌ 600.04800 2382.84000
veriT veriT-2017-06-17 default unknown ❌ 600.03800 599.96700
Z3 z3-4.5.0 default unsat ✅ 0.14889 0.14255
SMT-COMP 2018 0.50 (2/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.55901 0.55919
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.05000 4773.21000
veriT veriT_default unknown ❌ 1200.05000 1200.00000
Z3 z3-4.7.1_default unsat ✅ 0.14554 0.14542
SMT-COMP 2019 0.57 (3/7) CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.51880 0.51916
Par4 Par4-wrapped-sq_default unsat ✅ 0.15707 0.00598
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.05000 4393.43000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.44205 3.97210
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.18786 3.63086
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.43280 4.11066
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.06000 9432.85000
veriT veriT-wrapped-sq_default unknown ❌ 2306.15000 2305.94000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.15122 0.15121
z3-4.7.1_default unsat ✅ 0.14900 0.14897
SMT-COMP 2020 0.57 (3/7) CVC4 CVC4-sq-final_default unsat ✅ 0.54735 0.54763
Par4 Par4-wrapped-sq_default unsat ✅ 0.17221 0.00963
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.05000 1257.45000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.58611 3.98616
Vampire vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.03000 4753.63000
veriT veriT_default unknown ❌ 86.51930 84.49520
veriT+vite_default unknown ❌ 438.89500 438.36000
Z3 z3-4.8.8_default unsat ✅ 0.17223 0.17220
SMT-COMP 2021 0.50 (4/8) CVC4 CVC4-sq-final_default unsat ✅ 0.62830 0.62830
cvc5 cvc5-fixed_default unsat ✅ 0.48741 0.48684
Par4 Par4-wrapped-sq_default unsat ✅ 0.16627 0.00827
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.05000 1235.68000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.82297 5.21217
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.04000 4764.13000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.08000 4763.99000
veriT veriT_default unknown ❌ 1200.03000 1199.83000
Z3 z3-4.8.11_default unsat ✅ 0.15286 0.15248
z3-4.8.8_default unsat ✅ 0.16710 0.16697
SMT-COMP 2022 0.50 (3/6) CVC4 CVC4-sq-final_default unsat ✅ 0.55864 0.55898
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.79532 0.79563
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.00818 5.23337
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 1200.11000 4755.02000
veriT veriT_default unknown ❌ 130.71900 130.70600
Z3 z3-4.8.17_default unsat ✅ 0.15195 0.15373
SMT-COMP 2023 0.80 (1/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.53562 0.53619
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.51756 0.51796
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.15000 4715.83000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.11000 1240.07000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.15264 5.18010
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1200.03000 4763.87000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 0.89006 0.79048
iProver iProver v3.9 unknown ❌ 1201.74302 4748.39314
SMTInterpol SMTInterpol unknown ❌ 1202.26920 1294.11810
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 0.56268 0.44835
iProver iProver v3.9.3 unknown ❌ 1201.74727 4761.44122
SMTInterpol SMTInterpol unknown ❌ 1201.78986 1632.51683
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.99984 4.38778