Benchmark

non-incremental/UF/sledgehammer/TypeSafe/smtlib.1492800.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size30167
Compressed Size4368
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 30159
Compressed Size4388
Max. Term Depth13
Asserts 102
Declared Functions63
Declared Constants22
Declared Sorts 58
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false51 not4 or2
and6 =>315 =381 forall131
exists9 let54

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2401.65000 2402.24000
CVC4 CVC4 f7118b2 default sat ✅ 44.50870 44.48620
veriT veriT-smtcomp2014 default unknown ❌ 51.84110 51.83910
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.12000 2400.01000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2402.23000 2403.06000
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 21.16050 21.15780
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 21.10020 21.09880
veriT veriT default unknown ❌ 645.25000 645.27500
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.92000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 361.94500 306.45300
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 18.24570 18.33700
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 14.25160 56.45000
veriT veriT-dev default unknown ❌ 2400.03000 2401.56000
Z3 z3-4.4.1 default unknown ❌ 2400.10000 2401.22000
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 485.57000 473.20000
Vampire vampire4.2-smt vampire sat ✅ 2.86593 11.21000
veriT veriT-2017-06-17 default unknown ❌ 600.03500 599.91000
Z3 z3-4.5.0 default unknown ❌ 600.06900 599.95000
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 495.35100 488.59200
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 52.66480 209.28000
veriT veriT_default unknown ❌ 1200.11000 1199.85000
Z3 z3-4.7.1_default unknown ❌ 1200.06000 1199.98000
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.05000 9519.86000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 980.87400 969.11000
master-2018-06-10-b19c840-competition-default_default sat ✅ 490.58800 485.19300
Par4 Par4-wrapped-sq_default sat ✅ 492.83200 1470.80000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.06000 2466.14000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.38777 3.46276
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.14334 3.42392
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.36132 3.44471
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 117.43600 466.34000
vampire-4.3-smt_vampire_smtcomp sat ✅ 50.73540 201.42000
veriT veriT-wrapped-sq_default unknown ❌ 2400.09000 2399.83000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.84000
SMT-COMP 2021 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 501.76500 490.09800
iProver iProver-v3.5-final-fix2_iProver_SMT sat ✅ 165.98200 655.06000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.06000 1257.84000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.79663 4.71265
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 38.73860 153.22000
vampire_smt_4.5_vampire_smtcomp sat ✅ 38.00200 150.69000
veriT veriT_default unknown ❌ 1200.02000 1199.95000
Z3 z3-4.8.11_default unknown ❌ 1200.11000 1198.98000
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 524.83500 516.20400
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 521.25200 515.07600
iProver iProver-3.8-fix_iprover_SMT sat ✅ 354.47200 1397.17000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 1217.89000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.95695 4.97526
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 31.78220 125.90000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.84000
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 sat ✅ 543.03552 542.86202
iProver iProver v3.9.3 sat ✅ 980.60088 3900.28486
SMTInterpol SMTInterpol unknown ❌ 1201.86733 2380.34473
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.96045 4.09672
Yices2 Yices2 unknown ❌ 1201.31739 1201.05528