Benchmark

non-incremental/UF/sledgehammer/TypeSafe/smtlib.1426402.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size11237
Compressed Size2075
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 11229
Compressed Size2112
Max. Term Depth13
Asserts 45
Declared Functions29
Declared Constants20
Declared Sorts 30
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false10 not2 or4 and8
=>93 =146 forall46 exists4
let12

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 13.30840 13.30700
CVC4 CVC4 f7118b2 default sat ✅ 41.08320 41.05880
veriT veriT-smtcomp2014 default unknown ❌ 38.64970 38.62910
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.21000 2400.05000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 22.21630 22.22460
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.44160 20.44190
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.44060 20.44390
veriT veriT default unknown ❌ 432.11600 432.29300
Z3 z3 4.4.0 default unknown ❌ 2321.47000 2321.78000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 326.96900 303.02600
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 10.27170 10.31940
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.62153 2.08000
veriT veriT-dev default unknown ❌ 2400.02000 2401.14000
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2400.39000
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 459.38100 451.99600
Vampire vampire4.2-smt vampire sat ✅ 0.46132 0.45524
veriT veriT-2017-06-17 default unknown ❌ 600.05200 599.89000
Z3 z3-4.5.0 default unknown ❌ 600.05200 599.68000
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 483.38800 481.45000
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.69685 2.45000
veriT veriT_default unknown ❌ 1200.11000 1200.00000
Z3 z3-4.7.1_default unknown ❌ 641.21400 640.69100
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 160.14400 174.97700
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 966.67500 962.16400
master-2018-06-10-b19c840-competition-default_default sat ✅ 484.82600 481.93700
Par4 Par4-wrapped-sq_default sat ✅ 485.12000 1451.93000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2611.57000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.37899 3.40910
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.16317 3.35736
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.21367 3.43784
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 40.26290 159.74000
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.89295 3.33000
veriT veriT-wrapped-sq_default unknown ❌ 2400.02000 2399.75000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 928.07800 928.01100
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default sat ✅ 485.88500 481.81900
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.07000 4743.76000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.03000 1281.53000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 4.78921 11.52690
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 0.62020 2.07000
vampire_smt_4.5_vampire_smtcomp sat ✅ 0.50567 0.32456
veriT veriT_default unknown ❌ 1200.08000 1199.91000
Z3 z3-4.8.11_default unknown ❌ 566.52300 566.43400
SMT-COMP 2023 0.67 (2/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 522.51000 512.19500
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 520.74900 511.95300
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.09000 4751.35000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.02000 1506.76000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.91051 4.74837
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.81813 2.94000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.01000 1199.91000