Benchmark

non-incremental/UF/sledgehammer/TypeSafe/smtlib.1404271.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size10222
Compressed Size2055
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 10214
Compressed Size2046
Max. Term Depth13
Asserts 47
Declared Functions27
Declared Constants19
Declared Sorts 28
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false8 not2 or2 and6
=>74 =129 forall46 exists3
let10

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.50353 0.49592
CVC4 CVC4 f7118b2 default sat ✅ 40.93110 40.92580
veriT veriT-smtcomp2014 default unknown ❌ 2398.81000 2400.03000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.41000 2400.04000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.08646 0.08599
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.58000 20.58090
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.57060 20.57090
veriT veriT default unknown ❌ 474.73500 474.97400
Z3 z3 4.4.0 default unknown ❌ 1474.63000 1474.77000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 334.85400 304.71200
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.98511 10.02950
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.32925 0.32930
veriT veriT-dev default unknown ❌ 2400.02000 2401.36000
Z3 z3-4.4.1 default unknown ❌ 2400.04000 2400.83000
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 459.34400 451.83300
Vampire vampire4.2-smt vampire sat ✅ 0.28890 0.28423
veriT veriT-2017-06-17 default unknown ❌ 600.08700 600.00000
Z3 z3-4.5.0 default unknown ❌ 600.01200 599.68000
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 487.42200 482.02600
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 1.00930 3.69000
veriT veriT_default unknown ❌ 1200.03000 1200.02000
Z3 z3-4.7.1_default unknown ❌ 1200.11000 1200.04000
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 492.89600 482.33900
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 482.83900 481.65200
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.94241 4.86016
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp sat ✅ 1.10141 4.16000
veriT veriT_default unknown ❌ 1200.07000 1200.83000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.07000 1200.05000
Z3 z3-4.8.17_default unknown ❌ 1200.05000 1199.93000
SMT-COMP 2025 0.80 (1/5) cvc5 cvc5 sat ✅ 502.85882 502.69189
iProver iProver v3.9.3 unknown ❌ 1201.79336 4783.43977
SMTInterpol SMTInterpol unknown ❌ 1201.50484 1265.19776
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.92998 4.05481
Yices2 Yices2 unknown ❌ 1201.30815 1201.02161