Benchmark

non-incremental/UF/sledgehammer/TypeSafe/smtlib.770760.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size8634
Compressed Size1884
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 8626
Compressed Size1884
Max. Term Depth13
Asserts 58
Declared Functions34
Declared Constants20
Declared Sorts 29
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite2 not25 or1 and4
=>18 =112 forall47 exists6
let5

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2.72506 2.71759
CVC4 CVC4 f7118b2 default sat ✅ 40.20420 40.20090
veriT veriT-smtcomp2014 default unknown ❌ 2399.02000 2400.03000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.41000 2400.07000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.25807 0.25796
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.14890 20.14990
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.14600 20.14590
veriT veriT default unknown ❌ 2400.01000 2401.03000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2401.16000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 301.27900 300.65600
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.78008 9.82584
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.10671 0.10583
veriT veriT-dev default unknown ❌ 2400.03000 2401.63000
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.34000
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 450.34200 450.28400
Vampire vampire4.2-smt vampire sat ✅ 0.08613 0.12170
veriT veriT-2017-06-17 default unknown ❌ 600.02900 599.94600
Z3 z3-4.5.0 default unknown ❌ 600.05600 599.98400
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 480.55500 480.49600
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.23419 0.12356
veriT veriT_default unknown ❌ 1200.12000 1200.00000
Z3 z3-4.7.1_default unknown ❌ 1200.06000 1199.85000
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.02000 7111.54000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 960.80200 960.67000
master-2018-06-10-b19c840-competition-default_default sat ✅ 480.59100 480.58800
Par4 Par4-wrapped-sq_default sat ✅ 480.74300 1441.26000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.06000 2466.05000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.45259 3.34478
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.18731 3.36077
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.36473 3.40851
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 0.86179 3.30000
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.29052 0.13966
veriT veriT-wrapped-sq_default unknown ❌ 2400.02000 2399.65000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.09000 2400.15000
SMT-COMP 2020 0.71 (2/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1194.12000 4800.16000
CVC4 CVC4-sq-final_default sat ✅ 480.58200 480.51400
CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 960.77100 960.65400
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1264.73000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.56373 3.58254
Vampire vampire_smt_4.5_vampire_smtcomp sat ✅ 0.15326 0.09018
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.25352 0.13933
veriT veriT_default unknown ❌ 1200.02000 1199.92000
veriT+vite_default unknown ❌ 1200.03000 1199.91000
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.93000
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 476.87800 475.66200
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 464.28400 464.11400
iProver iProver-3.8-fix_iprover_SMT sat ✅ 340.91900 1343.27000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.07000 4224.44000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.83427 4.79945
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.20778 0.12093
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.12000 1200.05000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 sat ✅ 535.06112 534.87048
iProver iProver v3.9 sat ✅ 2.88627 9.06787
SMTInterpol SMTInterpol unknown ❌ 1202.74479 4386.80368
Yices2 Yices2 unknown ❌ 1201.27941 1200.73299