Benchmark

non-incremental/UFNIA/sledgehammer/QEpres/z3.605906.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size22293
Compressed Size3994
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 22285
Compressed Size4012
Max. Term Depth13
Asserts 143
Declared Functions39
Declared Constants35
Declared Sorts 35
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false10 ite12 not28
or10 and31 =>89 =249
forall142 exists8 let47 Int210
div2 mod3 +36 -33
*23 <52 <=34

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.02116 0.01300
CVC4 CVC4 f7118b2 default unknown ❌ 2400.01000 2399.78000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 2.20091 2.20166
SMT-COMP 2015 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.01291 0.01200
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.01000 2400.45000
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 2400.01000 2420.49000
Z3 z3 4.4.0 default unsat ✅ 0.91235 0.91286
SMT-COMP 2016 0.33 (2/3) CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 2400.03000 2288.90000
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.38018 0.38181
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.44772 0.44587
Z3 z3-4.4.1 default unsat ✅ 1.47229 1.47450
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.12000 566.88000
Vampire vampire4.2-smt vampire unsat ✅ 0.31540 0.30965
Z3 z3-4.5.0 default unsat ✅ 1.04517 1.04384
SMT-COMP 2018 0.33 (2/3) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.01000 1167.22000
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.70086 2.44000
Z3 z3-4.7.1_default unsat ✅ 0.97602 0.97593
SMT-COMP 2019 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 91.99410 364.61000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.03000 2373.23000
CVC4-SymBreak_03_06_2019-wrapped-sq_default unknown ❌ 2400.03000 2365.67000
Par4 Par4-wrapped-sq_default unsat ✅ 0.95335 1.79000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.28334 3.38383
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.42639 3.31290
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 2.78401 10.38000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.74185 2.54000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.91487 0.91467
z3-4.7.1_default unsat ✅ 0.93500 0.93496
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unknown ❌ 1201.71406 1200.99112
iProver iProver v3.9 unsat ✅ 53.45654 203.56716
SMTInterpol SMTInterpol unknown ❌ 1202.74437 1515.64642