Benchmark

non-incremental/UFNIA/sledgehammer/QEpres/z3.628319.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size22265
Compressed Size4007
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 22257
Compressed Size4021
Max. Term Depth13
Asserts 143
Declared Functions39
Declared Constants35
Declared Sorts 35
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false10 ite12 not28
or10 and31 =>89 =249
forall142 exists8 let47 Int210
div2 mod3 +37 -33
*23 <52 <=34

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.02131 0.01300
CVC4 CVC4 f7118b2 default unknown ❌ 2399.91000 2400.06000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.03173 0.03000
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unknown ❌ 0.01474 0.01400
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.07984 0.07699
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.07816 0.07499
Z3 z3 4.4.0 default unsat ✅ 0.05535 0.05499
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1403.20000 1332.61000
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.37087 0.37256
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.79154 2.93000
Z3 z3-4.4.1 default unsat ✅ 0.05655 0.05787
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 106.12100 97.99350
Vampire vampire4.2-smt vampire unsat ✅ 3.81260 14.86000
Z3 z3-4.5.0 default unsat ✅ 0.06099 0.05754
SMT-COMP 2018 0.33 (2/3) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.02000 1181.14000
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 243.97300 969.33000
Z3 z3-4.7.1_default unsat ✅ 0.06076 0.06069
SMT-COMP 2020 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.03000 4758.57000
CVC4 CVC4-sq-final_default unsat ✅ 104.34700 99.33840
Par4 Par4-wrapped-sq_default unsat ✅ 0.06948 0.00595
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.33677 3.55561
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 7.33779 28.81000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 245.11600 972.71000
Z3 z3-4.8.8_default unsat ✅ 0.05931 0.05924
SMT-COMP 2022 0.20 (4/5) CVC4 CVC4-sq-final_default unsat ✅ 290.37700 272.26900
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 211.61000 211.19300
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.82545 4.68068
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.58569 0.46762
Z3 z3-4.8.17_default unsat ✅ 0.04740 0.04921
SMT-COMP 2023 0.50 (2/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 211.94900 210.87100
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 211.66300 211.23100
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.10000 4743.51000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.96173 4.81962
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 3.56780 14.03000
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 210.54723 210.40169
iProver iProver v3.9 unsat ✅ 27.92912 102.11825
SMTInterpol SMTInterpol unsat ✅ 9.83810 24.65899