Benchmark

non-incremental/UFNIA/sledgehammer/QEpres/z3.602329.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size22265
Compressed Size4025
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 22257
Compressed Size4039
Max. Term Depth13
Asserts 143
Declared Functions39
Declared Constants35
Declared Sorts 35
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false10 ite12 not28
or10 and31 =>89 =249
forall142 exists8 let47 Int210
div2 mod3 +37 -33
*23 <52 <=34

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.02264 0.01300
CVC4 CVC4 f7118b2 default unknown ❌ 2399.71000 2400.08000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.04101 0.03199
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unknown ❌ 0.01426 0.01400
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.07869 0.07599
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.07849 0.07599
Z3 z3 4.4.0 default unsat ✅ 0.05503 0.05499
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 45.25420 41.28130
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.37416 0.37610
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.46500 0.34339
Z3 z3-4.4.1 default unsat ✅ 0.05550 0.05681
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 107.09800 97.92430
Vampire vampire4.2-smt vampire unsat ✅ 8.10791 31.97000
Z3 z3-4.5.0 default unsat ✅ 0.05854 0.05766
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 321.87700 271.75300
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 240.57000 955.53000
Z3 z3-4.7.1_default unsat ✅ 0.06096 0.06089
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 102.99600 100.05200
cvc5 cvc5-fixed_default unsat ✅ 211.32100 210.82900
Par4 Par4-wrapped-sq_default unsat ✅ 0.07621 0.00647
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 0.38750 0.60008
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.87988 4.70567
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 1.23452 4.77000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 7.51888 29.56000
Z3 z3-4.8.11_default unsat ✅ 0.04494 0.04487
SMT-COMP 2022 0.20 (4/5) CVC4 CVC4-sq-final_default unsat ✅ 283.89200 272.31200
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 211.46000 211.20400
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.71733 4.71429
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.80066 2.97000
Z3 z3-4.8.17_default unsat ✅ 0.04727 0.04914
SMT-COMP 2023 0.50 (2/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 211.81000 210.82100
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 211.59500 211.21800
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.04000 4751.95000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.90989 4.79909
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 85.86890 340.75000
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 210.49850 210.39602
iProver iProver v3.9 unsat ✅ 35.46527 131.40981
SMTInterpol SMTInterpol unsat ✅ 10.25309 25.95871