Benchmark

non-incremental/UFNIA/sledgehammer/QEpres/z3.1225273.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size92822
Compressed Size15852
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 92814
Compressed Size15846
Max. Term Depth13
Asserts 520
Declared Functions278
Declared Constants237
Declared Sorts 262
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false30 ite35 not97
or16 and62 =>246 =1032
forall580 exists38 let113 Int214
div2 mod2 +18 -17
*11 <15 <=5

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.06089 0.05999
CVC4 CVC4 f7118b2 default unsat ✅ 0.19135 0.18897
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 1333.76000 1334.24000
SMT-COMP 2015 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.04225 0.04199
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.21541 0.21297
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.21083 0.20697
Z3 z3 4.4.0 default unknown ❌ 330.77900 330.83800
SMT-COMP 2016 0.33 (2/3) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.25100 0.25130
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 3.88350 3.90317
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.63740 2.37000
Z3 z3-4.4.1 default unknown ❌ 0.09168 0.09331
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.25814 0.25808
Vampire vampire4.2-smt vampire unsat ✅ 3.08619 12.13000
Z3 z3-4.5.0 default unsat ✅ 0.13128 0.13073
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.28151 0.28172
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 4.48127 17.43000
Z3 z3-4.7.1_default unsat ✅ 0.11762 0.11754
SMT-COMP 2023 0.25 (3/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.29243 0.29296
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.35922 0.35847
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 3.66150 12.35000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.87606 5.05122
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.84365 3.00000
SMT-COMP 2025 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.45540 0.33211
iProver iProver v3.9.3 unsat ✅ 18.97148 66.01593
SMTInterpol SMTInterpol unknown ❌ 1201.86862 3705.80737
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.01857 4.47064