Benchmark

non-incremental/UFLIA/sledgehammer/QEpres/smtlib.978326.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size85338
Compressed Size13085
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 85330
Compressed Size13104
Max. Term Depth14
Asserts 508
Declared Functions96
Declared Constants150
Declared Sorts 102
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true5 false60 ite26 not171
or18 and92 =>537 =1388
forall572 exists45 let123 Int223
-4 <5 <=9

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.00959 0.00900
CVC4 CVC4 f7118b2 default unsat ✅ 20.87900 20.87480
veriT veriT-smtcomp2014 default unsat ✅ 0.12720 0.11798
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.09930 0.09098
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.00960 0.00900
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.55324 0.55092
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.57803 0.57491
veriT veriT default unsat ✅ 0.17251 0.17197
Z3 z3 4.4.0 default unsat ✅ 0.10252 0.10298
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.47862 0.47920
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 3.04530 3.05970
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.34456 0.34392
veriT veriT-dev default unsat ✅ 0.05762 0.05785
Z3 z3-4.4.1 default unsat ✅ 0.11030 0.11163
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.30500 0.30498
Vampire vampire4.2-smt vampire unsat ✅ 0.43228 0.42917
veriT veriT-2017-06-17 default unsat ✅ 0.06692 0.06710
Z3 z3-4.5.0 default unsat ✅ 0.12182 0.11811
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.33016 0.33036
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.68582 2.41000
veriT veriT_default unsat ✅ 0.08545 0.08568
Z3 z3-4.7.1_default unsat ✅ 0.11893 0.11886
SMT-COMP 2024 0.33 (2/3) cvc5 cvc5 unsat ✅ 0.41997 0.32052
iProver iProver v3.9 unsat ✅ 11.94061 38.52743
SMTInterpol SMTInterpol unknown ❌ 1202.74631 4499.25419
SMT-COMP 2025 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.43931 0.31650
iProver iProver v3.9.3 unsat ✅ 10.95463 35.71651
SMTInterpol SMTInterpol unknown ❌ 1013.28485 3698.78012
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.98269 4.29640