Benchmark

non-incremental/UFLIA/sledgehammer/QEpres/smtlib.693412.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size2201
Compressed Size689
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status None
Size 2193
Compressed Size690
Max. Term Depth6
Asserts 15
Declared Functions10
Declared Constants14
Declared Sorts 8
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false2 not2 and3
=29 forall10 Int9 <2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.01651 0.00800
CVC4 CVC4 f7118b2 default unknown ❌ 0.31155 0.28596
veriT veriT-smtcomp2014 default unknown ❌ 0.01215 0.00300
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.03778 0.03000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.00877 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 0.50863 0.48393
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 0.51863 0.49392
veriT veriT default unknown ❌ 0.00845 0.00200
Z3 z3 4.4.0 default sat ✅ 0.05073 0.05099
SMT-COMP 2016 0.75 (1/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 0.45279 0.45546
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 994.84500 1000.75000
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 1009.57000 3940.28000
veriT veriT-dev default unknown ❌ 0.06256 0.07047
Z3 z3-4.4.1 default sat ✅ 0.05120 0.05245
SMT-COMP 2017 0.75 (1/4) CVC4 CVC4-smtcomp2017-main default unknown ❌ 0.87122 0.87342
Vampire vampire4.2-smt vampire unknown ❌ 600.06900 2331.45000
veriT veriT-2017-06-17 default unknown ❌ 0.08942 0.10217
Z3 z3-4.5.0 default sat ✅ 0.05762 0.05716
SMT-COMP 2018 0.75 (1/4) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 0.91590 0.91820
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.04000 4774.59000
veriT veriT_default unknown ❌ 0.08938 0.09706
Z3 z3-4.7.1_default sat ✅ 0.06537 0.06530
SMT-COMP 2022 0.83 (1/6) CVC4 CVC4-sq-final_default unknown ❌ 0.68274 0.68681
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 0.83497 0.83845
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.05791 5.20783
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 1200.03000 4790.91000
veriT veriT_default unknown ❌ 0.07959 0.08297
Z3 z3-4.8.17_default sat ✅ 0.04950 0.05127
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unknown ❌ 60.74720 60.61601
iProver iProver v3.9 unknown ❌ 1201.74091 4745.98520
SMTInterpol SMTInterpol sat ✅ 0.63685 1.18748