Benchmark

non-incremental/UFLIA/sledgehammer/QEpres/smtlib.734483.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size11556
Compressed Size2279
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 11548
Compressed Size2295
Max. Term Depth12
Asserts 72
Declared Functions26
Declared Constants25
Declared Sorts 23
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false2 ite2 not7
and8 =>87 =74 forall71
exists1 let19 Int157 +32
-29 *8 <56 <=58

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.50 (2/4) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.08900 589.25600
Vampire vampire4.2-smt vampire unsat ✅ 0.06316 0.06030
veriT veriT-2017-06-17 default unsat ✅ 0.01844 0.01822
Z3 z3-4.5.0 default unknown ❌ 392.91100 392.55900
SMT-COMP 2018 0.50 (2/4) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.02000 1192.41000
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.06915 0.10551
veriT veriT_default unsat ✅ 0.01895 0.01921
Z3 z3-4.7.1_default unknown ❌ 1200.06000 1200.00000
SMT-COMP 2019 0.50 (4/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.05220 0.05295
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.11000 2388.35000
master-2018-06-10-b19c840-competition-default_default unknown ❌ 2400.03000 2389.64000
Par4 Par4-wrapped-sq_default unsat ✅ 0.03021 0.00566
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.06000 2715.14000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.51713 3.41050
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.03540 3.40567
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.45025 3.44567
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.20650 0.20643
veriT veriT-wrapped-sq_default unsat ✅ 0.02321 0.02357
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 142.77300 142.74100
SMT-COMP 2020 0.50 (4/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.06108 0.06167
CVC4 CVC4-sq-final_default unknown ❌ 1200.02000 1190.15000
Par4 Par4-wrapped-sq_default unsat ✅ 0.03157 0.00635
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.12000 4175.12000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.45801 3.62686
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.09652 0.09602
veriT veriT_default unsat ✅ 0.02463 0.02499
veriT+vite_default unsat ✅ 0.02802 0.02835
Z3 z3-4.8.8_default unknown ❌ 400.81000 400.64800
SMT-COMP 2022 0.67 (2/6) CVC4 CVC4-sq-final_default unknown ❌ 1200.02000 1182.96000
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.03000 1194.65000
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.91981 4.96055
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.17473 0.11116
veriT veriT_default unsat ✅ 0.02719 0.02755
Z3 z3-4.8.17_default unknown ❌ 1200.03000 1199.86000