Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.595955.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size39494
Compressed Size6110
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 39486
Compressed Size6120
Max. Term Depth14
Asserts 235
Declared Functions38
Declared Constants45
Declared Sorts 44
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false28 ite4 not51
or8 and25 =>288 =653
forall253 exists11 let90

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 6.13765 6.13207
CVC4 CVC4 f7118b2 default unsat ✅ 63.91380 63.89530
veriT veriT-smtcomp2014 default unknown ❌ 203.41400 203.43200
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.41645 0.40794
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 3.24388 3.24451
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.24059 4.23935
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 4.89435 4.89325
veriT veriT default unsat ✅ 743.00500 743.31800
Z3 z3 4.4.0 default unsat ✅ 0.45584 0.45593
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.22466 2.22600
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 182.14600 183.13500
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 1000.10000 3611.56000
veriT veriT-dev default unsat ✅ 23.21370 23.22930
Z3 z3-4.4.1 default unsat ✅ 0.19913 0.20055
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.62520 0.62501
Vampire vampire4.2-smt vampire unsat ✅ 6.59776 26.00000
veriT veriT-2017-06-17 default unsat ✅ 42.81900 42.81780
Z3 z3-4.5.0 default unsat ✅ 0.22831 0.22694
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.66999 0.67007
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 140.03600 556.75000
veriT veriT_default unsat ✅ 42.89530 42.89290
Z3 z3-4.7.1_default unsat ✅ 17.12390 17.12260
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 62.62750 248.55000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.59750 0.59777
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.68348 0.68377
Par4 Par4-wrapped-sq_default unsat ✅ 0.11039 0.00577
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.02000 2402.12000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.33348 3.44598
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.14316 3.31392
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.37338 3.47495
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 160.19000 636.25000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 133.77000 531.29000
veriT veriT-wrapped-sq_default unsat ✅ 42.88290 42.88020
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.10468 0.10468
SMT-COMP 2020 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 8.45019 33.38000
CVC4 CVC4-sq-final_default unsat ✅ 0.62964 0.62990
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.60424 0.60457
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.08000 1214.54000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.42771 3.47688
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 54.79130 217.09000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 132.35100 525.48000
veriT veriT_default unsat ✅ 0.36229 0.36256
veriT+vite_default unsat ✅ 0.47449 0.47482
Z3 z3-4.8.8_default unsat ✅ 0.15496 0.15491