Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.710176.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size96355
Compressed Size14998
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 96347
Compressed Size15071
Max. Term Depth14
Asserts 515
Declared Functions154
Declared Constants155
Declared Sorts 160
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3 false65 ite27 not120
or19 and81 =>527 =1412
forall561 exists41 let137

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.16385 0.15498
CVC4 CVC4 f7118b2 default unsat ✅ 0.21621 0.20497
veriT veriT-smtcomp2014 default unsat ✅ 0.08243 0.07099
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.09788 0.08998
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.15544 0.15498
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.23133 0.22896
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.22673 0.22296
veriT veriT default unsat ✅ 0.09892 0.09798
Z3 z3 4.4.0 default unsat ✅ 0.10686 0.10698
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.27510 0.27545
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 35.28720 35.37000
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 3.68760 14.45000
veriT veriT-dev default unsat ✅ 0.05745 0.05770
Z3 z3-4.4.1 default unsat ✅ 0.11335 0.11472
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.27820 0.27237
Vampire vampire4.2-smt vampire unsat ✅ 8.60898 33.77000
veriT veriT-2017-06-17 default unsat ✅ 0.07932 0.07909
Z3 z3-4.5.0 default unsat ✅ 0.11417 0.11310
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.30089 0.30108
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 357.14400 1419.76000
veriT veriT_default unsat ✅ 0.08743 0.08769
Z3 z3-4.7.1_default unsat ✅ 0.12227 0.12219
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.19369 0.19289
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.30009 0.30040
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.30549 0.30578
Par4 Par4-wrapped-sq_default unsat ✅ 0.09740 0.00561
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.06000 2406.19000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.47171 3.83573
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.07073 3.58333
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.39496 3.83039
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 40.59500 160.72000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 359.47300 1427.36000
veriT veriT-wrapped-sq_default unsat ✅ 0.09273 0.09305
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.12925 0.12924
SMT-COMP 2020 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.22976 0.22693
CVC4 CVC4-sq-final_default unsat ✅ 0.34906 0.34938
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.30036 0.30014
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1212.81000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.40822 3.91369
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 27.74870 109.84000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 357.27600 1414.93000
veriT veriT_default unsat ✅ 0.06950 0.06981
veriT+vite_default unsat ✅ 0.06844 0.06878
Z3 z3-4.8.8_default unsat ✅ 0.13663 0.13659
SMT-COMP 2022 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.35314 0.35350
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.33524 0.33576
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.09782 6.01317
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 37.24420 147.42000
veriT veriT_default unsat ✅ 0.06463 0.06500
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.10000 1199.99000
Z3 z3-4.8.17_default unsat ✅ 0.13459 0.13631
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.29260 0.29312
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.33591 0.33560
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 87.23540 339.59000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 22.61020 37.89640
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.09796 5.19028
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 30.57200 121.07000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.11000 1199.91000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.37652 0.27666
iProver iProver v3.9 unsat ✅ 11.88664 40.94029
SMTInterpol SMTInterpol unknown ❌ 1202.75233 4424.32915
Yices2 Yices2 unknown ❌ 1201.37176 1201.19981