Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.1185112.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size24673
Compressed Size4255
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 24665
Compressed Size4269
Max. Term Depth14
Asserts 142
Declared Functions47
Declared Constants48
Declared Sorts 54
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3 false21 ite3 not45
or6 and31 =>96 =355
forall164 exists10 let23

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 2.17292 2.16567
CVC4 CVC4 f7118b2 default unsat ✅ 87.55830 87.50870
veriT veriT-smtcomp2014 default unsat ✅ 0.03684 0.02799
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.17896 0.17097
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 2402.15000 2402.69000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.22468 1.22081
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.21337 1.21081
veriT veriT default unsat ✅ 0.03129 0.03000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2401.02000
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 103.19000 91.69550
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.16320 0.16417
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.33061 0.16756
veriT veriT-dev default unsat ✅ 0.05399 0.05443
Z3 z3-4.4.1 default unsat ✅ 0.11193 0.11357
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.31514 0.31410
Vampire vampire4.2-smt vampire unsat ✅ 0.10664 0.10499
veriT veriT-2017-06-17 default unsat ✅ 6.03333 6.03264
Z3 z3-4.5.0 default unsat ✅ 0.21138 0.21035
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.32802 0.32823
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.12389 0.12336
veriT veriT_default unsat ✅ 6.04138 6.04119
Z3 z3-4.7.1_default unknown ❌ 1200.10000 1200.05000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 6.47391 25.48000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.34550 0.34586
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.34479 0.34506
Par4 Par4-wrapped-sq_default unsat ✅ 0.36248 0.00562
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2407.71000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.37518 3.44780
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 1.99769 3.29862
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.27985 3.38795
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 1.73364 6.37000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.25574 0.13155
veriT veriT-wrapped-sq_default unsat ✅ 6.04161 6.04069
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 1501.33000 1501.22000
SMT-COMP 2020 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.11961 0.11753
CVC4 CVC4-sq-final_default unsat ✅ 0.42500 0.42524
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.39726 0.39759
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.08000 1250.10000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.39341 3.59757
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.34277 0.29390
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.23363 0.12741
veriT veriT_default unsat ✅ 0.03679 0.03711
veriT+vite_default unsat ✅ 0.03647 0.03680
Z3 z3-4.8.8_default unsat ✅ 0.11918 0.11908
SMT-COMP 2022 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.38625 0.38661
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.27594 0.27583
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.86448 4.71770
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.26808 0.26848
veriT veriT_default unsat ✅ 2.55246 2.55324
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.09000 1200.03000
Z3 z3-4.8.17_default unknown ❌ 1200.05000 1199.94000
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.32340 0.32392
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.28305 0.28355
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 0.71440 1.89349
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.06000 4281.14000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.81088 4.70702
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.51093 0.32562
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.11000 1199.88000