Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.939629.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size10253
Compressed Size2072
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 10245
Compressed Size2094
Max. Term Depth13
Asserts 55
Declared Functions26
Declared Constants26
Declared Sorts 32
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false18 not14 and6
=>54 =135 forall65 exists4
let17

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.67145 0.66290
CVC4 CVC4 f7118b2 default unsat ✅ 489.43700 489.37900
veriT veriT-smtcomp2014 default unknown ❌ 2399.02000 2400.05000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.08761 0.07999
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 27.43480 27.44580
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 40.70490 40.71280
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 40.72580 40.73280
veriT veriT default unknown ❌ 2400.01000 2401.03000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.74000
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 31.22090 20.90070
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 28.58970 28.72540
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 1.47265 5.39000
veriT veriT-dev default unknown ❌ 2400.02000 2401.34000
Z3 z3-4.4.1 default unsat ✅ 0.42120 0.42271
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 20.25900 20.25760
Vampire vampire4.2-smt vampire unsat ✅ 6.05344 23.93000
veriT veriT-2017-06-17 default unsat ✅ 0.02373 0.02364
Z3 z3-4.5.0 default unsat ✅ 0.23864 0.23228
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 30.86150 30.25840
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.50145 0.37033
veriT veriT_default unsat ✅ 0.02556 0.02581
Z3 z3-4.7.1_default unsat ✅ 5.30071 5.30041
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.08000 9518.34000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 60.86470 60.38330
master-2018-06-10-b19c840-competition-default_default unsat ✅ 30.38830 30.32180
Par4 Par4-wrapped-sq_default unsat ✅ 0.03728 0.00594
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.02000 2487.06000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.35434 3.41670
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.07316 3.33477
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.31140 3.40112
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 1.30725 4.37360
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.23749 0.23712
veriT veriT-wrapped-sq_default unsat ✅ 0.02878 0.02909
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.22736 0.22736
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.03000 4765.81000
CVC4 CVC4-sq-final_default unsat ✅ 30.15520 30.15400
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 60.54970 60.17770
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 994.71900 3648.61000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.21207 3.46529
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.49930 0.30670
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.50533 0.38194
veriT veriT_default unsat ✅ 0.08107 0.08137
veriT+vite_default unsat ✅ 0.08529 0.08560
Z3 z3-4.8.8_default unsat ✅ 39.76640 39.76410
SMT-COMP 2022 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 30.18500 30.16100
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.09558 0.09595
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.95127 4.89644
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.56500 2.05000
veriT veriT_default unsat ✅ 1.03086 1.03135
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.02000 1199.83000
Z3 z3-4.8.17_default unsat ✅ 199.30200 199.22800
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.06914 0.06965
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.15049 0.15081
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 18.19050 69.50380
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 3.67483 9.46121
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.82225 4.85464
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.67672 2.46000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.93000
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 unsat ✅ 0.24988 0.15013
iProver iProver v3.9 unsat ✅ 2.87931 8.96400
SMTInterpol SMTInterpol unsat ✅ 2.98326 8.54807
Yices2 Yices2 unknown ❌ 1201.29263 1200.89453
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 0.37757 0.20344
iProver iProver v3.9.3 unsat ✅ 2.40277 7.25734
SMTInterpol SMTInterpol unsat ✅ 5.56035 13.51526
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.92202 4.05286
Yices2 Yices2 unknown ❌ 1201.37857 1201.10884