Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.588744.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size1797
Compressed Size651
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1789
Compressed Size651
Max. Term Depth9
Asserts 5
Declared Functions9
Declared Constants9
Declared Sorts 12
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not2 =>6 =15 forall7
let1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.13370 0.12198
CVC4 CVC4 f7118b2 default sat ✅ 40.09100 40.08590
veriT veriT-smtcomp2014 default unknown ❌ 2399.12000 2400.07000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.01741 0.01600
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.11879 0.11798
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.03280 20.03400
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.03770 20.03800
veriT veriT default unknown ❌ 2400.01000 2401.15000
Z3 z3 4.4.0 default sat ✅ 0.03962 0.03899
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 300.33900 300.48900
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.70235 9.74629
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.04415 0.04423
veriT veriT-dev default unknown ❌ 126.81800 126.88800
Z3 z3-4.4.1 default sat ✅ 0.04105 0.04225
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 450.50600 450.46300
Vampire vampire4.2-smt vampire sat ✅ 0.05324 0.07681
veriT veriT-2017-06-17 default unknown ❌ 600.10700 704.49300
Z3 z3-4.5.0 default sat ✅ 0.04583 0.04500
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 480.56800 480.48400
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.20552 0.16183
veriT veriT_default unknown ❌ 818.80900 818.75800
Z3 z3-4.7.1_default sat ✅ 0.05339 0.05334
SMT-COMP 2019 0.50 (4/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 0.05602 0.15289
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 960.79900 960.71000
master-2018-06-10-b19c840-competition-default_default sat ✅ 480.98300 480.59000
Par4 Par4-wrapped-sq_default sat ✅ 0.07127 0.00578
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.06000 2402.88000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.37923 3.33918
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.21167 3.25472
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.28018 3.31146
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 0.30704 0.23471
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.07276 0.07035
veriT veriT-wrapped-sq_default unknown ❌ 749.44800 749.36900
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.06001 0.06003
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default sat ✅ 480.64500 480.63400
iProver iProver-v3.5-final-fix2_iProver_SMT sat ✅ 0.76387 0.49149
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.05000 1215.85000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 5.52627 10.98990
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 0.09866 0.06087
vampire_smt_4.5_vampire_smtcomp sat ✅ 0.09017 0.05224
veriT veriT_default unknown ❌ 520.40000 520.37800
Z3 z3-4.8.11_default sat ✅ 0.04562 0.04558
SMT-COMP 2022 0.29 (5/7) CVC4 CVC4-sq-final_default sat ✅ 480.84300 480.61300
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 510.55000 510.53400
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.71666 9.44963
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp sat ✅ 0.13038 0.08198
veriT veriT_default unknown ❌ 715.24800 715.23200
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.01161 0.00421
Z3 z3-4.8.17_default sat ✅ 0.04552 0.04731
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 525.55800 510.45600
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 510.56100 510.50000
iProver iProver-3.8-fix_iprover_SMT sat ✅ 0.65102 1.64000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 1219.13000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.91441 4.71950
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.10995 0.06590
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.01170 0.00402
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 sat ✅ 510.31437 510.13346
iProver iProver v3.9.3 sat ✅ 0.85076 1.06348
SMTInterpol SMTInterpol unknown ❌ 1201.35610 1235.82744
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.89871 4.03303
Yices2 Yices2 sat ✅ 0.25572 0.13300