Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.717436.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size6079
Compressed Size1431
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 6071
Compressed Size1431
Max. Term Depth11
Asserts 35
Declared Functions16
Declared Constants18
Declared Sorts 21
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false9 not13 or3
and6 =>24 =88 forall35
exists2 let10

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 1413.72000 1413.55000
CVC4 CVC4 f7118b2 default sat ✅ 40.34790 40.34290
veriT veriT-smtcomp2014 default unknown ❌ 2399.22000 2400.02000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.12000 2400.09000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2401.06000 2401.78000
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.42160 20.42190
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.42250 20.42590
veriT veriT default unknown ❌ 2400.01000 2400.91000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2401.02000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 314.00600 302.45500
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 13.12210 13.18560
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 4.56646 24.02860
veriT veriT-dev default unknown ❌ 2400.10000 2401.46000
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.32000
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 454.39400 451.11900
Vampire vampire4.2-smt vampire sat ✅ 0.34825 0.34686
veriT veriT-2017-06-17 default unknown ❌ 600.08200 599.98500
Z3 z3-4.5.0 default unknown ❌ 600.09400 600.05100
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 514.55300 481.24700
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 2.66009 10.17000
veriT veriT_default unknown ❌ 1200.12000 1200.02000
Z3 z3-4.7.1_default unknown ❌ 1200.09000 1199.93000
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.04000 9535.68000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 968.22900 961.94900
master-2018-06-10-b19c840-competition-default_default sat ✅ 482.58900 481.21100
Par4 Par4-wrapped-sq_default sat ✅ 482.23100 1445.32000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.08000 2452.75000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.40287 3.36477
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.05737 3.21268
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.41545 3.40799
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 2.89188 11.30000
vampire-4.3-smt_vampire_smtcomp sat ✅ 2.63897 10.10000
veriT veriT-wrapped-sq_default unknown ❌ 2400.05000 2399.81000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.70000
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default sat ✅ 484.45800 481.28100
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.05000 4751.57000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.05000 4316.19000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.99255 4.82295
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 0.40674 0.27558
vampire_smt_4.5_vampire_smtcomp sat ✅ 0.47433 0.24881
veriT veriT_default unknown ❌ 1200.01000 1199.76000
Z3 z3-4.8.11_default unknown ❌ 1200.05000 1199.84000
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 485.80000 481.32800
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 508.86200 505.42900
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.79059 4.72125
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp sat ✅ 0.69614 2.48000
veriT veriT_default unknown ❌ 1200.09000 1199.91000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.10000 1199.98000
Z3 z3-4.8.17_default unknown ❌ 1200.03000 1199.91000
SMT-COMP 2023 0.67 (2/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 514.52600 511.42800
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 513.77900 511.10800
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.13000 4743.74000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.02000 3294.37000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.75789 4.84811
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.58959 2.12000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.01000 1199.87000
SMT-COMP 2024 0.75 (1/4) cvc5 cvc5 sat ✅ 522.65408 522.28339
iProver iProver v3.9 unknown ❌ 1201.72458 4766.10454
SMTInterpol SMTInterpol unknown ❌ 1202.74530 1725.44232
Yices2 Yices2 unknown ❌ 1201.25507 1201.08027
SMT-COMP 2025 0.80 (1/5) cvc5 cvc5 sat ✅ 540.50788 540.28187
iProver iProver v3.9.3 unknown ❌ 1201.79531 4781.95338
SMTInterpol SMTInterpol unknown ❌ 560.62530 2144.52349
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.90060 3.80618
Yices2 Yices2 unknown ❌ 1201.37388 1201.13368