Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.1087428.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size12287
Compressed Size2110
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 12279
Compressed Size2115
Max. Term Depth8
Asserts 75
Declared Functions31
Declared Constants22
Declared Sorts 35
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false9 not3 and5 =>101
=212 forall72 exists3 let22

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2403.88000 2404.29000
CVC4 CVC4 f7118b2 default sat ✅ 40.60770 40.58280
veriT veriT-smtcomp2014 default unknown ❌ 2399.12000 2400.03000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.21000 2400.07000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 1333.19000 1333.27000
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.25880 20.25890
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.26450 20.26190
veriT veriT default unknown ❌ 321.49000 321.59100
Z3 z3 4.4.0 default unknown ❌ 867.91800 868.28100
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 318.38500 302.64700
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.83313 9.87726
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.17207 0.17160
veriT veriT-dev default unknown ❌ 2400.07000 2401.31000
Z3 z3-4.4.1 default unknown ❌ 2238.49000 2239.49000
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 453.37000 451.19500
Vampire vampire4.2-smt vampire sat ✅ 0.28703 0.15189
veriT veriT-2017-06-17 default unknown ❌ 600.01700 599.89000
Z3 z3-4.5.0 default unknown ❌ 600.01300 599.85000
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 492.39200 481.86900
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.20298 0.20311
veriT veriT_default unknown ❌ 1200.02000 1199.78000
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.86000
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.05000 9518.83000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 987.77600 964.65100
master-2018-06-10-b19c840-competition-default_default sat ✅ 488.45400 481.88400
Par4 Par4-wrapped-sq_default sat ✅ 487.04200 1485.03000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2438.26000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.38248 3.41934
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.06843 3.43616
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.41356 3.40880
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 1.31179 4.79000
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.26348 0.25577
veriT veriT-wrapped-sq_default unknown ❌ 2400.08000 2399.97000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 1158.40000 1158.22000
SMT-COMP 2020 0.71 (2/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.04000 4762.24000
CVC4 CVC4-sq-final_default sat ✅ 491.02800 482.25100
CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 992.56600 964.27100
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.13000 1719.05000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.32288 3.43999
Vampire vampire_smt_4.5_vampire_smtcomp sat ✅ 0.20619 0.11553
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.39820 0.24279
veriT veriT_default unknown ❌ 1200.02000 1200.00000
veriT+vite_default unknown ❌ 1200.02000 1199.80000
Z3 z3-4.8.8_default unknown ❌ 714.06900 713.84200
SMT-COMP 2021 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 496.14100 482.64700
iProver iProver-v3.5-final-fix2_iProver_SMT sat ✅ 0.81948 0.64268
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.04000 1220.79000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.86856 4.99955
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 0.26914 0.15010
vampire_smt_4.5_vampire_smtcomp sat ✅ 0.22228 0.12306
veriT veriT_default unknown ❌ 1200.02000 1199.74000
Z3 z3-4.8.11_default unknown ❌ 1120.56000 1120.51000
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 506.29300 483.25200
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 535.09300 513.34000
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.91554 4.75711
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp sat ✅ 0.28657 0.16061
veriT veriT_default unknown ❌ 1200.02000 1199.82000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.04000 1199.92000
Z3 z3-4.8.17_default unknown ❌ 1200.03000 1199.44000
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 556.32300 513.81700
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 538.70300 513.18600
iProver iProver-3.8-fix_iprover_SMT sat ✅ 339.43000 1378.12000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.04000 1229.99000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.78880 4.74256
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.20078 0.15040
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.12000 1200.04000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 sat ✅ 540.67191 540.30526
iProver iProver v3.9 sat ✅ 1.42909 3.97872
SMTInterpol SMTInterpol unknown ❌ 1201.71735 1238.32349
Yices2 Yices2 unknown ❌ 1201.37102 1201.11913
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 sat ✅ 540.66335 540.44415
iProver iProver v3.9.3 sat ✅ 0.85836 2.09223
SMTInterpol SMTInterpol unknown ❌ 1201.79551 1248.20062
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.88943 3.98591
Yices2 Yices2 unknown ❌ 1201.40620 1201.13748