Benchmark

non-incremental/UF/sledgehammer/StrongNorm/uf.727547.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size6564
Compressed Size1488
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 6556
Compressed Size1488
Max. Term Depth12
Asserts 40
Declared Functions23
Declared Constants28
Declared Sorts 23
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false4 not2 and5 =>34
=91 forall23 exists3 let1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2399.69000 2400.50000
CVC4 CVC4 f7118b2 default sat ✅ 41.00270 41.00680
veriT veriT-smtcomp2014 default unknown ❌ 72.10680 72.13300
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.12000 2400.04000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2400.30000 2401.23000
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.07870 20.08290
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.08490 20.08890
veriT veriT default unknown ❌ 739.43000 739.55500
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.94000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 324.74000 302.64800
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.73258 9.77587
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.07148 0.07036
veriT veriT-dev default unknown ❌ 1355.62000 1354.24000
Z3 z3-4.4.1 default unknown ❌ 2400.11000 2401.22000
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 456.15400 451.27400
Vampire vampire4.2-smt vampire sat ✅ 0.28437 0.07658
veriT veriT-2017-06-17 default unknown ❌ 600.01600 599.92000
Z3 z3-4.5.0 default unknown ❌ 600.05000 599.95600
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 483.95500 481.12700
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.19468 0.10327
veriT veriT_default unknown ❌ 1200.02000 1199.85000
Z3 z3-4.7.1_default unknown ❌ 1200.10000 1199.99000
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.10000 9513.58000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 966.18900 961.53200
master-2018-06-10-b19c840-competition-default_default sat ✅ 483.13600 480.96500
Par4 Par4-wrapped-sq_default sat ✅ 482.76000 1445.90000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.06000 2421.77000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.31929 3.50391
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.14089 3.52093
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.31468 3.48642
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 0.53425 0.27599
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.09610 0.09653
veriT veriT-wrapped-sq_default unknown ❌ 2400.02000 2399.52000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.70000
SMT-COMP 2020 0.71 (2/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.06000 4766.75000
CVC4 CVC4-sq-final_default sat ✅ 485.24000 481.09000
CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 963.56100 1021.11000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.04000 1218.35000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.26995 3.49448
Vampire vampire_smt_4.5_vampire_smtcomp sat ✅ 0.13413 0.07589
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.16643 0.09850
veriT veriT_default unknown ❌ 1200.06000 1199.90000
veriT+vite_default unknown ❌ 1200.03000 1199.80000
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.69000
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 485.40800 481.21500
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 514.58000 511.06900
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.90732 4.99902
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp sat ✅ 0.15925 0.09653
veriT veriT_default unknown ❌ 1200.05000 1199.90000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.01000 1199.75000
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.98000
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 519.88700 511.46300
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 512.22800 510.81600
iProver iProver-3.8-fix_iprover_SMT sat ✅ 338.91200 1335.53000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 1230.50000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.79047 4.86607
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.17521 0.10018
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.90000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 sat ✅ 540.43165 540.32750
iProver iProver v3.9 sat ✅ 0.82754 1.87861
SMTInterpol SMTInterpol unknown ❌ 1201.71768 1235.29378
Yices2 Yices2 unknown ❌ 1201.32493 1201.08979
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 sat ✅ 540.46854 540.27381
iProver iProver v3.9.3 sat ✅ 0.89440 1.93548
SMTInterpol SMTInterpol unknown ❌ 1201.48350 1251.01292
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.92543 3.84720
Yices2 Yices2 unknown ❌ 1201.45561 1201.21266