Benchmark

non-incremental/UF/sledgehammer/StrongNorm/uf.571206.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size38969
Compressed Size6081
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 38961
Compressed Size6041
Max. Term Depth15
Asserts 291
Declared Functions31
Declared Constants29
Declared Sorts 33
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false34 ite7 not43 or9
and17 =>180 =593 forall296
exists11 let86

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.13270 0.13198
CVC4 CVC4 f7118b2 default unsat ✅ 0.41116 0.39894
veriT veriT-smtcomp2014 default unsat ✅ 0.10878 0.09998
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.06835 0.06699
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.61171 0.61091
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.25747 0.25496
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.25744 0.25496
veriT veriT default unsat ✅ 0.19422 0.19297
Z3 z3 4.4.0 default unsat ✅ 0.10918 0.10898
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.34344 0.34384
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.37374 0.37537
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.48577 0.47539
veriT veriT-dev default unsat ✅ 0.13355 0.13386
Z3 z3-4.4.1 default unsat ✅ 0.23865 0.24012
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.36043 0.36048
Vampire vampire4.2-smt vampire unsat ✅ 4.30363 16.99000
veriT veriT-2017-06-17 default unsat ✅ 0.34273 0.34209
Z3 z3-4.5.0 default unsat ✅ 0.11804 0.11692
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.35718 0.35737
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 123.64600 491.38000
veriT veriT_default unsat ✅ 0.34396 0.33979
Z3 z3-4.7.1_default unsat ✅ 0.10736 0.10727
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 1.09568 4.19000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.35539 0.35569
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.36185 0.36211
Par4 Par4-wrapped-sq_default unsat ✅ 0.11347 0.00583
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2406.27000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.42855 3.39502
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.11760 3.39901
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.42479 3.39212
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 5.61632 22.00000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 173.18000 687.75000
veriT veriT-wrapped-sq_default unsat ✅ 0.34124 0.34158
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.11177 0.11176
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.37623 0.37651
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 1.80656 5.09461
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.03000 3845.09000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.83730 4.84868
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 3.36066 12.99000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 3.13359 12.21000
veriT veriT_default unsat ✅ 0.10233 0.10271
Z3 z3-4.8.11_default unsat ✅ 0.22893 0.22447
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 0.48421 0.35999
iProver iProver v3.9.3 unsat ✅ 1.35428 3.81602
SMTInterpol SMTInterpol unknown ❌ 1201.88477 4726.71519
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.97775 4.24581
Yices2 Yices2 unsat ✅ 10.34308 10.22310