Benchmark

non-incremental/UF/sledgehammer/StrongNorm/uf.680521.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size90933
Compressed Size14992
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 90925
Compressed Size14990
Max. Term Depth15
Asserts 479
Declared Functions206
Declared Constants176
Declared Sorts 223
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false85 ite9 not51 or29
and183 =>274 =1194 forall513
exists72 let131

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.16860 0.15698
CVC4 CVC4 f7118b2 default unsat ✅ 0.34356 0.33295
veriT veriT-smtcomp2014 default unsat ✅ 0.10702 0.09799
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.09303 0.08499
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.15678 0.15598
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.36532 0.36294
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.36338 0.36094
veriT veriT default unsat ✅ 0.13832 0.13698
Z3 z3 4.4.0 default unsat ✅ 0.11587 0.11598
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.35038 0.35084
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 245.08700 246.20200
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 34.54980 137.04000
veriT veriT-dev default unsat ✅ 0.05781 0.05812
Z3 z3-4.4.1 default unsat ✅ 0.10847 0.10977
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.33593 0.33442
Vampire vampire4.2-smt vampire unsat ✅ 2.75858 10.76000
veriT veriT-2017-06-17 default unsat ✅ 0.08811 0.08742
Z3 z3-4.5.0 default unsat ✅ 0.11791 0.11720
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.36483 0.36503
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 836.06200 3324.87000
veriT veriT_default unsat ✅ 0.09727 0.09750
Z3 z3-4.7.1_default unsat ✅ 0.12480 0.12472
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.32434 0.32413
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.35349 0.35381
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.35891 0.35907
Par4 Par4-wrapped-sq_default unsat ✅ 0.10977 0.00604
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.02000 2407.19000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.54742 3.82841
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.21721 3.57539
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.39289 3.90030
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 62.25990 245.65000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 831.34000 3300.84000
veriT veriT-wrapped-sq_default unsat ✅ 0.10212 0.10228
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.13305 0.13300
SMT-COMP 2022 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 0.39816 0.39842
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.36753 0.36807
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.96840 5.49414
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 113.29100 449.49000
veriT veriT_default unsat ✅ 0.06231 0.06266
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.29173 0.29167
Z3 z3-4.8.17_default unsat ✅ 0.13308 0.13490
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.33910 0.33965
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.36442 0.36492
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 2.15601 7.30000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.04000 1515.27000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 68.92190 5.02403
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 88.68700 351.46000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.49521 0.49515
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 unsat ✅ 0.43543 0.33553
iProver iProver v3.9 unsat ✅ 3.41362 10.29656
SMTInterpol SMTInterpol unknown ❌ 982.56885 3711.44059
Yices2 Yices2 unsat ✅ 0.40690 0.30690
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 0.50268 0.38222
iProver iProver v3.9.3 unsat ✅ 2.36530 6.92583
SMTInterpol SMTInterpol unknown ❌ 1123.03359 4068.52723
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.05766 4.44736
Yices2 Yices2 unsat ✅ 0.46852 0.35084