Benchmark

non-incremental/UF/sledgehammer/StrongNorm/uf.574168.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size6053
Compressed Size1476
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 6045
Compressed Size1468
Max. Term Depth10
Asserts 41
Declared Functions30
Declared Constants28
Declared Sorts 40
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite2 not2 and3 =>6
=71 forall28 let1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01848 0.01800
CVC4 CVC4 f7118b2 default sat ✅ 40.34630 40.34090
veriT veriT-smtcomp2014 default unknown ❌ 55.54730 55.56160
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.02776 0.01900
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01582 0.01500
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.12710 20.13090
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.12740 20.12990
veriT veriT default unknown ❌ 455.21800 447.88000
Z3 z3 4.4.0 default sat ✅ 0.04280 0.04299
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 302.38600 300.61900
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.71943 9.76445
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.07864 0.06284
veriT veriT-dev default unknown ❌ 2400.02000 2401.25000
Z3 z3-4.4.1 default sat ✅ 0.04238 0.04361
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 450.26500 450.18500
Vampire vampire4.2-smt vampire sat ✅ 0.12454 0.06455
veriT veriT-2017-06-17 default unknown ❌ 600.11000 599.99000
Z3 z3-4.5.0 default sat ✅ 0.04920 0.04795
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 484.12400 480.76400
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.10033 0.09355
veriT veriT_default unknown ❌ 1115.93000 1115.74000
Z3 z3-4.7.1_default sat ✅ 0.05657 0.05650
SMT-COMP 2019 0.50 (4/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.03000 3440.11000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 961.25300 960.66700
master-2018-06-10-b19c840-competition-default_default sat ✅ 481.89300 480.59500
Par4 Par4-wrapped-sq_default sat ✅ 0.06871 0.00573
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.07000 2408.67000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.36086 3.42635
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.15283 3.35610
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.24985 3.39905
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 0.39968 0.20783
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.17145 0.09327
veriT veriT-wrapped-sq_default unknown ❌ 1235.17000 1235.05000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.06132 0.06136
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default sat ✅ 481.58800 510.76800
iProver iProver-v3.5-final-fix2_iProver_SMT sat ✅ 0.93499 1.63030
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.02000 1219.83000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.90007 4.90021
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 0.15444 0.08227
vampire_smt_4.5_vampire_smtcomp sat ✅ 0.11766 0.06740
veriT veriT_default unknown ❌ 1200.02000 1199.78000
Z3 z3-4.8.11_default sat ✅ 0.04057 0.04054
SMT-COMP 2022 0.43 (4/7) CVC4 CVC4-sq-final_default sat ✅ 482.12900 480.77700
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 510.88100 510.53300
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.97915 5.05462
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp sat ✅ 0.13806 0.08512
veriT veriT_default unknown ❌ 1200.10000 1199.96000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.02000 1199.91000
Z3 z3-4.8.17_default sat ✅ 0.04199 0.04377
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 528.91300 512.35300
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 511.84000 510.61200
iProver iProver-3.8-fix_iprover_SMT sat ✅ 339.91200 1336.95000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.12000 1218.00000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.70790 4.67485
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.14403 0.08358
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.05000 1199.91000