Benchmark

non-incremental/UF/sledgehammer/NS_Shared/uf.738125.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size95195
Compressed Size14193
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 95187
Compressed Size14227
Max. Term Depth20
Asserts 479
Declared Functions208
Declared Constants151
Declared Sorts 221
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true8 false41 ite5 not126
or31 and33 =>422 =1087
forall476 exists10 let240

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2401.21000 2401.86000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 61.10560 61.11470
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 77.10670 61.17270
veriT veriT default unknown ❌ 2400.01000 2400.99000
Z3 z3 4.4.0 default unknown ❌ 1297.12000 1296.09000
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 63.07270 60.96780
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 96.22070 96.69620
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 24.75160 98.10000
veriT veriT-dev default unsat ✅ 0.19756 0.19787
Z3 z3-4.4.1 default unknown ❌ 2400.03000 2400.90000
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.84016 0.83981
Vampire vampire4.2-smt vampire unsat ✅ 30.35100 120.47000
veriT veriT-2017-06-17 default unsat ✅ 6.25121 6.25093
Z3 z3-4.5.0 default unknown ❌ 600.01300 599.83000
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.79043 0.79050
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.11000 4774.77000
veriT veriT_default unsat ✅ 6.27810 6.27631
Z3 z3-4.7.1_default unknown ❌ 984.11600 983.87000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 809.53200 3215.07000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.60084 0.60115
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.61200 0.61223
Par4 Par4-wrapped-sq_default unsat ✅ 0.65812 1.79000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.11000 2403.10000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.59351 3.82387
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.02782 3.60390
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.38206 3.90053
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 779.46500 3120.15000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 2400.10000 9534.39000
veriT veriT-wrapped-sq_default unsat ✅ 6.25219 6.25115
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 441.22600 441.14900
SMT-COMP 2020 0.57 (3/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.03000 4761.33000
CVC4 CVC4-sq-final_default unsat ✅ 0.81105 0.81140
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.72941 0.72970
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.04000 1278.77000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.41788 3.96596
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 313.76100 1136.37000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.04000 4765.71000
veriT veriT_default unsat ✅ 0.20170 0.20205
veriT+vite_default unsat ✅ 0.26432 0.26464
Z3 z3-4.8.8_default unknown ❌ 1200.09000 1200.03000
SMT-COMP 2021 0.57 (3/7) CVC4 CVC4-sq-final_default unsat ✅ 0.66740 0.66752
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.11000 4747.10000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.06000 1272.37000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.99603 10.60640
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 619.94600 2349.86000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 555.07200 2097.85000
veriT veriT_default unsat ✅ 0.13279 0.13317
Z3 z3-4.8.11_default unknown ❌ 572.92200 572.79700