Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/uf.850780.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size97472
Compressed Size13894
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 97464
Compressed Size13956
Max. Term Depth15
Asserts 513
Declared Functions266
Declared Constants189
Declared Sorts 296
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true17 false129 ite18 not104
or14 and13 =>701 =1330
distinct3 forall535 exists4 let89

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 64.56430 64.56820
CVC4 CVC4 f7118b2 default unsat ✅ 21.68560 21.67870
veriT veriT-smtcomp2014 default unknown ❌ 2399.21000 2400.09000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 89.96070 89.96830
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unsat ✅ 28.21230 28.22570
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 56.05930 56.07050
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 55.82340 55.81750
veriT veriT default unknown ❌ 1606.18000 1606.80000
Z3 z3 4.4.0 default unsat ✅ 96.88550 96.88430
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 28.95150 26.97550
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 27.12640 27.25700
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 6.90000 27.25000
veriT veriT-dev default unsat ✅ 7.86474 7.86891
Z3 z3-4.4.1 default unsat ✅ 422.02700 422.18000
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 17.82150 17.82050
Vampire vampire4.2-smt vampire unsat ✅ 6.18888 24.38000
veriT veriT-2017-06-17 default unsat ✅ 42.97820 42.97630
Z3 z3-4.5.0 default unsat ✅ 103.92800 103.91200
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 16.67580 16.67530
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 58.09880 230.88000
veriT veriT_default unsat ✅ 42.64050 42.63400
Z3 z3-4.7.1_default unsat ✅ 598.18100 598.08800
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 4.91112 19.30000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 13.92640 13.92640
master-2018-06-10-b19c840-competition-default_default unsat ✅ 13.77700 13.77660
Par4 Par4-wrapped-sq_default unsat ✅ 14.42020 42.98000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.06000 2623.51000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.34355 3.98280
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.28415 3.54602
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.41271 3.87145
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 9.96749 39.25000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 56.78860 224.69000
veriT veriT-wrapped-sq_default unsat ✅ 42.50930 42.50900
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 312.03200 311.91100
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 3.26858 12.82000
CVC4 CVC4-sq-final_default unsat ✅ 24.13980 24.13590
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 20.07250 20.07030
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.04000 1259.38000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.58883 3.97663
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 5.34717 21.01000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 51.43350 203.93000
veriT veriT_default unsat ✅ 180.32600 180.30300
veriT+vite_default unsat ✅ 14.86270 14.86260
Z3 z3-4.8.8_default unknown ❌ 1200.11000 1199.86000
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 12.41500 12.41570
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 18.35450 18.34190
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 13.16850 49.78000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 1253.04000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.11161 5.22217
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 5.25889 20.53000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.88000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 19.77619 19.67623
iProver iProver v3.9 unsat ✅ 14.93535 52.04289
SMTInterpol SMTInterpol unknown ❌ 1201.71387 1273.11587
Yices2 Yices2 unknown ❌ 1201.49782 1201.11376