Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/smtlib.635236.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size8771
Compressed Size1757
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 8763
Compressed Size1773
Max. Term Depth13
Asserts 45
Declared Functions47
Declared Constants19
Declared Sorts 27
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true11 not14 or6 and11
=>36 =162 forall65 let9

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.04280 0.03099
CVC4 CVC4 f7118b2 default unsat ✅ 0.04119 0.02899
veriT veriT-smtcomp2014 default unknown ❌ 21.24630 21.25080
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.02398 0.02300
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.03156 0.03099
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.04316 0.03999
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.04222 0.03999
veriT veriT default unsat ✅ 114.90200 114.92800
Z3 z3 4.4.0 default unsat ✅ 0.04708 0.04699
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.04917 0.04934
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.27730 0.27881
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.10917 0.05246
veriT veriT-dev default unsat ✅ 0.13759 0.13808
Z3 z3-4.4.1 default unsat ✅ 0.04678 0.04800
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.05005 0.05033
Vampire vampire4.2-smt vampire unsat ✅ 0.06587 0.06385
veriT veriT-2017-06-17 default unsat ✅ 23.20790 23.19980
Z3 z3-4.5.0 default unsat ✅ 0.05205 0.05107
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.05291 0.05310
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.10192 0.10181
veriT veriT_default unsat ✅ 23.47380 23.47390
Z3 z3-4.7.1_default unsat ✅ 0.05993 0.05988
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.05350 0.05478
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.05926 0.05962
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.05647 0.05679
Par4 Par4-wrapped-sq_default unsat ✅ 0.06419 0.00573
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2470.37000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.40039 3.40265
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.14812 3.32088
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.52294 3.45558
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.24825 0.24827
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.08707 0.08683
veriT veriT-wrapped-sq_default unsat ✅ 1.29243 1.29277
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.06389 0.06388
SMT-COMP 2020 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.05525 0.05493
CVC4 CVC4-sq-final_default unsat ✅ 0.05962 0.05993
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.05860 0.05894
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.11000 1220.73000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.21877 3.39322
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.08230 0.08183
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.09342 0.09328
veriT veriT_default unsat ✅ 0.07986 0.08016
veriT+vite_default unsat ✅ 9.31625 9.31629
Z3 z3-4.8.8_default unsat ✅ 0.06047 0.06043
SMT-COMP 2021 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 0.06224 0.06255
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 1.76924 5.85000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 2.20688 6.30698
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.03855 5.21244
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 0.22074 0.23000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.06995 0.06913
veriT veriT_default unsat ✅ 0.04928 0.04962
Z3 z3-4.8.11_default unsat ✅ 0.04263 0.04256
SMT-COMP 2023 0.17 (5/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.06618 0.06671
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.06463 0.06521
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 1.15093 3.74175
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 65.81510 81.10890
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.91693 4.89350
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.09216 0.13162
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 18.10520 18.10320
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.24745 0.14752
iProver iProver v3.9 unsat ✅ 3.90251 12.28158
SMTInterpol SMTInterpol unsat ✅ 48.71231 63.34282
Yices2 Yices2 unsat ✅ 1.26612 1.16632