Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/uf.671771.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size125780
Compressed Size19129
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 125772
Compressed Size19178
Max. Term Depth15
Asserts 545
Declared Functions511
Declared Constants329
Declared Sorts 578
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true13 false249 ite11 not115
or13 and43 =>801 =1451
forall628 exists28 let50

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.23098 0.22296
CVC4 CVC4 f7118b2 default unsat ✅ 0.64500 0.63390
veriT veriT-smtcomp2014 default unsat ✅ 14.14950 14.13580
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.91000 2400.02000
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unsat ✅ 513.78600 514.00300
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.27030 0.26796
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.28091 0.27796
veriT veriT default unsat ✅ 3.51782 3.51746
Z3 z3 4.4.0 default unknown ❌ 2400.06000 2400.09000
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.30179 0.30216
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 205.00600 205.99900
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 85.11960 338.01000
veriT veriT-dev default unsat ✅ 10.14090 10.14750
Z3 z3-4.4.1 default unknown ❌ 2400.07000 2400.54000
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 60.54630 60.52230
Vampire vampire4.2-smt vampire unsat ✅ 8.55538 33.70000
veriT veriT-2017-06-17 default unsat ✅ 18.63520 18.63570
Z3 z3-4.5.0 default unknown ❌ 600.11200 599.86000
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.32029 0.32049
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 1191.99000 4733.56000
veriT veriT_default unsat ✅ 18.63180 18.63180
Z3 z3-4.7.1_default unknown ❌ 1200.06000 1199.88000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 487.62100 1932.77000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.32508 0.32543
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.32962 0.32992
Par4 Par4-wrapped-sq_default unsat ✅ 0.35073 0.00614
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.08000 2412.26000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.56755 4.31864
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.16622 3.66980
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.48977 4.24612
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 445.88600 1770.30000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 1671.21000 6714.72000
veriT veriT-wrapped-sq_default unsat ✅ 7.53555 7.53562
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2294.87000 2294.61000
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 250.55300 994.77000
CVC4 CVC4-sq-final_default unsat ✅ 0.37772 0.37802
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.32611 0.32644
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.04000 1213.38000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.75250 4.25927
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 15.25730 60.13000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.02000 4767.52000
veriT veriT_default unsat ✅ 0.56272 0.56293
veriT+vite_default unsat ✅ 0.73318 0.73118
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.81000
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 28.48410 28.48280
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 379.71100 1500.49000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.05000 1236.91000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.03299 5.83577
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 327.80400 1187.48000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 16.62560 65.32000
veriT veriT_default unsat ✅ 0.13943 0.13972
Z3 z3-4.8.11_default unknown ❌ 1200.02000 1199.85000
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.03668 3.03705
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 5.57418 5.57468
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.12000 4655.80000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.04000 1244.90000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.08378 5.23843
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 329.50900 1307.28000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 510.08000 510.04000
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 unsat ✅ 1.28784 1.16805
iProver iProver v3.9.3 unknown ❌ 1201.80143 4781.09466
SMTInterpol SMTInterpol unknown ❌ 1201.79401 1281.95279
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.35290 5.12023
Yices2 Yices2 unsat ✅ 250.68076 250.49493