Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/uf.615681.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size91539
Compressed Size12713
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 91531
Compressed Size12756
Max. Term Depth20
Asserts 456
Declared Functions235
Declared Constants14
Declared Sorts 108
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false146 ite6 not100 or38
and98 =>814 =1515 forall686
exists40 let105

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 46.12090 46.13100
CVC4 CVC4 f7118b2 default unsat ✅ 20.62890 20.63090
veriT veriT-smtcomp2014 default unsat ✅ 0.57603 0.57491
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.41000 2400.09000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unsat ✅ 0.29448 0.29395
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.19554 0.19297
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.19296 0.18997
veriT veriT default unknown ❌ 2400.01000 2400.81000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.93000
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.22921 0.22952
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 5.08608 5.10871
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 5.99691 23.57000
veriT veriT-dev default unsat ✅ 0.18527 0.17630
Z3 z3-4.4.1 default unknown ❌ 2400.08000 2400.92000
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.23202 0.22662
Vampire vampire4.2-smt vampire unsat ✅ 93.39970 296.89000
veriT veriT-2017-06-17 default unsat ✅ 0.27517 0.27404
Z3 z3-4.5.0 default unknown ❌ 600.11200 599.95000
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.24174 0.24177
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 658.93700 2620.74000
veriT veriT_default unsat ✅ 0.37029 0.37050
Z3 z3-4.7.1_default unknown ❌ 1200.09000 1199.61000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 1.75618 6.57000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.24524 0.24525
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.24319 0.24348
Par4 Par4-wrapped-sq_default unsat ✅ 0.25972 0.00579
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2406.05000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.29118 3.78092
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.11710 3.50041
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.50725 3.83005
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 8.54445 33.54000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 684.36100 2715.72000
veriT veriT-wrapped-sq_default unsat ✅ 0.46804 0.46833
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 388.63700 388.66300
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 1.40104 5.35000
CVC4 CVC4-sq-final_default unsat ✅ 0.29688 0.29718
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.24945 0.24917
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.12000 1290.39000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.37731 3.86676
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 24.10330 95.41000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 657.86800 2614.24000
veriT veriT_default unsat ✅ 0.17358 0.17389
veriT+vite_default unsat ✅ 0.13344 0.13375
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.70000
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.29785 0.29816
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 975.82000 3859.64000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 3.77641 11.40830
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.03362 5.19990
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 25.62760 112.53000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 22.49450 88.96000
veriT veriT_default unsat ✅ 0.24356 0.24395
Z3 z3-4.8.11_default unknown ❌ 1200.10000 1199.92000
SMT-COMP 2022 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.30261 0.30288
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.26341 0.26393
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.94335 5.10808
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 23.59860 93.47000
veriT veriT_default unsat ✅ 0.10818 0.10851
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.03000 1200.03000
Z3 z3-4.8.17_default unknown ❌ 1200.07000 1199.81000
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.19164 0.19197
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.26022 0.26076
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.05000 4231.84000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 7.76646 20.86600
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.29247 4.93577
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 24.88440 98.41000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.93000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.31074 0.21129
iProver iProver v3.9 unknown ❌ 1201.72523 4765.78168
SMTInterpol SMTInterpol unsat ✅ 5.93707 17.14776
Yices2 Yices2 unknown ❌ 1201.31375 1201.19718