Benchmark

non-incremental/UF/20170428-Barrett/cdt-cade2015/nada/afp/splay_tree_analysis/x2015_09_10_16_56_26_954_1077626.smt_in.smt2 

Publications: "A Decision Procedure for (Co)Datatypes" by Andrew Reynolds and Jasmin Blanchette, CADE 2015.
Benchmark
Size70896
Compressed Size8899
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByAndrew Reynolds
Generated On2017-04-28 00:00:00
GeneratorSledgehammer, converted to v2.6 by CVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 70887
Compressed Size8910
Max. Term Depth15
Asserts 359
Declared Functions72
Declared Constants14
Declared Sorts 24
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true13 false123 Bool5 ite5
not91 or19 and289 =>388
=390 forall469 exists47

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.16600 0.16513
Vampire vampire4.2-smt vampire unsat ✅ 0.11089 0.10998
veriT veriT-2017-06-17 default unsat ✅ 0.04839 0.04855
Z3 z3-4.5.0 default unsat ✅ 8.40453 6.49347
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.17614 0.17633
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.10345 0.10254
veriT veriT_default unsat ✅ 0.04813 0.04836
Z3 z3-4.7.1_default unknown ❌ 1200.10000 1199.80000
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.21153 0.21099
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.18017 0.18051
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.18016 0.18050
Par4 Par4-wrapped-sq_default unsat ✅ 0.06011 0.00613
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2403.47000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.49323 3.50466
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.18307 3.34030
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.30370 3.44144
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.73091 2.58000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.15089 0.15036
veriT veriT-wrapped-sq_default unsat ✅ 0.05390 0.05423
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 220.21400 220.18700
SMT-COMP 2020 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.23400 0.23471
CVC4 CVC4-sq-final_default unsat ✅ 0.20702 0.20732
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.18012 0.18044
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.02000 1242.61000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.53868 3.55967
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.18282 0.12061
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.17655 0.11280
veriT veriT_default unsat ✅ 0.05013 0.05047
veriT+vite_default unsat ✅ 0.04761 0.04796
Z3 z3-4.8.8_default unsat ✅ 182.45400 182.35800
SMT-COMP 2022 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 0.20941 0.20973
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.19701 0.19757
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.91821 4.81835
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.16184 0.15996
veriT veriT_default unsat ✅ 0.04445 0.04482
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 164.61400 164.60800
Z3 z3-4.8.17_default unsat ✅ 173.12800 173.11000
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.18257 0.18278
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.27494 0.27304
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 1.72432 4.90000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.07000 1242.68000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.84550 4.91737
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.16738 0.16531
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 1199.83000 1199.61000
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 unsat ✅ 0.29773 0.19843
iProver iProver v3.9 unsat ✅ 1.82329 4.84607
SMTInterpol SMTInterpol unknown ❌ 1201.74583 1254.21855
Yices2 Yices2 unsat ✅ 293.42428 293.31945
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 0.38429 0.25935
iProver iProver v3.9.3 unsat ✅ 1.38428 4.22940
SMTInterpol SMTInterpol unknown ❌ 1201.48737 1257.16423
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.94184 4.06385
Yices2 Yices2 unsat ✅ 0.26356 0.14612