Benchmark

non-incremental/UF/20170428-Barrett/cdt-cade2015/nada/distro/gram_lang/x2015_09_10_16_47_34_876_1072686.smt_in.smt2

Publications: "A Decision Procedure for (Co)Datatypes" by Andrew Reynolds and Jasmin Blanchette, CADE 2015.
Benchmark
Size69446
Compressed Size9455
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByAndrew Reynolds
Generated On2017-04-28 00:00:00
GeneratorSledgehammer, converted to v2.6 by CVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 69437
Compressed Size9475
Max. Term Depth14
Asserts 361
Declared Functions90
Declared Constants22
Declared Sorts 32
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false83 ite4 not107 or35
and296 =>241 =460 forall420
exists32

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.15151 0.15104
Vampire vampire4.2-smt vampire unsat ✅ 0.35466 0.35394
veriT veriT-2017-06-17 default unsat ✅ 0.03696 0.03658
Z3 z3-4.5.0 default unsat ✅ 0.29400 0.29292
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.16323 0.16344
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 1.31409 4.80000
veriT veriT_default unsat ✅ 0.03960 0.03987
Z3 z3-4.7.1_default unsat ✅ 0.43966 0.43956
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.18387 0.18391
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.16830 0.16859
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.16609 0.16637
Par4 Par4-wrapped-sq_default unsat ✅ 0.05154 0.00553
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.10000 2404.44000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.38342 3.47149
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.10152 3.25643
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.35259 3.41866
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 4.33644 16.93000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.73067 2.71000
veriT veriT-wrapped-sq_default unsat ✅ 0.04385 0.04417
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.33022 0.33020
SMT-COMP 2020 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.17719 0.17706
CVC4 CVC4-sq-final_default unsat ✅ 0.19500 0.19529
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.16912 0.16950
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 4128.87000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.41228 3.45058
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.97320 3.54000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.95715 3.55000
veriT veriT_default unsat ✅ 0.07272 0.07303
veriT+vite_default unsat ✅ 0.07134 0.07167
Z3 z3-4.8.8_default unsat ✅ 0.30674 0.30671
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.19241 0.19275
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 8.29842 31.82060
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1195.22000 4213.92000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.97673 4.73260
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 1.39927 5.37000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.92446 3.47000
veriT veriT_default unsat ✅ 0.21520 0.21552
Z3 z3-4.8.11_default unsat ✅ 0.27476 0.27473
SMT-COMP 2022 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.19975 0.20009
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.18865 0.18919
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.78294 4.72704
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 1.38413 5.32000
veriT veriT_default unsat ✅ 0.23385 0.23421
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.02000 1199.95000
Z3 z3-4.8.17_default unsat ✅ 0.41181 0.41420
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.16498 0.16556
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.18543 0.18602
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 7.18321 25.77130
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.02000 4012.11000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.89338 4.78042
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 1.67313 6.22000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.88000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.32257 0.22359
iProver iProver v3.9 unsat ✅ 678.32911 2683.97993
SMTInterpol SMTInterpol unknown ❌ 1202.72133 4399.72802
Yices2 Yices2 unknown ❌ 1201.38210 1201.21752