Benchmark

non-incremental/UF/20170428-Barrett/cdt-cade2015/nada/distro/gram_lang/x2015_09_10_16_50_03_472_1230858.smt_in.smt2

Publications: "A Decision Procedure for (Co)Datatypes" by Andrew Reynolds and Jasmin Blanchette, CADE 2015.
Benchmark
Size79657
Compressed Size11153
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByAndrew Reynolds
Generated On2017-04-28 00:00:00
GeneratorSledgehammer, converted to v2.6 by CVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 79648
Compressed Size11160
Max. Term Depth14
Asserts 358
Declared Functions145
Declared Constants26
Declared Sorts 67
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false70 ite4 not49 or8
and311 =>293 =441 forall398
exists44

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.15822 0.15749
Vampire vampire4.2-smt vampire unsat ✅ 8.10441 31.95000
veriT veriT-2017-06-17 default unsat ✅ 0.05066 0.04746
Z3 z3-4.5.0 default unknown ❌ 352.23100 352.13200
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.17051 0.17068
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 750.35800 2984.96000
veriT veriT_default unsat ✅ 0.05252 0.05275
Z3 z3-4.7.1_default unknown ❌ 255.61200 255.56900
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.27469 0.27511
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.17378 0.17416
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.17384 0.17416
Par4 Par4-wrapped-sq_default unsat ✅ 0.06567 0.00597
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.10000 2444.45000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.39465 3.48745
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.04505 3.37795
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.32743 3.42993
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 154.69400 613.43000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 744.79800 2958.32000
veriT veriT-wrapped-sq_default unsat ✅ 0.05729 0.05754
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 472.98600 472.96700
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.25237 0.25228
CVC4 CVC4-sq-final_default unsat ✅ 0.20059 0.20083
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.17544 0.17579
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.09000 1211.96000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.32894 3.48661
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 27.21940 118.54000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 358.23200 1418.31000
veriT veriT_default unsat ✅ 0.05579 0.05611
veriT+vite_default unsat ✅ 0.05188 0.05224
Z3 z3-4.8.8_default unknown ❌ 1173.58000 1173.36000
SMT-COMP 2022 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.20444 0.20461
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.19769 0.19822
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.99890 5.00737
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 17.71130 69.77000
veriT veriT_default unsat ✅ 0.04854 0.04888
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.48968 0.48954
Z3 z3-4.8.17_default unknown ❌ 228.74300 228.71100
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.17092 0.17145
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.19765 0.19778
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 8.67041 32.24080
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 259.56400 322.14100
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.82591 4.78795
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 26.00210 102.95000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1200.01000