Benchmark

non-incremental/UF/20170428-Barrett/cdt-cade2015/nada/afp/sorted_list_operations/x2015_09_10_16_48_28_283_1115867.smt_in.smt2 

Publications: "A Decision Procedure for (Co)Datatypes" by Andrew Reynolds and Jasmin Blanchette, CADE 2015.
Benchmark
Size72871
Compressed Size10642
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByAndrew Reynolds
Generated On2017-04-28 00:00:00
GeneratorSledgehammer, converted to v2.6 by CVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 72862
Compressed Size10646
Max. Term Depth15
Asserts 359
Declared Functions98
Declared Constants11
Declared Sorts 34
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true7 false102 Bool3 ite20
not119 or10 and320 =>335
=414 forall475 exists25

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.15137 0.15104
Vampire vampire4.2-smt vampire unsat ✅ 0.06615 0.06552
veriT veriT-2017-06-17 default unsat ✅ 0.03995 0.03886
Z3 z3-4.5.0 default unsat ✅ 29.03370 29.03070
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.16330 0.16338
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.05949 0.05944
veriT veriT_default unsat ✅ 0.04149 0.04174
Z3 z3-4.7.1_default unsat ✅ 30.41180 30.40310
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.10434 0.10636
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.16689 0.16724
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.16649 0.16680
Par4 Par4-wrapped-sq_default unsat ✅ 0.05320 0.00587
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2404.99000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.56040 3.62268
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.19948 3.50285
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.37820 3.56739
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.23130 0.22374
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.11249 0.10980
veriT veriT-wrapped-sq_default unsat ✅ 0.04595 0.04631
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 24.04320 24.04130
SMT-COMP 2020 0.14 (6/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.11276 0.11307
CVC4 CVC4-sq-final_default unsat ✅ 0.19343 0.19374
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.16876 0.16910
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 0.80081 2.08599
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.43016 3.51043
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.09795 0.06021
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.09996 0.06637
veriT veriT_default unsat ✅ 0.04226 0.04260
veriT+vite_default unsat ✅ 0.04076 0.04106
Z3 z3-4.8.8_default unsat ✅ 22.91020 22.90990
SMT-COMP 2021 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 0.19577 0.19609
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 0.77908 0.88696
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 0.88150 2.30070
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.91506 5.00728
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.09835 0.09653
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.10684 0.06214
veriT veriT_default unsat ✅ 0.03825 0.03856
Z3 z3-4.8.11_default unsat ✅ 8.80596 8.80512
SMT-COMP 2023 0.17 (5/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.16089 0.16146
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.18556 0.18612
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 0.64984 1.76000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 1.30609 3.69010
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.90925 4.78197
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.14183 0.08278
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.02218 0.02215
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.29861 0.19743
iProver iProver v3.9 unsat ✅ 0.88981 1.84041
SMTInterpol SMTInterpol unsat ✅ 1.55601 4.37411
Yices2 Yices2 unsat ✅ 0.23026 0.13047