Benchmark

non-incremental/UF/20170428-Barrett/cdt-cade2015/nada/afp/sorted_list_operations/x2015_09_10_16_47_41_101_1067273.smt_in.smt2 

Publications: "A Decision Procedure for (Co)Datatypes" by Andrew Reynolds and Jasmin Blanchette, CADE 2015.
Benchmark
Size53539
Compressed Size6460
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByAndrew Reynolds
Generated On2017-04-28 00:00:00
GeneratorSledgehammer, converted to v2.6 by CVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 53530
Compressed Size6477
Max. Term Depth12
Asserts 321
Declared Functions27
Declared Constants8
Declared Sorts 12
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true10 false53 Bool2 ite7
not80 or21 and257 =>313
=251 forall402 exists27

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.26852 0.26824
Vampire vampire4.2-smt vampire unknown ❌ 600.06200 2306.85000
veriT veriT-2017-06-17 default unsat ✅ 0.39705 0.39681
Z3 z3-4.5.0 default unknown ❌ 600.01600 599.78000
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.23139 0.23158
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.04000 4774.28000
veriT veriT_default unsat ✅ 0.37853 0.37876
Z3 z3-4.7.1_default unknown ❌ 1200.05000 1199.90000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 1.33185 5.17000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.28518 0.28555
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.28782 0.28797
Par4 Par4-wrapped-sq_default unsat ✅ 0.31394 0.00563
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2438.49000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.30762 3.33593
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.30860 3.38428
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.53948 3.49829
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 2337.85000 9269.99000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 1310.25000 5204.81000
veriT veriT-wrapped-sq_default unsat ✅ 0.39331 0.39368
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.11000 2399.39000
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 1.91529 7.39000
CVC4 CVC4-sq-final_default unsat ✅ 0.25400 0.25431
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.23848 0.23881
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.11000 1215.58000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.37088 3.51531
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 503.85500 1889.93000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.02000 4757.51000
veriT veriT_default unsat ✅ 0.06647 0.06683
veriT+vite_default unsat ✅ 0.06271 0.06303
Z3 z3-4.8.8_default unknown ❌ 1200.03000 1199.33000
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default unsat ✅ 0.42565 0.42596
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.06000 4748.51000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.02000 3081.23000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.78143 4.78840
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.11000 1064.69000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.02000 4657.84000
veriT veriT_default unsat ✅ 0.26901 0.26939
Z3 z3-4.8.11_default unknown ❌ 1200.01000 1199.87000
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default unsat ✅ 0.31953 0.31977
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.18043 0.18094
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.95132 4.75160
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 1200.03000 4764.68000
veriT veriT_default unsat ✅ 0.25580 0.25618
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.10000 1199.96000
Z3 z3-4.8.17_default unknown ❌ 1200.08000 1199.69000
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.25299 0.25288
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.24038 0.24024
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 261.85900 1029.59000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 1335.95000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.00211 4.99625
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 1186.20000 4714.51000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.89000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.29919 0.19941
iProver iProver v3.9 unsat ✅ 451.65577 1786.64365
SMTInterpol SMTInterpol unknown ❌ 1202.74374 2199.54225
Yices2 Yices2 unknown ❌ 1201.33167 1201.14991
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 unsat ✅ 0.81443 0.65849
iProver iProver v3.9.3 unsat ✅ 447.23170 1773.25454
SMTInterpol SMTInterpol unknown ❌ 1015.43100 3872.62446
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.89611 4.05670
Yices2 Yices2 unknown ❌ 1201.39622 1201.13971