Benchmark

non-incremental/AUFBVDTLIA/20172804-Barrett/rec-fun-ijcar2016/wo-wdf/mutant_wo_fd_vcs_wdf/2.5-cvc4-LeftistHeap.scala-1.smt2-2.smt2

Publications: "Model Finding for Recursive Functions in SMT" by Andrew Reynolds, Jasmin Christian Blanchette, Simon Cruanes, and Cesare Tinelli, IJCAR 2016.
Benchmark
Size1931
Compressed Size764
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByAndrew Reynolds
Generated On2017-04-28 00:00:00
GeneratorNunchaku, Leon, CVC4, converted to v2.6 by CVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status sat
Size 1922
Compressed Size763
Max. Term Depth11
Asserts 2
Declared Functions2
Declared Constants2
Declared Sorts 1
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes1

Symbols

true4 ite8 not6 or1
and1 =3 forall4 bvadd2
bvslt1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default sat ✅ 113.39300 111.02800
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 124.00800 120.75800
SMT-COMP 2020 0.50 (1/2) CVC4 CVC4-sq-final_default sat ✅ 125.31100 120.75900
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.32893 3.27812
SMT-COMP 2022 0.33 (2/3) cvc5 cvc5_default sat ✅ 94.36530 90.75430
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 96.81310 90.84370
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.76160 4.47575
Z3 z3-4.8.17_default sat ✅ 62.01020 62.01380
SMT-COMP 2023 0.33 (2/3) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 96.68320 90.95070
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.32913 11.19630
Z3 z3-4.8.17_default sat ✅ 7.04358 7.04490
SMT-COMP 2024 0.50 (1/2) cvc5 cvc5 sat ✅ 90.35741 90.25720
SMTInterpol SMTInterpol unknown ❌ 0.57636 0.74450