Benchmark

non-incremental/AUFBVDTLIA/20172804-Barrett/rec-fun-ijcar2016/wo-wdf/mutant_wo_fd_vcs_wdf/2.5-cvc4-QuickSort.scala-14.smt2-3.smt2

Publications: "Model Finding for Recursive Functions in SMT" by Andrew Reynolds, Jasmin Christian Blanchette, Simon Cruanes, and Cesare Tinelli, IJCAR 2016.
Benchmark
Size4524
Compressed Size1059
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByAndrew Reynolds
Generated On2017-04-28 00:00:00
GeneratorNunchaku, Leon, CVC4, converted to v2.6 by CVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status sat
Size 4515
Compressed Size1062
Max. Term Depth14
Asserts 3
Declared Functions5
Declared Constants4
Declared Sorts 2
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes2

Symbols

true6 ite17 not21 or3
and9 =19 forall15 BitVec1
bvslt5

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default sat ✅ 452.69200 450.89500
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 509.45900 483.18200
SMT-COMP 2020 0.50 (1/2) CVC4 CVC4-sq-final_default sat ✅ 461.83100 425.32700
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.28485 3.18617
SMT-COMP 2021 CVC4 CVC4-sq-final_default sat ✅ 468.51200 426.18900
cvc5 cvc5-fixed_default sat ✅ 98.88680 91.80570
SMT-COMP 2022 0.67 (1/3) cvc5 cvc5_default sat ✅ 34.25880 32.03840
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 94.85290 91.10810
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.84627 5.31574
Z3 z3-4.8.17_default unknown ❌ 1200.05000 1199.88000
SMT-COMP 2023 0.67 (1/3) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 33.92540 30.96460
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.46641 11.19620
Z3 z3-4.8.17_default unknown ❌ 1200.06000 1199.94000
SMT-COMP 2024 0.50 (1/2) cvc5 cvc5 sat ✅ 30.75139 30.64838
SMTInterpol SMTInterpol unknown ❌ 1201.71918 1251.30878