Benchmark

non-incremental/AUFBVDTLIA/20172804-Barrett/rec-fun-ijcar2016/wo-wdf/mutant_wo_fd_vcs_wdf/2.5-cvc4-QuickSort.scala-25.smt2-3.smt2

Publications: "Model Finding for Recursive Functions in SMT" by Andrew Reynolds, Jasmin Christian Blanchette, Simon Cruanes, and Cesare Tinelli, IJCAR 2016.
Benchmark
Size4462
Compressed Size1042
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByAndrew Reynolds
Generated On2017-04-28 00:00:00
GeneratorNunchaku, Leon, CVC4, converted to v2.6 by CVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status sat
Size 4453
Compressed Size1050
Max. Term Depth14
Asserts 3
Declared Functions5
Declared Constants4
Declared Sorts 2
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes2

Symbols

true6 ite17 not21 or3
and9 =22 forall15 BitVec1
bvslt2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default sat ✅ 453.11600 450.83200
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 499.38900 483.01500
SMT-COMP 2021 CVC4 CVC4-sq-final_default sat ✅ 492.58200 425.99200
cvc5 cvc5-fixed_default sat ✅ 106.22900 91.67200
SMT-COMP 2022 0.67 (1/3) cvc5 cvc5_default unknown ❌ 1200.06000 60.95410
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 65.38120 60.93050
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.64982 4.46887
Z3 z3-4.8.17_default unknown ❌ 1200.03000 1199.84000
SMT-COMP 2023 0.67 (1/3) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 33.91840 30.91390
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.36021 11.67630
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.87000
SMT-COMP 2024 0.50 (1/2) cvc5 cvc5 sat ✅ 60.48276 60.38256
SMTInterpol SMTInterpol unknown ❌ 1201.72017 1251.46221