Benchmark

non-incremental/AUFBVDTLIA/20172804-Barrett/rec-fun-ijcar2016/wo-wdf/mutant_wo_fd_vcs_wdf/2.5-cvc4-ListOperations.scala-5.smt2-2.smt2

Publications: "Model Finding for Recursive Functions in SMT" by Andrew Reynolds, Jasmin Christian Blanchette, Simon Cruanes, and Cesare Tinelli, IJCAR 2016.
Benchmark
Size4540
Compressed Size1164
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByAndrew Reynolds
Generated On2017-04-28 00:00:00
GeneratorNunchaku, Leon, CVC4, converted to v2.6 by CVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status None
Size 4531
Compressed Size1170
Max. Term Depth14
Asserts 4
Declared Functions7
Declared Constants6
Declared Sorts 3
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes3

Symbols

true10 ite23 not17 or2
and6 =15 forall12 +2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default sat ✅ 452.35400 451.09400
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 482.59400 480.98800
SMT-COMP 2020 0.50 (1/2) CVC4 CVC4-sq-final_default sat ✅ 131.82000 120.90300
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.30235 6.31009
SMT-COMP 2022 0.67 (1/3) cvc5 cvc5_default sat ✅ 96.61260 91.17340
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 124.65000 121.09000
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.65510 4.44379
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.87000
SMT-COMP 2023 0.67 (1/3) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 124.74600 120.98400
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.41439 11.38430
Z3 z3-4.8.17_default unknown ❌ 1200.01000 1199.76000