Benchmark

non-incremental/AUFBVDTLIA/20172804-Barrett/rec-fun-ijcar2016/wo-wdf/mutant_wo_fd_vcs_wdf/2.5-cvc4-LambdaEval.scala-6.smt2-1.smt2

Publications: "Model Finding for Recursive Functions in SMT" by Andrew Reynolds, Jasmin Christian Blanchette, Simon Cruanes, and Cesare Tinelli, IJCAR 2016.
Benchmark
Size6206
Compressed Size1459
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByAndrew Reynolds
Generated On2017-04-28 00:00:00
GeneratorNunchaku, Leon, CVC4, converted to v2.6 by CVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status None
Size 6197
Compressed Size1463
Max. Term Depth13
Asserts 5
Declared Functions10
Declared Constants5
Declared Sorts 4
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes3

Symbols

true14 false6 ite29 not23
or3 and14 =24 forall15
BitVec1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default sat ✅ 560.08700 456.60700
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 168.15800 151.84300
SMT-COMP 2020 0.50 (1/2) CVC4 CVC4-sq-final_default sat ✅ 544.84900 486.82500
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 3.48982 3.23210
SMT-COMP 2021 0.50 (1/2) CVC4 CVC4-sq-final_default sat ✅ 494.91300 482.40300
cvc5 cvc5-fixed_default unknown ❌ 1200.02000 484.92700
SMT-COMP 2022 0.67 (1/3) cvc5 cvc5_default sat ✅ 552.74300 515.51700
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 544.88500 513.65400
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.61827 4.47229
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.85000
SMT-COMP 2023 0.67 (1/3) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 521.17200 541.71200
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.23438 11.67080
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.88000
SMT-COMP 2024 0.50 (1/2) cvc5 cvc5 sat ✅ 90.60716 90.50747
SMTInterpol SMTInterpol unknown ❌ 1201.71969 1223.94113
SMT-COMP 2025 0.50 (1/2) cvc5 cvc5 sat ✅ 540.44350 540.27564
SMTInterpol SMTInterpol unknown ❌ 1201.38414 1219.42842