Benchmark

non-incremental/QF_NIA/20170427-VeryMax/ITS/From_AProVE_2014__juHashMapCreateContainsValue.jar-obl-11__p31985_safety_0.smt2

Benchmark without description.
Benchmark
Size50690
Compressed Size4897
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByCristina Borralleras, Daniel Larraz, Albert Oliveras, Enric Rodriguez-Carbonell, Albert Rubio
Generated On2017-04-27 00:00:00
GeneratorVeryMax
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 50682
Compressed Size4907
Max. Term Depth21
Asserts 8
Declared Functions0
Declared Constants314
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not3 or8 and21 =392
+405 -581 *1376 <=50
>18 >=389

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.60 (2/5) AProVE AProVE NIA 2014 default sat ✅ 11.97530 17.39850
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.09800 599.99000
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.05000 599.94000
Yices2 Yices2-Main default sat ✅ 0.59860 0.59801
Z3 z3-4.5.0 default unknown ❌ 600.02700 599.81800
SMT-COMP 2018 0.40 (3/5) AProVE AProVE NIA 2014_default sat ✅ 32.48050 36.95090
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 1.71817 1.71849
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.03000 1199.84000
Yices2 Yices 2.6.0_default sat ✅ 0.38460 0.38454
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.89000
SMT-COMP 2019 0.38 (5/8) AProVE AProVE NIA 2014-wrapped-sq_default sat ✅ 86.22890 91.02610
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 2.25885 2.25916
CVC4-SymBreak_03_06_2019-wrapped-sq_default sat ✅ 21.58150 21.58130
master-2018-06-10-b19c840-competition-default_default sat ✅ 2.37095 2.37095
MathSAT mathsat-20190601-wrapped-sq_default sat ✅ 3.80721 3.80677
mathsat-na-20190601-wrapped-sq_default sat ✅ 4.68707 4.68693
Par4 Par4-wrapped-sq_default sat ✅ 0.24369 0.00594
ProB ProB-wrapped-sq_default unknown ❌ 5.36423 5.32596
SMT-RAT SMTRAT-5-wrapped-sq_default unknown ❌ 2400.05000 2399.77000
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.27046 0.27049
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.06000 2399.82000
SMT-COMP 2020 0.29 (5/7) AProVE AProVE NIA 2014_default sat ✅ 225.83300 230.91000
CVC4 CVC4-sq-final_default unknown ❌ 1200.03000 1199.54000
MathSAT MathSAT5_default.sh sat ✅ 7.57420 7.57348
Par4 Par4-wrapped-sq_default sat ✅ 0.76847 2.77000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.06000 1199.87000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.68399 0.68395
Z3 z3-4.8.8_default sat ✅ 0.47741 0.47740
SMT-COMP 2021 0.17 (5/6) AProVE AProVE NIA 2014_2021 sat ✅ 90.83370 95.27950
cvc5 cvc5-fixed_default sat ✅ 4.68838 4.68962
MathSAT mathsat-5.6.6_default sat ✅ 3.39589 3.39276
Par4 Par4-wrapped-sq_default sat ✅ 0.65891 2.39000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.02000 1199.83000
smtrat-SMTCOMP_default unknown ❌ 1200.02000 1199.80000
Z3 z3-4.8.11_default sat ✅ 1.35302 1.35297
SMT-COMP 2025 0.20 (4/5) cvc5 cvc5 sat ✅ 5.08211 4.95578
SMTInterpol SMTInterpol unknown ❌ 0.76607 1.64367
Yices2 Yices2 sat ✅ 1.28256 1.15488
Z3alpha Z3-alpha sat ✅ 0.57361 0.91135
Z3 Z3-alpha-base sat ✅ 0.46258 0.34399
z3siri-base sat ✅ 0.49336 0.36881