Benchmark

non-incremental/QF_NIA/20170427-VeryMax/ITS/From_AProVE_2014__juHashMapCreateIsEmpty.jar-obl-10__p2274_safety_0.smt2

Benchmark without description.
Benchmark
Size44659
Compressed Size3786
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByCristina Borralleras, Daniel Larraz, Albert Oliveras, Enric Rodriguez-Carbonell, Albert Rubio
Generated On2017-04-27 00:00:00
GeneratorVeryMax
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 44651
Compressed Size3798
Max. Term Depth21
Asserts 7
Declared Functions0
Declared Constants247
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not6 or8 and21 =372
+509 -448 *1189 <=77
>16 >=275

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.80 (1/5) AProVE AProVE NIA 2014 default sat ✅ 10.83540 16.48110
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.07600 599.05000
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.01500 599.93000
Yices2 Yices2-Main default unknown ❌ 600.10900 600.06400
Z3 z3-4.5.0 default unknown ❌ 600.10600 599.96000
SMT-COMP 2018 0.60 (2/5) AProVE AProVE NIA 2014_default unknown ❌ 1200.04000 1210.24000
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 1.96426 1.96428
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.04000 1199.92000
Yices2 Yices 2.6.0_default sat ✅ 42.03730 42.03900
Z3 z3-4.7.1_default unknown ❌ 1200.08000 1199.97000
SMT-COMP 2019 0.38 (5/8) AProVE AProVE NIA 2014-wrapped-sq_default sat ✅ 444.08800 449.64600
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 647.08500 645.83600
CVC4-SymBreak_03_06_2019-wrapped-sq_default unknown ❌ 2400.05000 2398.31000
master-2018-06-10-b19c840-competition-default_default unknown ❌ 2400.03000 2394.14000
MathSAT mathsat-20190601-wrapped-sq_default sat ✅ 34.54440 34.54170
mathsat-na-20190601-wrapped-sq_default sat ✅ 34.63720 34.63470
Par4 Par4-wrapped-sq_default sat ✅ 3.29561 12.60640
ProB ProB-wrapped-sq_default unknown ❌ 1.72099 1.69510
SMT-RAT SMTRAT-5-wrapped-sq_default unknown ❌ 2400.09000 2399.42000
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 3.34243 3.34232
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.06000 2399.72000
SMT-COMP 2020 0.43 (4/7) AProVE AProVE NIA 2014_default sat ✅ 569.08900 575.97000
CVC4 CVC4-sq-final_default sat ✅ 0.95630 0.95654
MathSAT MathSAT5_default.sh sat ✅ 193.86300 193.83400
Par4 Par4-wrapped-sq_default sat ✅ 943.03900 2976.67000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.05000 1199.97000
Yices2 Yices 2.6.2 bug fix_default unknown ❌ 1200.03000 1199.92000
Z3 z3-4.8.8_default unknown ❌ 363.92100 363.89100
SMT-COMP 2021 0.67 (2/6) AProVE AProVE NIA 2014_2021 unknown ❌ 1200.03000 1209.78000
cvc5 cvc5-fixed_default sat ✅ 5.81332 5.81370
MathSAT mathsat-5.6.6_default unknown ❌ 1200.02000 1199.97000
Par4 Par4-wrapped-sq_default unknown ❌ 1200.15000 4735.01000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.03000 1199.04000
smtrat-SMTCOMP_default unknown ❌ 1200.04000 1199.91000
Z3 z3-4.8.11_default sat ✅ 9.73157 9.73169
SMT-COMP 2022 0.14 (6/7) cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.21000 1176.94000
MathSAT MathSAT-5.6.8_default sat ✅ 49.96890 49.95320
Par4 Par4-wrapped-sq_default sat ✅ 2.06043 5.59000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.99141 0.99118
Yices-ismt yices-ismt-0721_default sat ✅ 0.99844 0.99864
Z3 z3-4.8.17_default sat ✅ 2.25724 2.25906
Z3++ z3++0715_default sat ✅ 201.38400 201.38300
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unknown ❌ 1201.78800 1200.86170
SMTInterpol SMTInterpol unknown ❌ 0.73481 1.55317
Yices2 Yices2 sat ✅ 0.51454 0.39787
Z3alpha Z3-alpha sat ✅ 1.80530 4.57719
Z3 Z3-alpha-base sat ✅ 2.37120 2.24161
z3siri-base sat ✅ 2.31898 2.19681