Benchmark

non-incremental/QF_NIA/20170427-VeryMax/ITS/From_AProVE_2014__juHashMapCreateIsEmpty.jar-obl-10__p1638_safety_0.smt2

Benchmark without description.
Benchmark
Size62414
Compressed Size4008
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByCristina Borralleras, Daniel Larraz, Albert Oliveras, Enric Rodriguez-Carbonell, Albert Rubio
Generated On2017-04-27 00:00:00
GeneratorVeryMax
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 62406
Compressed Size4018
Max. Term Depth20
Asserts 9
Declared Functions0
Declared Constants324
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not4 or11 and22 =398
+714 -493 *1787 <=132
>16 >=319

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.60 (2/5) AProVE AProVE NIA 2014 default sat ✅ 195.32900 202.53100
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.05800 597.09000
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.10200 600.03000
Yices2 Yices2-Main default sat ✅ 291.41000 291.39300
Z3 z3-4.5.0 default unknown ❌ 600.02800 599.89000
SMT-COMP 2018 0.40 (3/5) AProVE AProVE NIA 2014_default sat ✅ 1087.07000 1096.54000
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 1.23994 1.24008
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.10000 1199.94000
Yices2 Yices 2.6.0_default sat ✅ 0.06330 0.06326
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.90000
SMT-COMP 2019 0.50 (4/8) AProVE AProVE NIA 2014-wrapped-sq_default unknown ❌ 2400.03000 2413.50000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 25.80130 25.79970
CVC4-SymBreak_03_06_2019-wrapped-sq_default sat ✅ 28.78940 28.79050
master-2018-06-10-b19c840-competition-default_default sat ✅ 3.52148 3.52167
MathSAT mathsat-20190601-wrapped-sq_default sat ✅ 26.13190 26.13220
mathsat-na-20190601-wrapped-sq_default sat ✅ 11.94160 11.94060
Par4 Par4-wrapped-sq_default sat ✅ 0.09278 0.00594
ProB ProB-wrapped-sq_default unknown ❌ 2400.05000 2399.86000
SMT-RAT SMTRAT-5-wrapped-sq_default unknown ❌ 2400.01000 2399.72000
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.08370 0.08369
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.04000 2399.55000
SMT-COMP 2020 AProVE AProVE NIA 2014_default sat ✅ 692.61400 701.04700
CVC4 CVC4-sq-final_default sat ✅ 1.36728 1.36746
MathSAT MathSAT5_default.sh sat ✅ 6.29470 6.28838
Par4 Par4-wrapped-sq_default sat ✅ 0.07235 0.00582
SMT-RAT smtrat-SMTCOMP_default sat ✅ 82.37340 82.37180
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.07396 0.07360
Z3 z3-4.8.8_default sat ✅ 2.15780 2.15802
SMT-COMP 2021 0.17 (5/6) AProVE AProVE NIA 2014_2021 sat ✅ 950.25600 959.66500
cvc5 cvc5-fixed_default sat ✅ 2.13008 2.13053
MathSAT mathsat-5.6.6_default sat ✅ 12.23870 12.23830
Par4 Par4-wrapped-sq_default sat ✅ 0.07703 0.00746
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.01000 1199.75000
smtrat-SMTCOMP_default unknown ❌ 1200.03000 1199.81000
Z3 z3-4.8.11_default sat ✅ 108.70000 108.69300
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 sat ✅ 0.70863 0.60846
SMTInterpol SMTInterpol unknown ❌ 0.83166 1.94105
Yices2 Yices2 sat ✅ 0.25732 0.15740
Z3alpha Z3-alpha sat ✅ 12.58985 12.48965
SMT-COMP 2025 0.20 (4/5) cvc5 cvc5 sat ✅ 2.39744 2.27796
SMTInterpol SMTInterpol unknown ❌ 0.75491 1.65800
Yices2 Yices2 sat ✅ 0.45651 0.33794
Z3alpha Z3-alpha sat ✅ 0.62854 0.95598
Z3 Z3-alpha-base sat ✅ 2.31930 2.20107
z3siri-base sat ✅ 2.33268 2.21231