Benchmark

non-incremental/QF_NIA/20170427-VeryMax/ITS/From_AProVE_2014__juHashMapCreateContainsValue.jar-obl-11__p31927_safety_0.smt2

Benchmark without description.
Benchmark
Size39525
Compressed Size3325
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByCristina Borralleras, Daniel Larraz, Albert Oliveras, Enric Rodriguez-Carbonell, Albert Rubio
Generated On2017-04-27 00:00:00
GeneratorVeryMax
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 39517
Compressed Size3333
Max. Term Depth22
Asserts 7
Declared Functions0
Declared Constants218
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not3 or7 and18 =330
+439 -384 *1043 <=68
>14 >=247

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.60 (2/5) AProVE AProVE NIA 2014 default sat ✅ 1.73840 4.30173
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.02000 599.93000
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.02900 599.93000
Yices2 Yices2-Main default sat ✅ 0.68883 0.68835
Z3 z3-4.5.0 default unknown ❌ 600.01900 599.81400
SMT-COMP 2018 0.60 (2/5) AProVE AProVE NIA 2014_default sat ✅ 2.45503 4.88997
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 16.89730 16.89690
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.03000 1200.00000
Yices2 Yices 2.6.0_default unknown ❌ 1200.02000 1199.96000
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.89000
SMT-COMP 2019 0.38 (5/8) AProVE AProVE NIA 2014-wrapped-sq_default sat ✅ 1.46386 4.24105
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.02000 2358.92000
CVC4-SymBreak_03_06_2019-wrapped-sq_default unknown ❌ 2400.04000 2385.54000
master-2018-06-10-b19c840-competition-default_default sat ✅ 21.12560 21.12530
MathSAT mathsat-20190601-wrapped-sq_default unknown ❌ 2400.02000 2399.72000
mathsat-na-20190601-wrapped-sq_default sat ✅ 253.86600 253.85100
Par4 Par4-wrapped-sq_default sat ✅ 3.34277 12.86660
ProB ProB-wrapped-sq_default unknown ❌ 1.73483 1.68127
SMT-RAT SMTRAT-5-wrapped-sq_default unknown ❌ 2400.07000 2399.62000
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 1096.80000 1096.72000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.04000 2399.66000
SMT-COMP 2020 0.14 (6/7) AProVE AProVE NIA 2014_default sat ✅ 2.78459 5.77390
CVC4 CVC4-sq-final_default sat ✅ 0.84008 0.84034
MathSAT MathSAT5_default.sh sat ✅ 40.72950 40.72630
Par4 Par4-wrapped-sq_default sat ✅ 1.72174 5.68000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.02000 1199.86000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.83951 0.83935
Z3 z3-4.8.8_default sat ✅ 2.24689 2.24706
SMT-COMP 2021 0.17 (5/6) AProVE AProVE NIA 2014_2021 sat ✅ 14.55550 17.78590
cvc5 cvc5-fixed_default sat ✅ 2.21252 2.21314
MathSAT mathsat-5.6.6_default sat ✅ 226.56300 226.49400
Par4 Par4-wrapped-sq_default sat ✅ 0.43504 0.00875
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.11000 1200.01000
smtrat-SMTCOMP_default unknown ❌ 1200.12000 1199.92000
Z3 z3-4.8.11_default sat ✅ 2.76336 2.76342
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 543.71500 542.38700
MathSAT MathSAT-5.6.8_default sat ✅ 3.05342 3.05312
Par4 Par4-wrapped-sq_default sat ✅ 2.39129 9.21000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 94.15410 94.14230
Yices-ismt yices-ismt-0721_default sat ✅ 94.78470 94.77300
Z3 z3-4.8.17_default sat ✅ 2.21239 2.21440
Z3++ z3++0715_default sat ✅ 0.46732 0.46728
SMT-COMP 2023 0.20 (4/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.25000 1194.49000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.39820 0.39813
Yices-ismt yices-ismt-sq-0526_default sat ✅ 0.53954 0.53977
Z3alpha z3alpha_default sat ✅ 41.90590 41.90720
Z3++ z3++0715_default sat ✅ 0.64739 0.64739
Z3++_sq_0526_default sat ✅ 1.67007 1.67000
SMT-COMP 2025 0.20 (4/5) cvc5 cvc5 sat ✅ 305.73519 305.55552
SMTInterpol SMTInterpol unknown ❌ 0.70355 1.34824
Yices2 Yices2 sat ✅ 0.60462 0.48383
Z3alpha Z3-alpha sat ✅ 0.52413 0.66689
Z3 Z3-alpha-base sat ✅ 0.52028 0.39016
z3siri-base sat ✅ 1.15012 1.02822