Benchmark

non-incremental/QF_NIA/20170427-VeryMax/ITS/From_AProVE_2014__juHashMapCreateContainsKey.jar-obl-11__p31318_safety_0.smt2

Benchmark without description.
Benchmark
Size51897
Compressed Size5072
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByCristina Borralleras, Daniel Larraz, Albert Oliveras, Enric Rodriguez-Carbonell, Albert Rubio
Generated On2017-04-27 00:00:00
GeneratorVeryMax
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 51889
Compressed Size5087
Max. Term Depth20
Asserts 8
Declared Functions0
Declared Constants337
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not3 or8 and21 =366
+391 -582 *1398 <=51
>18 >=422

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.40 (3/5) AProVE AProVE NIA 2014 default sat ✅ 24.66170 29.83790
CVC4 CVC4-smtcomp2017-main default sat ✅ 21.06550 21.05900
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.01400 599.82000
Yices2 Yices2-Main default sat ✅ 0.36252 0.36218
Z3 z3-4.5.0 default unknown ❌ 600.02000 599.86100
SMT-COMP 2018 0.40 (3/5) AProVE AProVE NIA 2014_default sat ✅ 671.38900 678.43400
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 7.71577 7.71530
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.02000 1200.00000
Yices2 Yices 2.6.0_default sat ✅ 0.17645 0.17636
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.84000
SMT-COMP 2019 0.38 (5/8) AProVE AProVE NIA 2014-wrapped-sq_default sat ✅ 31.35370 36.14300
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 1.68340 1.68349
CVC4-SymBreak_03_06_2019-wrapped-sq_default sat ✅ 603.52300 603.24300
master-2018-06-10-b19c840-competition-default_default sat ✅ 2.41076 2.41090
MathSAT mathsat-20190601-wrapped-sq_default sat ✅ 2.00622 2.00633
mathsat-na-20190601-wrapped-sq_default sat ✅ 31.87320 31.87490
Par4 Par4-wrapped-sq_default sat ✅ 0.51186 0.00666
ProB ProB-wrapped-sq_default unknown ❌ 1.79624 1.76216
SMT-RAT SMTRAT-5-wrapped-sq_default unknown ❌ 2400.02000 2399.00000
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.58852 0.58851
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.04000 2399.81000
SMT-COMP 2020 0.14 (6/7) AProVE AProVE NIA 2014_default sat ✅ 34.08410 38.62090
CVC4 CVC4-sq-final_default sat ✅ 496.48600 496.30300
MathSAT MathSAT5_default.sh sat ✅ 249.27400 249.17700
Par4 Par4-wrapped-sq_default sat ✅ 0.86856 2.33000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.03000 1200.03000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.43354 0.43341
Z3 z3-4.8.8_default sat ✅ 5.48577 5.48609
SMT-COMP 2021 0.33 (4/6) AProVE AProVE NIA 2014_2021 sat ✅ 385.90100 391.50400
cvc5 cvc5-fixed_default unknown ❌ 1200.05000 540.32100
MathSAT mathsat-5.6.6_default sat ✅ 1.94971 1.94973
Par4 Par4-wrapped-sq_default sat ✅ 1.35979 5.20000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.03000 1199.96000
smtrat-SMTCOMP_default unknown ❌ 1200.03000 1199.75000
Z3 z3-4.8.11_default sat ✅ 2.33023 2.33046
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 453.84400 453.40100
MathSAT MathSAT-5.6.8_default sat ✅ 3.67620 3.67567
Par4 Par4-wrapped-sq_default sat ✅ 0.27379 0.00640
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.24316 0.24314
Yices-ismt yices-ismt-0721_default sat ✅ 0.31473 0.31182
Z3 z3-4.8.17_default sat ✅ 2.28497 2.28706
Z3++ z3++0715_default sat ✅ 1.17579 1.17562
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 16.65990 16.66000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.20958 0.20954
Yices-ismt yices-ismt-sq-0526_default sat ✅ 0.17911 0.17931
Z3alpha z3alpha_default sat ✅ 1.64564 1.64573
Z3++ z3++0715_default sat ✅ 5.29707 5.29693
Z3++_sq_0526_default sat ✅ 1.57499 1.57487
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 sat ✅ 4.62555 4.52602
SMTInterpol SMTInterpol unknown ❌ 0.79957 1.83422
Yices2 Yices2 sat ✅ 0.72789 0.62751
Z3alpha Z3-alpha sat ✅ 0.78444 0.68418
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unknown ❌ 1201.79849 1200.94744
SMTInterpol SMTInterpol unknown ❌ 0.79066 1.66266
Yices2 Yices2 sat ✅ 0.55150 0.42618
Z3alpha Z3-alpha sat ✅ 0.72253 1.34072
Z3 Z3-alpha-base sat ✅ 2.38398 2.26658
z3siri-base sat ✅ 1.88404 1.76552