Benchmark

non-incremental/QF_NIA/20170427-VeryMax/ITS/From_AProVE_2014__juHashMapCreateIsEmpty.jar-obl-10__p2566_safety_0.smt2

Benchmark without description.
Benchmark
Size22425
Compressed Size2481
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByCristina Borralleras, Daniel Larraz, Albert Oliveras, Enric Rodriguez-Carbonell, Albert Rubio
Generated On2017-04-27 00:00:00
GeneratorVeryMax
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 22417
Compressed Size2493
Max. Term Depth20
Asserts 5
Declared Functions0
Declared Constants157
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not2 or5 and12 =198
+187 -246 *551 <=36
>9 >=164

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.80 (1/5) AProVE AProVE NIA 2014 default unknown ❌ 600.04000 605.86000
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.03600 599.98000
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.07400 599.92000
Yices2 Yices2-Main default unsat ✅ 1.54231 1.53411
Z3 z3-4.5.0 default unknown ❌ 600.11300 600.01900
SMT-COMP 2018 0.80 (1/5) AProVE AProVE NIA 2014_default unknown ❌ 1200.03000 1207.72000
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.02000 1198.63000
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.07000 1199.96000
Yices2 Yices 2.6.0_default unsat ✅ 0.97214 0.97204
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.87000
SMT-COMP 2019 0.50 (4/8) AProVE AProVE NIA 2014-wrapped-sq_default unknown ❌ 2400.02000 2412.39000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 7.88307 7.88243
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 13.32140 13.32290
master-2018-06-10-b19c840-competition-default_default unsat ✅ 9.12171 9.12155
MathSAT mathsat-20190601-wrapped-sq_default unsat ✅ 25.11280 25.11120
mathsat-na-20190601-wrapped-sq_default unsat ✅ 11.24620 11.24550
Par4 Par4-wrapped-sq_default unsat ✅ 0.55773 2.06000
ProB ProB-wrapped-sq_default unknown ❌ 5.68105 5.66249
SMT-RAT SMTRAT-5-wrapped-sq_default unknown ❌ 2400.05000 2399.92000
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.58635 0.58632
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.73000
SMT-COMP 2020 0.43 (4/7) AProVE AProVE NIA 2014_default unknown ❌ 1200.05000 1207.84000
CVC4 CVC4-sq-final_default unknown ❌ 1200.11000 1199.28000
MathSAT MathSAT5_default.sh unsat ✅ 50.66520 50.66430
Par4 Par4-wrapped-sq_default unsat ✅ 1.24095 4.74000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.05000 1199.91000
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 1.08925 1.08911
Z3 z3-4.8.8_default unsat ✅ 2.18270 2.18275
SMT-COMP 2022 0.14 (6/7) cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.04000 1179.93000
MathSAT MathSAT-5.6.8_default unsat ✅ 19.01470 19.01400
Par4 Par4-wrapped-sq_default unsat ✅ 1.72323 5.39000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 1.98880 1.98855
Yices-ismt yices-ismt-0721_default unsat ✅ 1.99227 1.99254
Z3 z3-4.8.17_default unsat ✅ 2.42956 2.43142
Z3++ z3++0715_default unsat ✅ 5.28138 5.28135
SMT-COMP 2023 0.20 (4/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.03000 1199.42000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.82831 0.82820
Yices-ismt yices-ismt-sq-0526_default unsat ✅ 0.90035 0.90046
Z3alpha z3alpha_default unsat ✅ 1.74590 1.74625
Z3++ z3++0715_default unsat ✅ 5.66204 5.66144
Z3++_sq_0526_default unsat ✅ 2.30771 2.30768
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 unsat ✅ 469.76163 469.53678
SMTInterpol SMTInterpol unknown ❌ 0.67681 1.25733
Yices2 Yices2 unsat ✅ 0.69286 0.59281
Z3alpha Z3-alpha unsat ✅ 3.54472 3.44369