Benchmark

non-incremental/QF_NIA/20170427-VeryMax/ITS/From_AProVE_2014__juHashMapCreateIsEmpty.jar-obl-10__p2623_safety_0.smt2

Benchmark without description.
Benchmark
Size23115
Compressed Size2499
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByCristina Borralleras, Daniel Larraz, Albert Oliveras, Enric Rodriguez-Carbonell, Albert Rubio
Generated On2017-04-27 00:00:00
GeneratorVeryMax
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 23107
Compressed Size2509
Max. Term Depth20
Asserts 5
Declared Functions0
Declared Constants160
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not3 or5 and12 =198
+197 -263 *574 <=37
>9 >=167

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.80 (1/5) AProVE AProVE NIA 2014 default unknown ❌ 600.11000 607.95000
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.02900 599.60000
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.05900 599.87000
Yices2 Yices2-Main default unsat ✅ 2.00638 2.00500
Z3 z3-4.5.0 default unknown ❌ 600.09100 600.04600
SMT-COMP 2018 0.60 (2/5) AProVE AProVE NIA 2014_default unknown ❌ 1200.09000 1208.28000
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.71270 5.71280
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.02000 1199.94000
Yices2 Yices 2.6.0_default unsat ✅ 0.60701 0.60689
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.93000
SMT-COMP 2019 0.50 (4/8) AProVE AProVE NIA 2014-wrapped-sq_default unknown ❌ 2400.02000 2413.35000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.08667 5.08736
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 19.90170 19.90050
master-2018-06-10-b19c840-competition-default_default unsat ✅ 8.02264 8.02273
MathSAT mathsat-20190601-wrapped-sq_default unsat ✅ 44.42120 44.41990
mathsat-na-20190601-wrapped-sq_default unsat ✅ 41.68300 41.68330
Par4 Par4-wrapped-sq_default unsat ✅ 0.79746 3.05000
ProB ProB-wrapped-sq_default unknown ❌ 438.56900 1.59341
SMT-RAT SMTRAT-5-wrapped-sq_default unknown ❌ 2400.10000 2399.46000
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.82974 0.82979
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.73000
SMT-COMP 2020 0.43 (4/7) AProVE AProVE NIA 2014_default unknown ❌ 1200.11000 1208.83000
CVC4 CVC4-sq-final_default unknown ❌ 1200.06000 1197.18000
MathSAT MathSAT5_default.sh unsat ✅ 23.12410 23.12420
Par4 Par4-wrapped-sq_default unsat ✅ 0.66499 2.41000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.06000 1199.99000
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.58523 0.58034
Z3 z3-4.8.8_default unsat ✅ 2.15951 2.15947
SMT-COMP 2023 0.20 (4/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.12000 1185.61000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.80248 0.80240
Yices-ismt yices-ismt-sq-0526_default unsat ✅ 2.60131 2.60128
Z3alpha z3alpha_default unsat ✅ 2.13894 2.13926
Z3++ z3++0715_default unsat ✅ 2.58883 2.58870
Z3++_sq_0526_default unsat ✅ 1.85295 1.85288