Benchmark

non-incremental/QF_NIA/20170427-VeryMax/ITS/From_AProVE_2014__juHashMapCreateIsEmpty.jar-obl-10__p2649_safety_0.smt2

Benchmark without description.
Benchmark
Size44699
Compressed Size3721
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByCristina Borralleras, Daniel Larraz, Albert Oliveras, Enric Rodriguez-Carbonell, Albert Rubio
Generated On2017-04-27 00:00:00
GeneratorVeryMax
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 44691
Compressed Size3732
Max. Term Depth21
Asserts 7
Declared Functions0
Declared Constants250
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not4 or8 and21 =367
+509 -449 *1183 <=77
>16 >=279

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.20 (4/5) AProVE AProVE NIA 2014 default sat ✅ 434.10700 441.15700
CVC4 CVC4-smtcomp2017-main default sat ✅ 1.19920 1.19885
SMT-RAT SMTRAT-comp2017_2 default sat ✅ 19.55870 19.55020
Yices2 Yices2-Main default sat ✅ 11.18130 11.18140
Z3 z3-4.5.0 default unknown ❌ 600.01400 599.89800
SMT-COMP 2018 0.60 (2/5) AProVE AProVE NIA 2014_default sat ✅ 710.32700 717.48600
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.10000 1199.33000
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.01000 1199.92000
Yices2 Yices 2.6.0_default sat ✅ 0.25024 0.25015
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.86000
SMT-COMP 2019 0.38 (5/8) AProVE AProVE NIA 2014-wrapped-sq_default sat ✅ 620.65200 628.39800
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 1.23417 1.23253
CVC4-SymBreak_03_06_2019-wrapped-sq_default sat ✅ 603.65400 602.40200
master-2018-06-10-b19c840-competition-default_default sat ✅ 0.72850 0.72878
MathSAT mathsat-20190601-wrapped-sq_default sat ✅ 14.67550 14.67400
mathsat-na-20190601-wrapped-sq_default sat ✅ 14.74710 14.74770
Par4 Par4-wrapped-sq_default sat ✅ 0.88377 3.34000
ProB ProB-wrapped-sq_default unknown ❌ 2400.02000 2406.41000
SMT-RAT SMTRAT-5-wrapped-sq_default unknown ❌ 2400.02000 2399.54000
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 274.56700 274.53600
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.06000 2400.05000
SMT-COMP 2020 0.29 (5/7) AProVE AProVE NIA 2014_default sat ✅ 997.55900 1006.60000
CVC4 CVC4-sq-final_default sat ✅ 6.66207 6.66187
MathSAT MathSAT5_default.sh sat ✅ 869.44500 869.21200
Par4 Par4-wrapped-sq_default sat ✅ 0.26785 0.01031
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.02000 1199.88000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.09184 0.09178
Z3 z3-4.8.8_default unknown ❌ 156.33400 156.33200
SMT-COMP 2021 0.17 (5/6) AProVE AProVE NIA 2014_2021 sat ✅ 85.11760 89.89340
cvc5 cvc5-fixed_default sat ✅ 1.31584 1.31641
MathSAT mathsat-5.6.6_default sat ✅ 0.63738 0.63728
Par4 Par4-wrapped-sq_default sat ✅ 3.84550 14.73000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.03000 1199.83000
smtrat-SMTCOMP_default unknown ❌ 1200.02000 1199.80000
Z3 z3-4.8.11_default sat ✅ 177.69900 177.68100
SMT-COMP 2022 0.14 (6/7) cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 430.72100 430.10200
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.11000 1199.90000
Par4 Par4-wrapped-sq_default sat ✅ 0.83084 1.98000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.33090 0.33084
Yices-ismt yices-ismt-0721_default sat ✅ 0.33575 0.33590
Z3 z3-4.8.17_default sat ✅ 5.63552 5.63775
Z3++ z3++0715_default sat ✅ 21.58220 21.57770