Benchmark

non-incremental/QF_NIA/20170427-VeryMax/ITS/From_AProVE_2014__juHashMapCreateIsEmpty.jar-obl-10__p2414_safety_0.smt2

Benchmark without description.
Benchmark
Size56928
Compressed Size3855
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByCristina Borralleras, Daniel Larraz, Albert Oliveras, Enric Rodriguez-Carbonell, Albert Rubio
Generated On2017-04-27 00:00:00
GeneratorVeryMax
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 56920
Compressed Size3868
Max. Term Depth19
Asserts 9
Declared Functions0
Declared Constants294
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not2 or9 and20 =384
+572 -480 *1596 <=104
>16 >=325

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.40 (3/5) AProVE AProVE NIA 2014 default sat ✅ 2.45150 6.25797
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.02100 599.27000
SMT-RAT SMTRAT-comp2017_2 default sat ✅ 6.55783 6.55417
Yices2 Yices2-Main default sat ✅ 0.14252 0.14208
Z3 z3-4.5.0 default unknown ❌ 600.07800 599.87000
SMT-COMP 2018 0.40 (3/5) AProVE AProVE NIA 2014_default sat ✅ 1.98445 4.86884
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.02000 1199.73000
SMT-RAT SMTRAT-Rat-final_default sat ✅ 13.37650 13.37630
Yices2 Yices 2.6.0_default sat ✅ 0.06894 0.06890
Z3 z3-4.7.1_default unknown ❌ 1200.06000 1199.89000
SMT-COMP 2019 0.38 (5/8) AProVE AProVE NIA 2014-wrapped-sq_default sat ✅ 1.55733 4.61748
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 613.14100 610.53800
CVC4-SymBreak_03_06_2019-wrapped-sq_default unknown ❌ 2400.11000 2396.88000
master-2018-06-10-b19c840-competition-default_default sat ✅ 52.21850 52.21360
MathSAT mathsat-20190601-wrapped-sq_default sat ✅ 54.91410 54.91170
mathsat-na-20190601-wrapped-sq_default sat ✅ 222.24200 222.15400
Par4 Par4-wrapped-sq_default sat ✅ 3.22505 12.52000
ProB ProB-wrapped-sq_default unknown ❌ 2400.02000 2400.02000
SMT-RAT SMTRAT-5-wrapped-sq_default unknown ❌ 2400.02000 2399.71000
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 32.37560 32.37530
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.76000
SMT-COMP 2020 AProVE AProVE NIA 2014_default sat ✅ 2.11375 5.45549
CVC4 CVC4-sq-final_default sat ✅ 17.75650 17.75440
MathSAT MathSAT5_default.sh sat ✅ 3.39698 6.77684
Par4 Par4-wrapped-sq_default sat ✅ 0.07816 0.00686
SMT-RAT smtrat-SMTCOMP_default sat ✅ 36.96540 36.96250
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.07020 0.07015
Z3 z3-4.8.8_default sat ✅ 2.18154 2.18135
SMT-COMP 2021 AProVE AProVE NIA 2014_2021 sat ✅ 1.80840 4.96448
cvc5 cvc5-fixed_default sat ✅ 2.82138 2.82119
MathSAT mathsat-5.6.6_default sat ✅ 11.38290 11.38250
Par4 Par4-wrapped-sq_default sat ✅ 0.07946 0.00686
SMT-RAT smtrat-SMTCOMP_default sat ✅ 150.99500 150.98600
smtrat-SMTCOMP_default sat ✅ 149.86400 149.85600
Z3 z3-4.8.11_default sat ✅ 192.05400 192.04400
SMT-COMP 2025 0.20 (4/5) cvc5 cvc5 sat ✅ 0.86593 0.74214
SMTInterpol SMTInterpol unknown ❌ 0.84271 1.81948
Yices2 Yices2 sat ✅ 0.46661 0.34321
Z3alpha Z3-alpha sat ✅ 0.54387 0.78063
Z3 Z3-alpha-base sat ✅ 1.31458 1.18954
z3siri-base sat ✅ 2.31500 2.19623