Benchmark

non-incremental/QF_NIA/20170427-VeryMax/ITS/From_AProVE_2014__juHashMapCreateIsEmpty.jar-obl-10__p2688_safety_0.smt2

Benchmark without description.
Benchmark
Size39575
Compressed Size3280
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByCristina Borralleras, Daniel Larraz, Albert Oliveras, Enric Rodriguez-Carbonell, Albert Rubio
Generated On2017-04-27 00:00:00
GeneratorVeryMax
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 39567
Compressed Size3279
Max. Term Depth21
Asserts 7
Declared Functions0
Declared Constants227
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not2 or7 and18 =312
+415 -407 *1045 <=64
>14 >=259

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.20 (4/5) AProVE AProVE NIA 2014 default sat ✅ 1.30102 4.13154
CVC4 CVC4-smtcomp2017-main default sat ✅ 7.97579 7.97543
SMT-RAT SMTRAT-comp2017_2 default sat ✅ 55.23320 55.22650
Yices2 Yices2-Main default sat ✅ 5.32939 5.32781
Z3 z3-4.5.0 default unknown ❌ 600.01200 599.82800
SMT-COMP 2018 0.20 (4/5) AProVE AProVE NIA 2014_default sat ✅ 1.63416 4.00283
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 1.16066 1.16088
SMT-RAT SMTRAT-Rat-final_default sat ✅ 9.34635 9.34559
Yices2 Yices 2.6.0_default sat ✅ 69.12750 69.11810
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.83000
SMT-COMP 2019 0.38 (5/8) AProVE AProVE NIA 2014-wrapped-sq_default sat ✅ 1.67954 4.28455
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.83966 0.84000
CVC4-SymBreak_03_06_2019-wrapped-sq_default sat ✅ 50.13360 50.11020
master-2018-06-10-b19c840-competition-default_default sat ✅ 10.19000 10.18980
MathSAT mathsat-20190601-wrapped-sq_default sat ✅ 3.32616 3.32605
mathsat-na-20190601-wrapped-sq_default sat ✅ 51.74560 51.73930
Par4 Par4-wrapped-sq_default sat ✅ 0.29165 0.00607
ProB ProB-wrapped-sq_default unknown ❌ 1.76073 1.71514
SMT-RAT SMTRAT-5-wrapped-sq_default unknown ❌ 2400.02000 2399.43000
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.30746 0.30743
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.08000 2399.64000
SMT-COMP 2020 AProVE AProVE NIA 2014_default sat ✅ 1.12904 3.10357
CVC4 CVC4-sq-final_default sat ✅ 34.42390 34.40610
MathSAT MathSAT5_default.sh sat ✅ 243.65800 243.64200
Par4 Par4-wrapped-sq_default sat ✅ 2.12124 7.86000
SMT-RAT smtrat-SMTCOMP_default sat ✅ 12.76400 12.76370
Yices2 Yices 2.6.2 bug fix_default sat ✅ 1.44911 1.44893
Z3 z3-4.8.8_default sat ✅ 2.23212 2.23208
SMT-COMP 2021 0.17 (5/6) AProVE AProVE NIA 2014_2021 sat ✅ 1.31221 3.87968
cvc5 cvc5-fixed_default unknown ❌ 1200.03000 480.27600
MathSAT mathsat-5.6.6_default sat ✅ 24.66140 24.65450
Par4 Par4-wrapped-sq_default sat ✅ 0.08955 0.00827
SMT-RAT smtrat-SMTCOMP_default sat ✅ 42.36690 42.36720
smtrat-SMTCOMP_default sat ✅ 41.36670 41.34500
Z3 z3-4.8.11_default sat ✅ 0.98600 0.98604
SMT-COMP 2022 0.14 (6/7) cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 557.44500 556.93900
MathSAT MathSAT-5.6.8_default sat ✅ 17.20520 17.20240
Par4 Par4-wrapped-sq_default sat ✅ 2.72530 10.50000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.03000 1199.90000
Yices-ismt yices-ismt-0721_default sat ✅ 124.14100 124.10600
Z3 z3-4.8.17_default sat ✅ 2.14450 2.14651
Z3++ z3++0715_default sat ✅ 201.60200 201.59100
SMT-COMP 2025 0.20 (4/5) cvc5 cvc5 sat ✅ 52.58814 52.45033
SMTInterpol SMTInterpol unknown ❌ 0.73094 1.47533
Yices2 Yices2 sat ✅ 2.35137 2.23905
Z3alpha Z3-alpha sat ✅ 0.57871 0.85422
Z3 Z3-alpha-base sat ✅ 5.81720 5.68727
z3siri-base sat ✅ 5.87723 5.75422