Benchmark

non-incremental/QF_NIA/20170427-VeryMax/ITS/From_AProVE_2014__juHashMapCreateIsEmpty.jar-obl-10__p1937_safety_0.smt2

Benchmark without description.
Benchmark
Size21721
Compressed Size2363
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByCristina Borralleras, Daniel Larraz, Albert Oliveras, Enric Rodriguez-Carbonell, Albert Rubio
Generated On2017-04-27 00:00:00
GeneratorVeryMax
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 21713
Compressed Size2375
Max. Term Depth20
Asserts 5
Declared Functions0
Declared Constants155
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not2 or5 and12 =196
+184 -231 *519 <=36
>9 >=162

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.80 (1/5) AProVE AProVE NIA 2014 default unknown ❌ 600.01900 607.95000
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.01500 599.91000
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.02200 599.99000
Yices2 Yices2-Main default unsat ✅ 0.81812 0.81742
Z3 z3-4.5.0 default unknown ❌ 600.11400 600.02600
SMT-COMP 2018 0.60 (2/5) AProVE AProVE NIA 2014_default unknown ❌ 1200.03000 1208.22000
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.64946 4.64883
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.05000 1200.00000
Yices2 Yices 2.6.0_default unsat ✅ 1.44837 1.44809
Z3 z3-4.7.1_default unknown ❌ 1200.10000 1199.95000
SMT-COMP 2019 0.50 (4/8) AProVE AProVE NIA 2014-wrapped-sq_default unknown ❌ 2400.04000 2412.77000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 7.89653 7.89691
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 17.35340 17.35520
master-2018-06-10-b19c840-competition-default_default unsat ✅ 14.56880 14.56700
MathSAT mathsat-20190601-wrapped-sq_default unsat ✅ 34.01640 34.01540
mathsat-na-20190601-wrapped-sq_default unsat ✅ 41.28490 41.28410
Par4 Par4-wrapped-sq_default unsat ✅ 0.69948 2.41601
ProB ProB-wrapped-sq_default unknown ❌ 1.62809 1.59511
SMT-RAT SMTRAT-5-wrapped-sq_default unknown ❌ 2400.05000 2399.25000
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.72660 0.72658
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.03000 2400.01000
SMT-COMP 2020 0.43 (4/7) AProVE AProVE NIA 2014_default unknown ❌ 1200.06000 1210.12000
CVC4 CVC4-sq-final_default unknown ❌ 1200.06000 1198.84000
MathSAT MathSAT5_default.sh unsat ✅ 44.12830 44.13050
Par4 Par4-wrapped-sq_default unsat ✅ 1.59241 6.06000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.06000 1199.84000
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 1.02675 1.02657
Z3 z3-4.8.8_default unsat ✅ 2.16604 2.16610
SMT-COMP 2022 0.14 (6/7) cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.10000 1182.19000
MathSAT MathSAT-5.6.8_default unsat ✅ 32.54910 32.54730
Par4 Par4-wrapped-sq_default unsat ✅ 1.04381 3.92000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.85198 0.85180
Yices-ismt yices-ismt-0721_default unsat ✅ 0.86086 0.86084
Z3 z3-4.8.17_default unsat ✅ 2.57200 2.57386
Z3++ z3++0715_default unsat ✅ 4.00186 4.00191
SMT-COMP 2023 0.20 (4/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.13000 1186.46000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.75601 0.75590
Yices-ismt yices-ismt-sq-0526_default unsat ✅ 0.74874 0.74885
Z3alpha z3alpha_default unsat ✅ 2.18166 2.18168
Z3++ z3++0715_default unsat ✅ 8.76978 8.76916
Z3++_sq_0526_default unsat ✅ 2.06165 2.06140
SMT-COMP 2025 0.20 (4/5) cvc5 cvc5 unsat ✅ 158.71628 158.56464
SMTInterpol SMTInterpol unknown ❌ 0.59099 1.03469
Yices2 Yices2 unsat ✅ 0.91035 0.78206
Z3alpha Z3-alpha unsat ✅ 2.30894 6.02056
Z3 Z3-alpha-base unsat ✅ 2.45457 2.32293
z3siri-base unsat ✅ 2.35480 2.23788