Benchmark

non-incremental/QF_NIA/20170427-VeryMax/ITS/From_AProVE_2014__juHashMapCreateIsEmpty.jar-obl-10__p2331_safety_0.smt2

Benchmark without description.
Benchmark
Size22301
Compressed Size2432
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByCristina Borralleras, Daniel Larraz, Albert Oliveras, Enric Rodriguez-Carbonell, Albert Rubio
Generated On2017-04-27 00:00:00
GeneratorVeryMax
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 22293
Compressed Size2443
Max. Term Depth20
Asserts 5
Declared Functions0
Declared Constants154
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not3 or5 and12 =198
+195 -251 *544 <=37
>9 >=161

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.80 (1/5) AProVE AProVE NIA 2014 default unknown ❌ 600.02000 608.34000
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.01300 599.97000
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.02100 599.96000
Yices2 Yices2-Main default unsat ✅ 1.94741 1.94689
Z3 z3-4.5.0 default unknown ❌ 600.01300 599.88000
SMT-COMP 2018 0.60 (2/5) AProVE AProVE NIA 2014_default unknown ❌ 1200.02000 1208.44000
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 7.07521 7.07508
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.02000 1200.02000
Yices2 Yices 2.6.0_default unsat ✅ 1.98791 1.98792
Z3 z3-4.7.1_default unknown ❌ 1200.11000 1200.00000
SMT-COMP 2020 0.43 (4/7) AProVE AProVE NIA 2014_default unknown ❌ 1200.07000 1207.33000
CVC4 CVC4-sq-final_default unknown ❌ 1200.02000 1197.84000
MathSAT MathSAT5_default.sh unsat ✅ 12.92930 12.92910
Par4 Par4-wrapped-sq_default unsat ✅ 1.33724 4.32000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.02000 1199.88000
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.87183 0.87166
Z3 z3-4.8.8_default unsat ✅ 2.16758 2.16782
SMT-COMP 2021 0.50 (3/6) AProVE AProVE NIA 2014_2021 unknown ❌ 1200.05000 1208.42000
cvc5 cvc5-fixed_default unknown ❌ 1200.06000 1197.39000
MathSAT mathsat-5.6.6_default unsat ✅ 15.15380 15.14880
Par4 Par4-wrapped-sq_default unsat ✅ 1.11528 4.17000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.03000 1199.93000
smtrat-SMTCOMP_default unknown ❌ 1200.07000 1199.88000
Z3 z3-4.8.11_default unsat ✅ 3.26788 3.26784
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 89.75030 89.73680
MathSAT MathSAT-5.6.8_default unsat ✅ 60.58350 60.57630
Par4 Par4-wrapped-sq_default unsat ✅ 0.84096 3.06000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.64588 0.64572
Yices-ismt yices-ismt-0721_default unsat ✅ 0.64881 0.64899
Z3 z3-4.8.17_default unsat ✅ 2.14576 4.25012
Z3++ z3++0715_default unsat ✅ 2.73300 2.73304
SMT-COMP 2023 0.20 (4/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.11000 1186.49000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.59186 0.59173
Yices-ismt yices-ismt-sq-0526_default unsat ✅ 1.46482 1.46500
Z3alpha z3alpha_default unsat ✅ 2.19605 2.19648
Z3++ z3++0715_default unsat ✅ 2.66088 2.65567
Z3++_sq_0526_default unsat ✅ 2.83413 2.83375
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unknown ❌ 1201.79009 1200.99808
SMTInterpol SMTInterpol unknown ❌ 0.64767 1.17961
Yices2 Yices2 unsat ✅ 0.81878 0.69306
Z3alpha Z3-alpha unsat ✅ 2.53293 6.70246
Z3 Z3-alpha-base unsat ✅ 2.39256 2.26048
z3siri-base unsat ✅ 2.33389 2.21464