Benchmark

non-incremental/QF_NIA/20170427-VeryMax/ITS/From_AProVE_2014__juHashMapCreateIsEmpty.jar-obl-10__p1633_safety_0.smt2

Benchmark without description.
Benchmark
Size135918
Compressed Size8443
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByCristina Borralleras, Daniel Larraz, Albert Oliveras, Enric Rodriguez-Carbonell, Albert Rubio
Generated On2017-04-27 00:00:00
GeneratorVeryMax
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 135910
Compressed Size8782
Max. Term Depth21
Asserts 18
Declared Functions0
Declared Constants631
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not2 or18 and44 =830
+1156 -1266 *3955 <=102
>40 >=920

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 1.00 (0/5) AProVE AProVE NIA 2014 default unknown ❌ 600.03400 608.96000
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.02300 599.93000
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.02800 599.91000
Yices2 Yices2-Main default unknown ❌ 600.01700 599.94500
Z3 z3-4.5.0 default unknown ❌ 600.06500 599.95000
SMT-COMP 2018 1.00 (0/5) AProVE AProVE NIA 2014_default unknown ❌ 1200.04000 1210.03000
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.01000 1198.90000
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.01000 1199.81000
Yices2 Yices 2.6.0_default unknown ❌ 1200.09000 1199.97000
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.89000
SMT-COMP 2019 0.88 (1/8) AProVE AProVE NIA 2014-wrapped-sq_default unknown ❌ 2400.02000 2413.82000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.07000 2247.69000
CVC4-SymBreak_03_06_2019-wrapped-sq_default unknown ❌ 2400.03000 2399.13000
master-2018-06-10-b19c840-competition-default_default unknown ❌ 2400.02000 2399.62000
MathSAT mathsat-20190601-wrapped-sq_default sat ✅ 591.53400 591.36800
mathsat-na-20190601-wrapped-sq_default sat ✅ 214.14600 214.12800
Par4 Par4-wrapped-sq_default unknown ❌ 2400.13000 9491.57000
ProB ProB-wrapped-sq_default unknown ❌ 2.36154 2.31829
SMT-RAT SMTRAT-5-wrapped-sq_default unknown ❌ 2400.04000 2399.46000
Yices2 Yices 2.6.2-wrapped-sq_default unknown ❌ 2400.05000 2399.73000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.57000
SMT-COMP 2020 0.29 (5/7) AProVE AProVE NIA 2014_default unknown ❌ 1200.07000 1210.88000
CVC4 CVC4-sq-final_default sat ✅ 127.38400 127.33900
MathSAT MathSAT5_default.sh sat ✅ 110.79800 110.78800
Par4 Par4-wrapped-sq_default sat ✅ 3.37313 12.83000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.10000 1199.94000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 4.22169 4.22134
Z3 z3-4.8.8_default sat ✅ 3.18795 3.18800
SMT-COMP 2021 0.33 (4/6) AProVE AProVE NIA 2014_2021 unknown ❌ 1200.08000 1209.75000
cvc5 cvc5-fixed_default sat ✅ 450.69600 448.87200
MathSAT mathsat-5.6.6_default sat ✅ 55.99400 55.98900
Par4 Par4-wrapped-sq_default sat ✅ 33.61340 131.94000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.02000 1199.88000
smtrat-SMTCOMP_default unknown ❌ 1200.04000 1199.93000
Z3 z3-4.8.11_default sat ✅ 119.35100 119.35600
SMT-COMP 2022 0.29 (5/7) cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.02000 1197.96000
MathSAT MathSAT-5.6.8_default sat ✅ 264.59200 264.21000
Par4 Par4-wrapped-sq_default sat ✅ 2.41916 7.70000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 1.17644 1.17637
Yices-ismt yices-ismt-0721_default sat ✅ 1.18917 1.18920
Z3 z3-4.8.17_default sat ✅ 2.93212 2.93398
Z3++ z3++0715_default unknown ❌ 225.00900 224.96500
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 445.69900 445.07800
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 2.98850 2.98777
Yices-ismt yices-ismt-sq-0526_default sat ✅ 6.51151 6.51188
Z3alpha z3alpha_default sat ✅ 320.40400 320.36600
Z3++ z3++0715_default sat ✅ 197.41500 197.39800
Z3++_sq_0526_default sat ✅ 218.47800 218.43600
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unknown ❌ 1201.74714 1200.76205
SMTInterpol SMTInterpol unknown ❌ 1.05548 2.67178
Yices2 Yices2 sat ✅ 0.73001 0.63031
Z3alpha Z3-alpha sat ✅ 9.78138 9.68109
SMT-COMP 2025 0.20 (4/5) cvc5 cvc5 sat ✅ 435.64016 435.46904
SMTInterpol SMTInterpol unknown ❌ 0.97798 2.34022
Yices2 Yices2 sat ✅ 5.05447 4.93450
Z3alpha Z3-alpha sat ✅ 1.31897 3.05293
Z3 Z3-alpha-base sat ✅ 20.27123 20.14970
z3siri-base sat ✅ 22.30010 22.16758