Benchmark

non-incremental/QF_NIA/20170427-VeryMax/ITS/From_AProVE_2014__juHashMapCreateIsEmpty.jar-obl-10__p2144_safety_0.smt2

Benchmark without description.
Benchmark
Size144569
Compressed Size9196
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByCristina Borralleras, Daniel Larraz, Albert Oliveras, Enric Rodriguez-Carbonell, Albert Rubio
Generated On2017-04-27 00:00:00
GeneratorVeryMax
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 144561
Compressed Size9569
Max. Term Depth21
Asserts 18
Declared Functions0
Declared Constants681
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not2 or18 and44 =830
+1196 -1392 *4241 <=104
>40 >=1000

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.80 (1/5) AProVE AProVE NIA 2014 default unknown ❌ 600.08200 609.61000
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.06200 600.02000
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.05800 599.95000
Yices2 Yices2-Main default sat ✅ 322.02600 322.01400
Z3 z3-4.5.0 default unknown ❌ 600.01400 599.96000
SMT-COMP 2018 0.80 (1/5) AProVE AProVE NIA 2014_default unknown ❌ 1200.03000 1209.56000
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.02000 1196.52000
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.01000 1199.98000
Yices2 Yices 2.6.0_default sat ✅ 8.66018 8.65930
Z3 z3-4.7.1_default unknown ❌ 1200.06000 1199.91000
SMT-COMP 2020 0.57 (3/7) AProVE AProVE NIA 2014_default unknown ❌ 1200.06000 1210.04000
CVC4 CVC4-sq-final_default unknown ❌ 1200.08000 1198.56000
MathSAT MathSAT5_default.sh sat ✅ 244.89200 244.84100
Par4 Par4-wrapped-sq_default unknown ❌ 1200.12000 4736.00000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.02000 1199.91000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 427.60100 427.55000
Z3 z3-4.8.8_default sat ✅ 14.38460 14.38360
SMT-COMP 2021 0.33 (4/6) AProVE AProVE NIA 2014_2021 unknown ❌ 1200.02000 1210.62000
cvc5 cvc5-fixed_default sat ✅ 35.38270 35.37860
MathSAT mathsat-5.6.6_default sat ✅ 44.83010 44.81110
Par4 Par4-wrapped-sq_default sat ✅ 369.05600 1454.71000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.11000 1199.97000
smtrat-SMTCOMP_default unknown ❌ 1200.02000 1199.84000
Z3 z3-4.8.11_default sat ✅ 279.15100 279.09200
SMT-COMP 2022 0.43 (4/7) cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.05000 1198.19000
MathSAT MathSAT-5.6.8_default sat ✅ 45.68130 91.26140
Par4 Par4-wrapped-sq_default sat ✅ 218.98400 861.74000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.03000 1199.88000
Yices-ismt yices-ismt-0721_default unknown ❌ 1200.12000 1199.94000
Z3 z3-4.8.17_default sat ✅ 401.32900 401.30100
Z3++ z3++0715_default sat ✅ 89.49340 89.48500
SMT-COMP 2023 0.20 (4/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.12000 1198.01000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.99787 0.99781
Yices-ismt yices-ismt-sq-0526_default sat ✅ 131.56400 131.49500
Z3alpha z3alpha_default sat ✅ 339.24100 339.23100
Z3++ z3++0715_default sat ✅ 88.07660 88.07900
Z3++_sq_0526_default sat ✅ 335.60100 335.55100
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unknown ❌ 1201.78396 1201.20041
SMTInterpol SMTInterpol unknown ❌ 1.03601 2.42139
Yices2 Yices2 sat ✅ 11.29410 11.17107
Z3alpha Z3-alpha sat ✅ 1.88745 4.71996
Z3 Z3-alpha-base sat ✅ 15.53926 15.41501
z3siri-base sat ✅ 39.94015 39.81136