Benchmark

non-incremental/QF_NIA/20170427-VeryMax/ITS/From_AProVE_2014__juHashMapCreateIsEmpty.jar-obl-10__p2521_safety_0.smt2

Benchmark without description.
Benchmark
Size61772
Compressed Size3970
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByCristina Borralleras, Daniel Larraz, Albert Oliveras, Enric Rodriguez-Carbonell, Albert Rubio
Generated On2017-04-27 00:00:00
GeneratorVeryMax
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 61764
Compressed Size3979
Max. Term Depth20
Asserts 9
Declared Functions0
Declared Constants325
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not4 or11 and22 =380
+705 -474 *1758 <=130
>16 >=325

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.80 (1/5) AProVE AProVE NIA 2014 default unknown ❌ 600.08700 609.04000
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.01500 599.22000
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.04100 599.97000
Yices2 Yices2-Main default sat ✅ 0.13326 0.13198
Z3 z3-4.5.0 default unknown ❌ 600.02000 599.82000
SMT-COMP 2018 0.60 (2/5) AProVE AProVE NIA 2014_default sat ✅ 663.35800 671.55300
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.10000 1199.19000
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.01000 1199.91000
Yices2 Yices 2.6.0_default sat ✅ 0.29970 0.29967
Z3 z3-4.7.1_default unknown ❌ 1200.04000 1199.97000
SMT-COMP 2019 0.38 (5/8) AProVE AProVE NIA 2014-wrapped-sq_default sat ✅ 1242.85000 1254.52000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 603.58900 602.12500
CVC4-SymBreak_03_06_2019-wrapped-sq_default unknown ❌ 2400.02000 2398.27000
master-2018-06-10-b19c840-competition-default_default sat ✅ 1.71748 1.71765
MathSAT mathsat-20190601-wrapped-sq_default sat ✅ 4.43898 4.43848
mathsat-na-20190601-wrapped-sq_default sat ✅ 4.16215 4.16208
Par4 Par4-wrapped-sq_default sat ✅ 1.13867 4.23470
ProB ProB-wrapped-sq_default unknown ❌ 2400.32000 2404.14000
SMT-RAT SMTRAT-5-wrapped-sq_default unknown ❌ 2400.08000 2400.04000
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 1.11959 1.11958
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.04000 2400.01000
SMT-COMP 2020 0.14 (6/7) AProVE AProVE NIA 2014_default sat ✅ 400.11200 406.43100
CVC4 CVC4-sq-final_default sat ✅ 584.96500 584.31100
MathSAT MathSAT5_default.sh sat ✅ 33.44920 33.45060
Par4 Par4-wrapped-sq_default sat ✅ 4.72249 18.43000
SMT-RAT smtrat-SMTCOMP_default unknown ❌ 1200.03000 1199.97000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 12.28390 12.28220
Z3 z3-4.8.8_default sat ✅ 2.17770 2.18009
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 sat ✅ 2.58552 2.48482
SMTInterpol SMTInterpol unknown ❌ 0.85868 2.02104
Yices2 Yices2 sat ✅ 0.26833 0.16823
Z3alpha Z3-alpha sat ✅ 1010.82477 1010.28466
SMT-COMP 2025 0.20 (4/5) cvc5 cvc5 sat ✅ 421.35217 421.13500
SMTInterpol SMTInterpol unknown ❌ 0.79725 1.68094
Yices2 Yices2 sat ✅ 0.49011 0.36295
Z3alpha Z3-alpha sat ✅ 0.95177 1.95982
Z3 Z3-alpha-base sat ✅ 0.57784 0.45589
z3siri-base sat ✅ 0.63469 0.51814