Benchmark

non-incremental/QF_NRA/hycomp/ball_count_2d_hill.04.redlog_global_9.smt2

Benchmarks generated from hycomp (https://es-static.fbk.eu/tools/hycomp/). BMC instances of non-linear hybrid automata taken from: Alessandro Cimatti, Sergio Mover, Stefano Tonetta, A quantifier-free SMT encoding of non-linear hybrid automata, FMCAD 2012 and Alessandro Cimatti, Sergio Mover, Stefano Tonetta, Quantier-free encoding of invariants for Hybrid Systems, Formal Methods in System Design. This instance solves a BMC problem of depth 9 and uses the encoding obtained with quantifier elimination using redlog encoding. Contacts: Sergio Mover (mover@fbk.eu), Stefano Tonetta (tonettas@fbk.eu), Alessandro Cimatti (cimatti@fbk.eu).
Benchmark
Size185986
Compressed Size34299
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 185978
Compressed Size33698
Max. Term Depth4068
Asserts 1
Declared Functions0
Declared Constants141
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not198 or541 and716 =244
let4065 /2 +705 -266
*1470 <=191

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 15.39360 15.39870
CVC4 CVC4 f7118b2 default unsat ✅ 0.17748 0.16797
raSAT raSAT-main-track-final default.sh unknown ❌ 0.01915 0.00600
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 2.94096 2.93355
SMT-COMP 2015 0.17 (5/6) CVC3 CVC3 default unsat ✅ 5.47560 5.47717
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.20207 0.19997
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.20501 0.20297
raSAT raSAT default.sh unsat ✅ 0.13123 0.12898
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.87000
Yices2 Yices2-NL default unsat ✅ 0.02336 0.02200
Z3 z3 4.4.0 default unsat ✅ 3.75859 3.76043
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.17802 0.17820
raSAT raSAT 0.3 default.sh unsat ✅ 1.05527 1.05604
raSAT 0.4 exp - final default.py unsat ✅ 0.14575 0.20553
SMT-RAT SMT-RAT default unsat ✅ 4.38473 4.38748
Yices2 Yices-2.4.2 default unsat ✅ 0.02015 0.02012
Z3 z3-4.4.1 default unsat ✅ 2.22354 2.22610
SMT-COMP 2017 0.20 (4/5) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.19318 0.19333
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.05800 600.02000
veriT veriT+raSAT+Redlog default unsat ✅ 0.04701 0.04595
Yices2 Yices2-Main default unsat ✅ 0.02329 0.01970
Z3 z3-4.5.0 default unsat ✅ 0.76406 0.76051
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.21243 0.21264
SMT-RAT SMTRAT-Rat-final_default unsat ✅ 47.52500 47.52160
SMTRAT-MCSAT-final_default unsat ✅ 29.88670 29.88080
veriT veriT+raSAT+Reduce_default unsat ✅ 0.04424 0.04416
Yices2 Yices 2.6.0_default unsat ✅ 0.02197 0.02188
Z3 z3-4.7.1_default unsat ✅ 2.23533 2.23469
SMT-COMP 2019 CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.22521 0.22555
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 0.83743 0.83080
MathSAT mathsat-20190601-wrapped-sq_default unsat ✅ 0.06484 0.06485
mathsat-na-20190601-wrapped-sq_default unsat ✅ 0.06510 0.06508
Par4 Par4-wrapped-sq_default unsat ✅ 0.03123 0.00596
SMT-RAT SMTRAT-5-wrapped-sq_default unsat ✅ 80.23570 80.21340
SMTRAT-MCSAT-4-wrapped-sq_default unsat ✅ 71.53570 71.53960
veriT veriT+raSAT+Redlog-wrapped-sq_default unsat ✅ 0.04874 0.04876
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.02439 0.02438
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 3.18392 3.18386
z3-4.7.1_default unsat ✅ 3.44517 3.44468
SMT-COMP 2020 CVC4 CVC4-sq-final_default unsat ✅ 0.32785 0.32811
MathSAT MathSAT5_default.sh unsat ✅ 0.06082 0.06078
Par4 Par4-wrapped-sq_default unsat ✅ 0.03095 0.00689
SMT-RAT smtrat-CDCAC_default unsat ✅ 135.28600 135.25000
smtrat-MCSAT_default unsat ✅ 136.66000 136.65100
veriT veriT+raSAT+Redlog_default unsat ✅ 0.04649 0.04642
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.03639 0.03629
Z3 z3-4.8.8_default unsat ✅ 8.39460 8.39401
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.19270 1.19100
MathSAT MathSAT-5.6.8_default unsat ✅ 0.06174 0.06166
NRA-LS NRA-LS-FINAL_default unsat ✅ 0.98937 0.98406
Par4 Par4-wrapped-sq_default unsat ✅ 0.13132 0.00957
SMT-RAT SMT-RAT-MCSAT_default unsat ✅ 27.68490 27.67970
veriT veriT+raSAT+Redlog_default unsat ✅ 0.04826 0.04819
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.03728 0.03723
Z3 z3-4.8.17_default unsat ✅ 5.12903 5.13047
Z3++ z3++0715_default unsat ✅ 4.70433 4.70437
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.14449 0.14491
NRA-LS cvc5-NRA-LS-sq_default unsat ✅ 0.80871 0.80859
Par4 Par4-wrapped-sq_default unsat ✅ 0.03024 0.00622
SMT-RAT SMT-RAT-MCSAT_default unsat ✅ 52.32740 52.32700
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.03190 0.03186
Z3alpha z3alpha_default unsat ✅ 5.13853 5.13885
Z3++ z3++0715_default unsat ✅ 2.70646 5.34650
Z3++_sq_0526_default unsat ✅ 2.71413 2.71419
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.28953 0.19013
SMTInterpol SMTInterpol unsat ✅ 1.30228 3.54715
SMT-RAT SMT-RAT unsat ✅ 8.72658 8.62691
Yices2 Yices2 unsat ✅ 0.26367 0.16335
Z3alpha Z3-alpha unsat ✅ 0.29565 0.19597