Benchmark

non-incremental/QF_NRA/hycomp/ball_count_2d_slope.10.seq_lazy_lemmas_global_10.smt2

Benchmarks generated from hycomp (https://es-static.fbk.eu/tools/hycomp/). BMC instances of non-linear hybrid automata taken from: Alessandro Cimatti, Sergio Mover, Stefano Tonetta, A quantifier-free SMT encoding of non-linear hybrid automata, FMCAD 2012 and Alessandro Cimatti, Sergio Mover, Stefano Tonetta, Quantier-free encoding of invariants for Hybrid Systems, Formal Methods in System Design. This instance solves a BMC problem of depth 10 and uses the quantifier free encoding with lemmas encoding. Contacts: Sergio Mover (mover@fbk.eu), Stefano Tonetta (tonettas@fbk.eu), Alessandro Cimatti (cimatti@fbk.eu).
Benchmark
Size203600
Compressed Size38750
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 203592
Compressed Size38271
Max. Term Depth4505
Asserts 1
Declared Functions0
Declared Constants155
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not459 or1005 and1166 =215
let4502 /24 +524 -238
*847 <=286

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 426.37600 426.46100
CVC4 CVC4 f7118b2 default unsat ✅ 0.19249 0.18197
raSAT raSAT-main-track-final default.sh unknown ❌ 0.02262 0.00800
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 55.18510 55.17860
SMT-COMP 2015 0.17 (5/6) CVC3 CVC3 default unsat ✅ 115.96400 115.96900
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.19457 0.19197
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.19654 0.19397
raSAT raSAT default.sh unsat ✅ 81.37230 78.85400
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.82000
Yices2 Yices2-NL default unsat ✅ 0.09600 0.09498
Z3 z3 4.4.0 default unsat ✅ 22.40420 22.41360
SMT-COMP 2016 0.20 (4/5) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.18371 0.18414
raSAT raSAT 0.3 default.sh unsat ✅ 1.40356 1.40407
raSAT 0.4 exp - final default.py unsat ✅ 1.48412 2.86000
SMT-RAT SMT-RAT default unknown ❌ 2400.02000 2401.35000
Yices2 Yices-2.4.2 default unsat ✅ 0.04204 0.04201
Z3 z3-4.4.1 default unsat ✅ 22.31790 22.32930
SMT-COMP 2017 0.20 (4/5) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.21472 0.21401
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.01200 599.59000
veriT veriT+raSAT+Redlog default unsat ✅ 0.07251 0.06025
Yices2 Yices2-Main default unsat ✅ 0.03847 0.03712
Z3 z3-4.5.0 default unsat ✅ 22.56080 22.55900
SMT-COMP 2018 0.20 (4/5) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.22019 0.21879
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.07000 1199.88000
SMTRAT-MCSAT-final_default unknown ❌ 1200.05000 1199.97000
veriT veriT+raSAT+Reduce_default unsat ✅ 0.05272 0.05265
Yices2 Yices 2.6.0_default unsat ✅ 0.03375 0.03364
Z3 z3-4.7.1_default unsat ✅ 15.26400 15.26270
SMT-COMP 2020 CVC4 CVC4-sq-final_default unsat ✅ 0.30062 0.30078
MathSAT MathSAT5_default.sh unsat ✅ 0.07011 0.07004
Par4 Par4-wrapped-sq_default unsat ✅ 0.04370 0.00651
SMT-RAT smtrat-CDCAC_default unknown ❌ 1200.02000 1199.75000
smtrat-MCSAT_default unsat ✅ 303.87100 303.89300
veriT veriT+raSAT+Redlog_default unsat ✅ 0.09467 0.09338
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.04312 0.04307
Z3 z3-4.8.8_default unsat ✅ 15.14610 15.14600
SMT-COMP 2021 0.60 (4/10) MathSAT mathsat-5.6.6_default unsat ✅ 0.07105 0.07103
Par4 Par4-wrapped-sq_default unsat ✅ 0.04066 0.00652
SMT-RAT smtrat-MCSAT_default unknown ❌ 1200.10000 1199.88000
veriT veriT+raSAT+Redlog_default unsat ✅ 0.05736 0.05730
Z3 z3-4.8.11_default unsat ✅ 15.15990 15.15930
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.81270 0.81323
MathSAT MathSAT-5.6.8_default unsat ✅ 0.07070 0.07064
NRA-LS NRA-LS-FINAL_default unsat ✅ 0.70572 0.70059
Par4 Par4-wrapped-sq_default unsat ✅ 0.04242 0.00650
SMT-RAT SMT-RAT-MCSAT_default unsat ✅ 881.53700 881.37600
veriT veriT+raSAT+Redlog_default unsat ✅ 0.05698 0.05693
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.04426 0.04417
Z3 z3-4.8.17_default unsat ✅ 1.67143 1.67316
Z3++ z3++0715_default unsat ✅ 1.95136 1.95112
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.14874 0.14909
NRA-LS cvc5-NRA-LS-sq_default unsat ✅ 0.67833 0.67335
Par4 Par4-wrapped-sq_default unsat ✅ 0.04130 0.00641
SMT-RAT SMT-RAT-MCSAT_default unsat ✅ 126.48700 126.45300
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.03828 0.03826
Z3alpha z3alpha_default unsat ✅ 5.16961 5.16995
Z3++ z3++0715_default unsat ✅ 0.77677 0.77681
Z3++_sq_0526_default unsat ✅ 0.78802 0.78806
SMT-COMP 2024 0.20 (4/5) cvc5 cvc5 unsat ✅ 0.32635 0.22731
SMTInterpol SMTInterpol unsat ✅ 1.41294 3.94151
SMT-RAT SMT-RAT unsat ✅ 591.13703 590.95589
Yices2 Yices2 unknown ❌ 1201.24315 1201.11714
Z3alpha Z3-alpha unsat ✅ 15.32364 15.22389
SMT-COMP 2025 cvc5 cvc5 unsat ✅ 0.34561 0.22073
SMTInterpol SMTInterpol unsat ✅ 1.29002 3.43754
SMT-RAT SMT-RAT unsat ✅ 48.77480 48.64201
Yices2 Yices2 unsat ✅ 0.31992 0.18663
Z3alpha Z3-alpha unsat ✅ 0.73058 0.69622
Z3 Z3-alpha-base unsat ✅ 0.41361 0.29446
z3siri-base unsat ✅ 0.42352 0.29508