Benchmark

non-incremental/QF_BV/spear/samba_v3.0.24/bin_eventlogadm_vc331086.smt2

Benchmarks generated by the Calysto static checker.  Provided by Domagoj
Babic.  See http://www.cs.ubc.ca/~babic/index_benchmarks.htm.  Translated using
Spear Sf2Smt translator.
Benchmark
Size223893
Compressed Size33485
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 223885
Compressed Size31714
Max. Term Depth5
Asserts 1924
Declared Functions0
Declared Constants2089
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite990 =>5 =3465 distinct30
concat7 extract563 bvand95 bvadd43
bvurem11 bvult88 bvule8 bvslt10
bvshl7 sign_extend73

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 3.13847
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 3.03531
abziz_portfolio_2011_solvers_2 default sat ✅ 3.03615
abziz_portfolio_2012_minfeatures default sat ✅ 3.06918
abziz_portfolio_2012_solvers default sat ✅ 3.03009
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 3.04900
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.41139
Boolector-SMT-COMP-2011 default sat ✅ 15.08450
Boolector-SMT-COMP-2012 default sat ✅ 0.21154
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 37.56360
CVC3-SMT-COMP-2011 default sat ✅ 34.60080
CVC3-SMT-COMP-2012 default sat ✅ 34.78860
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 3.03327
CVC4-SMT-EVAL-2013 default sat ✅ 9.01969
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 22.79230
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 22.94820
MathSAT5-SMT-COMP-2011 default sat ✅ 3.74225
MathSAT5-SMT-COMP-2012 default sat ✅ 3.64904
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅
SONOLAR-SMT-COMP-2010 default sat ✅ 16.41290
SONOLAR-SMT-COMP-2011 default sat ✅ 6.26869
SONOLAR-SMT-COMP-2012 default sat ✅ 4.11757
STP STP2-SMT-COMP-2011 default sat ✅ 1.23523
STP2-SMT-COMP-2012 default sat ✅ 2.86290
simplifyingSTP-SMT-COMP-2010 default sat ✅ 2.59455
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 3.85885
Z3-SMT-COMP-2011 default sat ✅ 3.08185
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.06292 0.06282
Boolector SMT17 final boolector sat ✅ 0.06474 0.06352
CVC4 CVC4-smtcomp2017-main default sat ✅ 11.31460 22.54260
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 6.91026 6.90965
MinkeyRink MinkeyRink 2017.3a default sat ✅ 3.35704 3.37625
Q3B Q3B default sat ✅ 17.78390 52.96000
STP stp_st default sat ✅ 3.81020 3.80864
stp_mt default sat ✅ 6.71144 15.25020
Yices2 Yices2-Main default sat ✅ 0.20034 0.19956
Z3 z3-4.5.0 default sat ✅ 3.18045 3.17962
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.05792 0.05788
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 14.96770 14.96550
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 5.26962 5.27056
MinkeyRink Minkeyrink MT_mt sat ✅ 1.99839 4.73719
Minkeyrink ST_st sat ✅ 1.58255 1.58261
STP STP-CMS-st-2018_default-no-stderr sat ✅ 1.33779 1.33747
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 1.54495 3.11424
STP-Riss-st-2018_riss-no-stderr sat ✅ 24.24240 24.23900
Yices2 Yices 2.6.0_default sat ✅ 0.17514 0.17506
Z3 z3-4.7.1_default sat ✅ 2.31245 2.31223
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.07803 0.07802
Poolector-wrapped-sq_default sat ✅ 0.18175 0.18336
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 4.56677 9.08684
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 4.18491 4.18480
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 1.32660 2.43549
MinkeyRink ST-wrapped-sq_default sat ✅ 1.58433 1.58438
Par4 Par4-wrapped-sq_default sat ✅ 0.07074 0.00618
STP STP-2019-wrapped-sq_default sat ✅ 1.36115 1.36143
stp-mergesat-fixed-wrapped-sq_default sat ✅ 4.47664 4.47602
stp-minisat-wrapped-sq_default sat ✅ 1.80587 1.80616
stp-mt-wrapped-sq_default sat ✅ 1.55220 2.88515
stp-portfolio-fixed-wrapped-sq_default sat ✅ 4.59153 6.08483
stp-riss-wrapped-sq_default unknown ❌ 1.03634 1.03647
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.20650 0.20649
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.58064 0.58066
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 7.41367 7.41318
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 0.68639 0.68632
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.61815 0.61813
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 3.28056 3.28050
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.37509 0.37498
Boolector Boolector-wrapped-sq_default sat ✅ 0.07684 0.07685
Poolector-wrapped-sq_default sat ✅ 0.18545 0.18837
CVC4 CVC4-sq-final_default sat ✅ 3.46120 3.46100
LazyBV2Int LazyBV2Int20200523_default.sh sat ✅ 131.61300 131.57300
MathSAT MathSAT5_default.sh sat ✅ 6.72232 6.72163
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.94087 0.94115
MinkeyRink Solver 2020.3_default sat ✅ 1.32075 2.58799
STP STP_default sat ✅ 1.07745 1.64318
STP ++ Mergsat v1_default sat ✅ 0.92822 0.92974
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.49849 0.49844
Z3 z3-4.8.8_default sat ✅ 3.88500 3.88364
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.38386 0.38382
MathSAT mathsat-5.6.6_default sat ✅ 3.03374 3.03343
STP STP 2021.0_default sat ✅ 1.15911 1.93566
Z3 z3-4.8.11_default sat ✅ 5.87212 5.87170
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.73255 0.63207
cvc5 cvc5 sat ✅ 3.92902 3.82727
SMTInterpol SMTInterpol unknown ❌ 530.26770 576.10622
STP STP sat ✅ 1.52003 1.41922
Yices2 Yices2 sat ✅ 0.91607 0.81631
Z3alpha Z3-alpha sat ✅ 0.84677 0.74693