Benchmark

non-incremental/QF_BV/spear/samba_v3.0.24/bin_eventlogadm_vc354405.smt2 

Benchmarks generated by the Calysto static checker.  Provided by Domagoj
Babic.  See http://www.cs.ubc.ca/~babic/index_benchmarks.htm.  Translated using
Spear Sf2Smt translator.
Benchmark
Size1038686
Compressed Size145745
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1038678
Compressed Size145742
Max. Term Depth5
Asserts 8950
Declared Functions0
Declared Constants9322
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite5346 =>7 =16432 distinct60
concat8 extract2433 bvand362 bvadd189
bvurem8 bvsub11 bvult420 bvule37
bvslt4 bvsle2 bvshl8 sign_extend271

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 Spear Spear v1.9 (fh-1-2) unsat ✅ 16.50000 —
Spear v1.9 (sw-v) unsat ✅ 19.40000 —
Yices Yices 1.0.10 unsat ✅ 0.90000 —
Z3 Z3 0.1 unsat ✅ 0.80000 —
Z3 0.1 (fixed BV) unsat ✅ 0.80000 —
SMT-COMP 2010 CVC3 CVC3 2.3 unsat ✅ 92.70000 —
SONOLAR SONOLAR r252 unsat ✅ 4.00000 —
STP simplifyingSTP unsat ✅ 2.10000 —
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49237 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 1.30405 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 1.32133 —
abziz_portfolio_2012_minfeatures default unsat ✅ 1.32697 —
abziz_portfolio_2012_solvers default unsat ✅ 1.32613 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 1.33229 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.36922 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.17167 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.38935 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 62.18680 —
CVC3-SMT-COMP-2011 default unsat ✅ 53.89480 —
CVC3-SMT-COMP-2012 default unsat ✅ 55.61760 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 6.22837 —
CVC4-SMT-EVAL-2013 default unsat ✅ 6.75589 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 4.48668 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 15.12770 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 4.26334 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 4.39314 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.53351 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.14060 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 3.22989 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.71200 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.25511 —
STP2-SMT-COMP-2012 default unsat ✅ 0.23222 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 1.82780 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 1.83414 —
Z3-SMT-COMP-2011 default unsat ✅ 1.30751 —
SMT-COMP 2014 4Simp 4Simp - 2014 default unsat ✅ 2.28163 2.27365
Abziz abziz_portfolio_all_features default unsat ✅ 2.94015 2.92155
abziz_portfolio_min_features default unsat ✅ 2.93233 2.91955
Boolector Boolector boolector unsat ✅ 0.15846 0.14998
CVC4 CVC4 f7118b2 default unsat ✅ 7.98096 15.38070
MathSAT MathSAT-5.2.12-Main default unsat ✅ 4.61719 4.61030
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.60389 0.60091
STP stp-cryptominisat4 default unsat ✅ 0.70082 0.69189
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.34171 0.33295
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 2.23327 2.22666
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.27816 0.27689
Boolector SMT17 final boolector unsat ✅ 0.26431 0.26085
CVC4 CVC4-smtcomp2017-main default unsat ✅ 8.33410 16.03280
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 6.78050 6.78048
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.19891 0.19821
Q3B Q3B default unknown ❌ 600.07800 1787.16000
STP stp_st default unsat ✅ 1.07214 1.07117
stp_mt default unsat ✅ 1.05690 1.05567
Yices2 Yices2-Main default unsat ✅ 0.33669 0.33386
Z3 z3-4.5.0 default unsat ✅ 2.05615 2.05494
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.23418 0.23408
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 23.86950 23.86870
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 7.19276 7.19314
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.19010 0.18995
Minkeyrink ST_st unsat ✅ 0.18824 0.18823
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 1.12738 1.12743
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 1.15151 1.15158
STP-Riss-st-2018_riss-no-stderr unsat ✅ 1.13013 1.12993
Yices2 Yices 2.6.0_default unsat ✅ 0.28987 0.28973
Z3 z3-4.7.1_default unsat ✅ 2.32955 2.32941
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.24978 0.24974
Boolector Boolector-wrapped-sq_default unsat ✅ 0.26968 0.26970
Poolector-wrapped-sq_default unsat ✅ 0.47601 1.51116
CVC4 CVC4-sq-final_default unsat ✅ 8.60160 8.60071
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.07000 1199.85000
MathSAT MathSAT5_default.sh unsat ✅ 5.26936 5.26885
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.15835 0.15835
MinkeyRink Solver 2020.3_default unsat ✅ 0.16694 0.16706
STP STP_default unsat ✅ 1.12181 1.12185
STP ++ Mergsat v1_default unsat ✅ 1.14303 1.14469
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.38979 0.38976
Z3 z3-4.8.8_default unsat ✅ 2.76294 2.76298
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.28027 0.28020
MathSAT mathsat-5.6.6_default unsat ✅ 4.88865 4.88698
STP STP 2021.0_default unsat ✅ 1.15211 1.14799
Z3 z3-4.8.11_default unsat ✅ 2.71279 2.71248