Benchmark

non-incremental/QF_BV/spear/samba_v3.0.24/bin_eventlogadm_vc354401.smt2

Benchmarks generated by the Calysto static checker.  Provided by Domagoj
Babic.  See http://www.cs.ubc.ca/~babic/index_benchmarks.htm.  Translated using
Spear Sf2Smt translator.
Benchmark
Size962433
Compressed Size134304
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 962425
Compressed Size134307
Max. Term Depth5
Asserts 8263
Declared Functions0
Declared Constants8711
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite4842 =>6 =15150 distinct58
concat8 extract2322 bvand359 bvadd162
bvurem8 bvsub10 bvult378 bvule37
bvslt4 bvsle2 bvshl8 sign_extend255

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 Spear Spear v1.9 (fh-1-2) unsat ✅ 15.50000
Spear v1.9 (sw-v) unsat ✅ 15.80000
Yices Yices 1.0.10 unsat ✅ 0.80000
Z3 Z3 0.1 unsat ✅ 0.80000
Z3 0.1 (fixed BV) unsat ✅ 0.80000
SMT-COMP 2012 4Simp 4Simp unsat ✅ 2.40000
Abziz AbzizPortfolio+BOOLECTOR+MATHSAT+SONOLAR+STP2+Z3_6 unsat ✅ 2.30000
Boolector Boolector unsat ✅ 0.30000
CVC3 CVC3 v2.4.2 unsat ✅ 82.90000
CVC4 1.0rc.3931 unsat ✅ 9.20000
MathSAT MathSAT-HeavyBV unsat ✅ 22.20000
SONOLAR SONOLAR unsat ✅ 1.50000
Z3 Z3 unsat ✅ 2.30000
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49252
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 1.23703
abziz_portfolio_2011_solvers_2 default unsat ✅ 1.24207
abziz_portfolio_2012_minfeatures default unsat ✅ 1.24647
abziz_portfolio_2012_solvers default unsat ✅ 1.23911
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 1.23861
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.33171
Boolector-SMT-COMP-2011 default unsat ✅ 0.15485
Boolector-SMT-COMP-2012 default unsat ✅ 0.39091
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 46.50730
CVC3-SMT-COMP-2011 default unsat ✅ 39.71360
CVC3-SMT-COMP-2012 default unsat ✅ 40.88100
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 5.73739
CVC4-SMT-EVAL-2013 default unsat ✅ 6.24820
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 3.94397
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 13.42150
MathSAT5-SMT-COMP-2011 default unsat ✅ 3.70677
MathSAT5-SMT-COMP-2012 default unsat ✅ 3.87600
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.51432
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.64597
SONOLAR-SMT-COMP-2011 default unsat ✅ 3.12333
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.69137
STP STP2-SMT-COMP-2011 default unsat ✅ 0.23396
STP2-SMT-COMP-2012 default unsat ✅ 0.22993
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 1.54957
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 1.64391
Z3-SMT-COMP-2011 default unsat ✅ 1.23611
SMT-COMP 2014 4Simp 4Simp - 2014 default unsat ✅ 2.10750 2.09468
Abziz abziz_portfolio_all_features default unsat ✅ 2.75998 2.74458
abziz_portfolio_min_features default unsat ✅ 2.76053 2.73358
Boolector Boolector boolector unsat ✅ 0.14333 0.13398
CVC4 CVC4 f7118b2 default unsat ✅ 7.35778 14.16880
MathSAT MathSAT-5.2.12-Main default unsat ✅ 4.66975 4.66329
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.57111 0.55891
STP stp-cryptominisat4 default unsat ✅ 0.70523 0.69689
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.34263 0.33395
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 1.97807 1.97070
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.20739 0.20670
Boolector SMT17 final boolector unsat ✅ 0.22507 0.22429
CVC4 CVC4-smtcomp2017-main default unsat ✅ 7.64561 14.72360
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 6.20109 6.20139
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.15608 0.15676
Q3B Q3B default unknown ❌ 600.06400 1787.72000
STP stp_st default unsat ✅ 0.94807 0.94726
stp_mt default unsat ✅ 0.94863 0.94778
Yices2 Yices2-Main default unsat ✅ 0.32027 0.31952
Z3 z3-4.5.0 default unsat ✅ 1.90181 1.90091
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.18118 0.18106
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 21.29630 21.28740
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 6.56350 6.56407
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.17500 0.17504
Minkeyrink ST_st unsat ✅ 0.17498 0.17497
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.97870 0.97847
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.97833 0.97829
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.98099 0.98094
Yices2 Yices 2.6.0_default unsat ✅ 0.28842 0.28823
Z3 z3-4.7.1_default unsat ✅ 1.89999 1.90001
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.26206 0.26208
Poolector-wrapped-sq_default unsat ✅ 0.47754 1.44774
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.26873 0.26865
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 8.03015 8.02945
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.18108 0.18123
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.17845 0.17851
Par4 Par4-wrapped-sq_default unsat ✅ 0.22394 0.00608
STP STP-2019-wrapped-sq_default unsat ✅ 1.09318 1.09322
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 1.09274 1.09269
stp-minisat-wrapped-sq_default unsat ✅ 1.09247 1.09233
stp-mt-wrapped-sq_default unsat ✅ 1.09527 1.09540
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 1.09222 1.09236
stp-riss-wrapped-sq_default unsat ✅ 1.09372 1.09373
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.33399 0.33401
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.33327 0.33327
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.32996 0.32973
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.82000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.33100 0.33098
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.97885 1.97893
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.25473 0.25470
Boolector Boolector-wrapped-sq_default unsat ✅ 0.26891 0.26892
Poolector-wrapped-sq_default unsat ✅ 0.47929 1.47099
CVC4 CVC4-sq-final_default unsat ✅ 7.81069 7.81044
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.05000 1199.84000
MathSAT MathSAT5_default.sh unsat ✅ 4.68433 4.68458
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.14643 0.14653
MinkeyRink Solver 2020.3_default unsat ✅ 0.15564 0.15571
STP STP_default unsat ✅ 0.89890 0.89898
STP ++ Mergsat v1_default unsat ✅ 0.91149 0.91320
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.40444 0.40435
Z3 z3-4.8.8_default unsat ✅ 2.50268 2.50255
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.24194 0.24184
MathSAT mathsat-5.6.6_default unsat ✅ 4.69621 4.69548
STP STP 2021.0_default unsat ✅ 0.93693 0.93709
Z3 z3-4.8.11_default unsat ✅ 2.35183 2.35135
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.49710 0.39695
cvc5 cvc5 unsat ✅ 7.00437 6.90086
SMTInterpol SMTInterpol unknown ❌ 1201.74576 1282.10902
STP STP unsat ✅ 0.34672 0.24681
Yices2 Yices2 unsat ✅ 0.44925 0.34767
Z3alpha Z3-alpha unsat ✅ 0.73340 0.63367
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.45411 0.33358
Bitwuzla-MachBV-base unsat ✅ 0.54446 0.41576
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.02044 0.88970
BVDecide bv_decide unknown ❌ 1201.38433 1200.99736
bv_decide-nokernel unsat ✅ 87.42200 87.27901
cvc5 cvc5 unsat ✅ 4.80875 4.68848
SMTInterpol SMTInterpol unknown ❌ 1201.44623 1242.73196
Yices2 Yices2 unsat ✅ 0.47769 0.35202
Z3alpha Z3-alpha unsat ✅ 1.42148 3.70053
Z3 Z3-alpha-base unsat ✅ 1.11754 0.99432
Z3-Owl-base unsat ✅ 3.44999 3.32758
z3siri-base unsat ✅ 1.15769 1.02836
Z3-Owl Z3-Owl unsat ✅ 2.16227 2.02511