Benchmark

non-incremental/QF_BV/spear/samba_v3.0.24/bin_eventlogadm_vc354403.smt2 

Benchmarks generated by the Calysto static checker.  Provided by Domagoj
Babic.  See http://www.cs.ubc.ca/~babic/index_benchmarks.htm.  Translated using
Spear Sf2Smt translator.
Benchmark
Size933464
Compressed Size130737
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 933456
Compressed Size130747
Max. Term Depth5
Asserts 7987
Declared Functions0
Declared Constants8464
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite4698 =>7 =14672 distinct59
concat9 extract2279 bvand361 bvadd132
bvurem9 bvsub13 bvult334 bvule37
bvslt4 bvsle2 bvshl9 sign_extend248

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 Spear Spear v1.9 (fh-1-2) unsat ✅ 15.40000 —
Spear v1.9 (sw-v) unsat ✅ 14.20000 —
Yices Yices 1.0.10 unsat ✅ 0.80000 —
Z3 Z3 0.1 unsat ✅ 0.70000 —
Z3 0.1 (fixed BV) unsat ✅ 0.70000 —
SMT-COMP 2010 CVC3 CVC3 2.3 unsat ✅ 60.20000 —
SONOLAR SONOLAR r252 unsat ✅ 3.30000 —
STP simplifyingSTP unsat ✅ 1.60000 —
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.48797 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 1.17641 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 1.18393 —
abziz_portfolio_2012_minfeatures default unsat ✅ 1.17781 —
abziz_portfolio_2012_solvers default unsat ✅ 1.19106 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 1.20492 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.33792 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.14958 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.36380 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 32.53180 —
CVC3-SMT-COMP-2011 default unsat ✅ 28.57870 —
CVC3-SMT-COMP-2012 default unsat ✅ 28.93290 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 5.58053 —
CVC4-SMT-EVAL-2013 default unsat ✅ 6.09406 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 4.04064 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 13.56530 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 3.82369 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 3.96062 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.49102 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.56476 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 3.19523 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.68125 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.22369 —
STP2-SMT-COMP-2012 default unsat ✅ 0.21639 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 1.54598 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 1.56847 —
Z3-SMT-COMP-2011 default unsat ✅ 1.18451 —
SMT-COMP 2014 4Simp 4Simp - 2014 default unsat ✅ 2.04923 2.04069
Abziz abziz_portfolio_all_features default unsat ✅ 2.58546 2.57261
abziz_portfolio_min_features default unsat ✅ 2.56911 2.55561
Boolector Boolector boolector unsat ✅ 0.13960 0.13098
CVC4 CVC4 f7118b2 default unsat ✅ 7.16464 13.80890
MathSAT MathSAT-5.2.12-Main default unsat ✅ 4.23880 4.23136
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.53331 0.52292
STP stp-cryptominisat4 default unsat ✅ 0.65848 0.64990
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.34453 0.33195
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 1.75790 1.74773
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.19722 0.19608
Boolector SMT17 final boolector unsat ✅ 0.19531 0.19525
CVC4 CVC4-smtcomp2017-main default unsat ✅ 7.63145 14.70970
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 6.08290 6.08189
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.15046 0.14977
Q3B Q3B default unknown ❌ 600.02300 1799.26000
STP stp_st default unsat ✅ 1.04566 1.04488
stp_mt default unsat ✅ 1.44204 1.16646
Yices2 Yices2-Main default unsat ✅ 0.32009 0.32052
Z3 z3-4.5.0 default unsat ✅ 1.82353 1.82225
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.18958 0.18918
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 20.20490 20.19970
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 6.44986 6.44769
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.17487 0.17485
Minkeyrink ST_st unsat ✅ 0.17111 0.17091
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.92366 0.92334
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.92708 0.92711
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.92910 0.92836
Yices2 Yices 2.6.0_default unsat ✅ 0.28414 0.28401
Z3 z3-4.7.1_default unsat ✅ 1.93707 1.93687
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.27105 0.27104
Poolector-wrapped-sq_default unsat ✅ 0.49204 1.43216
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.27215 0.27214
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 7.15236 7.15236
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.17357 0.17370
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.17294 0.17303
Par4 Par4-wrapped-sq_default unsat ✅ 0.22828 0.00575
STP STP-2019-wrapped-sq_default unsat ✅ 1.00945 1.00957
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 1.00311 1.00328
stp-minisat-wrapped-sq_default unsat ✅ 1.00632 1.00639
stp-mt-wrapped-sq_default unsat ✅ 1.00961 1.00943
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 1.00754 1.00768
stp-riss-wrapped-sq_default unsat ✅ 1.00529 1.00540
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.32916 0.32916
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.33324 0.33319
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.33251 0.33254
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 12.30660 12.30590
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.33616 0.33612
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.81706 1.81697
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.23672 0.23663
Boolector Boolector-wrapped-sq_default unsat ✅ 0.25411 0.25409
Poolector-wrapped-sq_default unsat ✅ 0.47877 1.39985
CVC4 CVC4-sq-final_default unsat ✅ 7.68542 7.68586
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.05000 1199.92000
MathSAT MathSAT5_default.sh unsat ✅ 4.48746 4.48737
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.14777 0.14788
MinkeyRink Solver 2020.3_default unsat ✅ 0.14953 0.14967
STP STP_default unsat ✅ 0.87868 0.87869
STP ++ Mergsat v1_default unsat ✅ 0.88026 0.88190
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.40426 0.40425
Z3 z3-4.8.8_default unsat ✅ 2.60747 2.60739
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.23738 0.23733
MathSAT mathsat-5.6.6_default unsat ✅ 4.55766 4.55758
STP STP 2021.0_default unsat ✅ 0.92561 0.92571
Z3 z3-4.8.11_default unsat ✅ 2.28329 2.28297
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.48891 0.38858
cvc5 cvc5 unsat ✅ 6.48110 6.37317
SMTInterpol SMTInterpol unknown ❌ 1201.74646 1277.20062
STP STP unsat ✅ 0.41576 0.31616
Yices2 Yices2 unsat ✅ 0.51349 0.41375
Z3alpha Z3-alpha unsat ✅ 0.64881 0.54890