Benchmark

non-incremental/QF_BV/sage/app1/bench_2261.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size71450
Compressed Size10028
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 71442
Compressed Size10035
Max. Term Depth166
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite72 not72 and1
=187 let156 extract1 bvand38
bvor171 bvadd355 bvmul5 bvsub219
bvult243 bvule526 bvslt1 bvsle42
bvshl172 bvashr5 zero_extend300

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 1.14211 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 1.98152 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 1.96660 —
abziz_portfolio_2012_minfeatures default unsat ✅ 1.94173 —
abziz_portfolio_2012_solvers default unsat ✅ 1.97667 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 1.97846 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.12564 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.57641 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.10597 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 32.29760 —
CVC3-SMT-COMP-2011 default unsat ✅ 30.40250 —
CVC3-SMT-COMP-2012 default unsat ✅ 31.19280 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.61025 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.92812 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.53051 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.93735 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.68008 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.68373 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.51865 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.59022 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.10585 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.52800 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.43118 —
STP2-SMT-COMP-2012 default unsat ✅ 0.77580 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 1.05071 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 1.98159 —
Z3-SMT-COMP-2011 default unsat ✅ 1.93201 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.82467 0.82387
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.22931 2.40463
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.08646 4.12737
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 1.60381 1.60376
SMT-RAT SMT-RAT-final default unsat ✅ 122.72500 122.75200
STP stp-cryptominisat4 default unsat ✅ 0.54496 0.54392
stp-cmsat4-v15 default unsat ✅ 12.48210 12.48610
stp-cmsat4-mt-v15 default unknown ❌ 0.40349 0.40294
stp-minisat-v15 default unsat ✅ 0.41897 0.41794
Yices2 Yices default unsat ✅ 0.04394 0.04299
Z3 z3 4.4.0 default unsat ✅ 2.35263 2.35264
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 0.87915 0.87915
ABC_glucose glucose unsat ✅ 11.22300 11.22920
Boolector Boolector boolector unsat ✅ 1.46009 1.46102
Boolector preprop boolector unsat ✅ 1.47401 1.47474
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.94675 1.84779
MapleSTP MapleSTP default unsat ✅ 0.84502 0.84545
MapleSTP-mt default unsat ✅ 1.05840 3.02609
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 1.04474 1.04602
MinkeyRink Minkeyrink 2016 default unsat ✅ 1.62460 2.27960
Q3B Q3B default unknown ❌ 2400.02000 7203.41000
STP stp-cms-exp-2016 default unsat ✅ 1.60647 1.60558
stp-cms-mt-2016 default unsat ✅ 6.12382 23.13450
stp-cms-st-2016 default unsat ✅ 0.88294 0.88144
stp-minisat-st-2016 default unsat ✅ 0.66363 0.66391
Yices2 Yices-2.4.2 default unsat ✅ 0.59335 0.59351
Z3 z3-4.4.1 default unsat ✅ 2.02829 2.03066
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.82712 0.82623
Boolector SMT17 final boolector unsat ✅ 1.56381 1.56181
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.29748 2.54503
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 1.70838 1.70870
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.57197 0.56247
Q3B Q3B default unknown ❌ 600.06800 1799.70000
STP stp_st default unsat ✅ 1.05520 1.05443
stp_mt default unsat ✅ 1.20890 3.24250
Yices2 Yices2-Main default unsat ✅ 0.79252 0.79134
Z3 z3-4.5.0 default unsat ✅ 2.12816 2.12801
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.75006 0.74983
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.78114 1.78132
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 1.53386 1.53496
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.28998 0.37880
Minkeyrink ST_st unsat ✅ 0.27578 0.27592
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 3.02332 3.02321
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 8.12527 25.77880
STP-Riss-st-2018_riss-no-stderr unsat ✅ 2.85656 2.85632
Yices2 Yices 2.6.0_default unsat ✅ 0.77272 0.77242
Z3 z3-4.7.1_default unsat ✅ 1.90466 1.90446
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.25847 0.25848
Poolector-wrapped-sq_default unsat ✅ 0.28007 0.23469
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.47784 1.47782
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 2.93167 2.93173
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.28858 0.39609
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.26312 0.26315
Par4 Par4-wrapped-sq_default unsat ✅ 0.25754 0.00580
STP STP-2019-wrapped-sq_default unsat ✅ 1.65191 1.65224
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 1.35625 1.35643
stp-minisat-wrapped-sq_default unsat ✅ 0.65101 0.65126
stp-mt-wrapped-sq_default unsat ✅ 0.63127 1.10166
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 1.72925 3.03498
stp-riss-wrapped-sq_default unknown ❌ 0.46384 0.46401
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.78006 0.78002
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.66764 0.66767
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.12714 0.12715
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 10.29730 10.29600
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.39745 0.39749
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.47780 1.47767
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.48705 0.48697
Boolector Boolector-wrapped-sq_default unsat ✅ 0.26774 0.26777
Poolector-wrapped-sq_default unsat ✅ 0.28168 0.23545
CVC4 CVC4-sq-final_default unsat ✅ 3.07763 3.07718
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 748.73600 748.70200
MathSAT MathSAT5_default.sh unsat ✅ 0.53641 0.53637
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.27023 0.27044
MinkeyRink Solver 2020.3_default unsat ✅ 0.29392 0.36713
STP STP_default unsat ✅ 0.26968 0.37090
STP ++ Mergsat v1_default unsat ✅ 0.22605 0.22777
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.07642 0.07637
Z3 z3-4.8.8_default unsat ✅ 0.65812 0.65790
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.49764 0.49732
MathSAT mathsat-5.6.6_default unsat ✅ 0.76509 0.76499
STP STP 2021.0_default unsat ✅ 0.24916 0.33443
Z3 z3-4.8.11_default unsat ✅ 1.47023 1.47019
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.40758 0.30758
cvc5 cvc5 unsat ✅ 1.74800 1.64814
SMTInterpol SMTInterpol unknown ❌ 1201.74251 1232.65492
STP STP unsat ✅ 0.48262 0.38287
Yices2 Yices2 unsat ✅ 0.35626 0.25630
Z3alpha Z3-alpha unsat ✅ 1.23174 1.13136
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.36340 0.24441
Bitwuzla-MachBV-base unsat ✅ 0.38423 0.26139
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.57478 0.45552
BVDecide bv_decide unsat ✅ 14.16338 13.99151
bv_decide-nokernel unsat ✅ 7.43986 7.26361
cvc5 cvc5 unsat ✅ 1.14806 1.02243
SMTInterpol SMTInterpol unknown ❌ 1201.58890 1234.50693
Yices2 Yices2 unsat ✅ 0.49336 0.37041
Z3alpha Z3-alpha unsat ✅ 0.82178 1.67121
Z3 Z3-alpha-base unsat ✅ 1.59872 1.47527
Z3-Owl-base unsat ✅ 5.54567 5.42688
z3siri-base unsat ✅ 1.58532 1.45970
Z3-Owl Z3-Owl unsat ✅ 9.10194 8.97856