Benchmark

non-incremental/QF_BV/sage/app9/bench_1363.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size6386
Compressed Size1325
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 6378
Compressed Size1308
Max. Term Depth39
Asserts 1
Declared Functions0
Declared Constants31
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not13 and1 =21
let23 bvor9 bvadd77 bvsub17
bvult1 bvule32 bvsle1 bvshl9
zero_extend30

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2011 0.17 (5/6) Boolector Boolector 1.5.23-833 unsat ✅ 6.10000 —
CVC3 CVC3 v2.4 unknown ❌ 1200.00000 —
MathSAT MathSAT5 unsat ✅ 0.10000 —
SONOLAR SONOLAR unsat ✅ 2.30000 —
STP simplifyingSTP unsat ✅ 4.50000 —
STP2 unsat ✅ 4.80000 —
Z3 Z3 unsat ✅ 0.70000 —
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.98546 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 64.83400 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 7.88446 —
abziz_portfolio_2012_minfeatures default unsat ✅ 5.07679 —
abziz_portfolio_2012_solvers default unsat ✅ 5.15545 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 5.06888 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 4.01714 —
Boolector-SMT-COMP-2011 default unsat ✅ 2.85952 —
Boolector-SMT-COMP-2012 default unsat ✅ 8.20807 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.08669 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.10911 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.03760 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.10826 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.04625 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.03975 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.04084 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 27.19460 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 5.08785 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.43846 —
STP STP2-SMT-COMP-2011 default unsat ✅ 3.33600 —
STP2-SMT-COMP-2012 default unsat ✅ 1.36491 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 2.53340 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 1.00139 —
Z3-SMT-COMP-2011 default unsat ✅ 67.32640 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 1.51600 1.51577
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.12627 0.23396
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.12404 0.23096
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.09462 0.09398
SMT-RAT SMT-RAT-final default unsat ✅ 149.54600 149.59100
STP stp-cryptominisat4 default unsat ✅ 0.93035 0.92886
stp-cmsat4-v15 default unsat ✅ 0.89457 0.89386
stp-cmsat4-mt-v15 default unknown ❌ 0.06267 0.06099
stp-minisat-v15 default unsat ✅ 2.28423 2.28465
Yices2 Yices default unsat ✅ 0.00866 0.00800
Z3 z3 4.4.0 default unsat ✅ 18.69160 18.69920
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 1.96085 1.96200
ABC_glucose glucose unsat ✅ 1.08316 1.08436
Boolector Boolector boolector unsat ✅ 1.24731 1.24793
Boolector preprop boolector unsat ✅ 1.25263 1.25331
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.13194 0.24887
MapleSTP MapleSTP default unsat ✅ 112.16500 112.21500
MapleSTP-mt default unsat ✅ 62.75550 250.11300
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.08092 0.08197
MinkeyRink Minkeyrink 2016 default unsat ✅ 250.29800 997.20800
Q3B Q3B default unknown ❌ 2400.02000 7203.16000
STP stp-cms-exp-2016 default unsat ✅ 2.06892 2.07027
stp-cms-mt-2016 default unsat ✅ 0.72171 2.72101
stp-cms-st-2016 default unsat ✅ 0.88529 0.88587
stp-minisat-st-2016 default unsat ✅ 24.77230 24.78670
Yices2 Yices-2.4.2 default unsat ✅ 0.01242 0.01002
Z3 z3-4.4.1 default unsat ✅ 0.24913 0.25046
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.56313 0.56260
Boolector SMT17 final boolector unsat ✅ 1.36174 1.36060
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.13436 0.25081
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.08218 0.08196
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 23.49060 42.20000
Q3B Q3B default unsat ✅ 192.47200 577.06400
STP stp_st default unsat ✅ 0.81618 0.81522
stp_mt default unsat ✅ 0.97859 2.74454
Yices2 Yices2-Main default unsat ✅ 0.01093 0.01089
Z3 z3-4.5.0 default unsat ✅ 0.65138 0.65080
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.49404 0.49379
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.25010 0.25026
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.08410 0.08506
MinkeyRink Minkeyrink MT_mt unsat ✅ 30.83010 122.34200
Minkeyrink ST_st unsat ✅ 23.13150 23.12880
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 3.83522 3.83488
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 1.21137 4.60327
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.98027 0.98031
Yices2 Yices 2.6.0_default unsat ✅ 0.01366 0.01357
Z3 z3-4.7.1_default unsat ✅ 1.24309 1.24286
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.80952 0.80952
Poolector-wrapped-sq_default unsat ✅ 0.98349 3.29914
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 5.27980 5.27936
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.11373 0.11396
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 9.56908 37.77400
MinkeyRink ST-wrapped-sq_default unsat ✅ 12.24220 12.24230
Par4 Par4-wrapped-sq_default unsat ✅ 0.02292 0.00632
STP STP-2019-wrapped-sq_default unsat ✅ 1.50687 1.50714
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 6.39260 6.39287
stp-minisat-wrapped-sq_default unsat ✅ 1.57064 1.57066
stp-mt-wrapped-sq_default unsat ✅ 1.33209 5.07281
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 6.45279 9.44707
stp-riss-wrapped-sq_default unknown ❌ 0.06099 0.06118
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.01238 0.01239
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.01728 0.01729
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.01530 0.01530
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.11827 0.11826
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.02055 0.02058
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.32432 0.32430
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.86563 0.86559
MathSAT mathsat-5.6.6_default unsat ✅ 0.03992 0.03989
STP STP 2021.0_default unsat ✅ 0.75074 2.83424
Z3 z3-4.8.11_default unsat ✅ 1.94428 1.94421
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.81713 0.81711
Bitwuzla-wrapped_default unsat ✅ 0.72197 0.72189
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.13182 0.13137
MathSAT MathSAT-5.6.8_default unsat ✅ 0.04157 0.04102
STP STP 2022.4_default unsat ✅ 1.64556 1.64346
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.01600 0.01594
Z3++BV z3++bv_0702_default unsat ✅ 0.79366 0.79361
Z3 z3-4.8.17_default unsat ✅ 0.16984 0.17157
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.23439 0.13482
cvc5 cvc5 unsat ✅ 0.30420 0.20408
SMTInterpol SMTInterpol unsat ✅ 2.22433 6.38248
STP STP unsat ✅ 0.85753 0.75590
Yices2 Yices2 unsat ✅ 0.22195 0.12205
Z3alpha Z3-alpha unsat ✅ 3.68917 3.58721
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.76068 0.64119
Bitwuzla-MachBV-base unsat ✅ 0.27181 0.15602
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.84712 0.72159
BVDecide bv_decide unsat ✅ 2.06930 1.90324
bv_decide-nokernel unsat ✅ 1.65798 1.49483
cvc5 cvc5 unsat ✅ 0.36034 0.23320
SMTInterpol SMTInterpol unsat ✅ 5.45719 15.39932
Yices2 Yices2 unsat ✅ 0.30207 0.18630
Z3alpha Z3-alpha unsat ✅ 3.79584 13.61380
Z3 Z3-alpha-base unsat ✅ 13.67095 13.55161
Z3-Owl-base unsat ✅ 62.90971 62.76971
z3siri-base unsat ✅ 13.86828 13.73313
Z3-Owl Z3-Owl unsat ✅ 37.58294 37.45481