Benchmark

non-incremental/QF_BV/sage/app1/bench_909.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size44305
Compressed Size5346
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 44297
Compressed Size5365
Max. Term Depth65
Asserts 1
Declared Functions0
Declared Constants280
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite27 not51 and1
=124 let55 bvand8 bvor168
bvadd208 bvsub71 bvult115 bvule227
bvshl169 bvashr3 zero_extend250

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.38301 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.03148 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.03128 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.04083 —
abziz_portfolio_2012_solvers default unsat ✅ 0.03239 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.03526 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.01256 —
Boolector-SMT-COMP-2011 default unsat ✅ — —
Boolector-SMT-COMP-2012 default unsat ✅ 0.01087 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 2.06862 —
CVC3-SMT-COMP-2011 default unsat ✅ 1.92320 —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.27158 —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.14768 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.03647 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.11331 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.21042 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.04102 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.02310 —
STP2-SMT-COMP-2012 default unsat ✅ 0.02280 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.04158 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ — —
Z3-SMT-COMP-2011 default unsat ✅ 0.02643 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.02483 0.02399
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.52000 0.99985
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.51767 0.99885
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.38787 0.38694
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.71000
STP stp-cryptominisat4 default unsat ✅ 0.02407 0.02300
stp-cmsat4-v15 default unsat ✅ 0.02260 0.02200
stp-cmsat4-mt-v15 default unsat ✅ 0.02236 0.02099
stp-minisat-v15 default unsat ✅ 0.02240 0.02099
Yices2 Yices default unsat ✅ 0.02203 0.02100
Z3 z3 4.4.0 default unsat ✅ 0.04138 0.04099
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.12748 0.12726
ABC_glucose glucose unsat ✅ 0.12311 0.12309
Boolector Boolector boolector unsat ✅ 0.02631 0.02630
Boolector preprop boolector unsat ✅ 0.03388 0.03389
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.50100 0.96623
MapleSTP MapleSTP default unsat ✅ 0.02279 0.02272
MapleSTP-mt default unsat ✅ 0.02324 0.02324
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.33939 0.34054
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.02988 0.02981
Q3B Q3B default unsat ✅ 0.08648 0.08709
STP stp-cms-exp-2016 default unsat ✅ 0.02169 0.02162
stp-cms-mt-2016 default unsat ✅ 0.02155 0.02152
stp-cms-st-2016 default unsat ✅ 0.02159 0.02156
stp-minisat-st-2016 default unsat ✅ 0.02297 0.02293
Yices2 Yices-2.4.2 default unsat ✅ 0.02658 0.02655
Z3 z3-4.4.1 default unsat ✅ 0.03967 0.04076
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.12218 0.12283
Boolector SMT17 final boolector unsat ✅ 0.12196 0.12148
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.59171 1.14281
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.29115 0.29143
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.02802 0.02722
Q3B Q3B default unsat ✅ 0.11742 0.11637
STP stp_st default unsat ✅ 0.04378 0.04349
stp_mt default unsat ✅ 0.04451 0.04388
Yices2 Yices2-Main default unsat ✅ 0.02454 0.02394
Z3 z3-4.5.0 default unsat ✅ 0.04589 0.04512
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.10843 0.10835
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.22402 1.22416
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.28171 0.28273
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.02712 0.02719
Minkeyrink ST_st unsat ✅ 0.02777 0.02776
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.03985 0.03985
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.03985 0.03995
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.03989 0.03991
Yices2 Yices 2.6.0_default unsat ✅ 0.02434 0.02423
Z3 z3-4.7.1_default unsat ✅ 0.04595 0.04584
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.20023 0.20014
Boolector Boolector-wrapped-sq_default unsat ✅ 0.19251 0.19250
Poolector-wrapped-sq_default unsat ✅ 0.18023 0.23069
CVC4 CVC4-sq-final_default unsat ✅ 0.51541 0.51564
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.76000
MathSAT MathSAT5_default.sh unsat ✅ 0.15223 0.15218
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.02932 0.02940
MinkeyRink Solver 2020.3_default unsat ✅ 0.03129 0.03139
STP STP_default unsat ✅ 0.04336 0.04347
STP ++ Mergsat v1_default unsat ✅ 0.03852 0.04015
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.02632 0.02624
Z3 z3-4.8.8_default unsat ✅ 0.04145 0.04139
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.07089 0.07086
MathSAT mathsat-5.6.6_default unsat ✅ 0.19871 0.19869
STP STP 2021.0_default unsat ✅ 0.04193 0.04202
Z3 z3-4.8.11_default unsat ✅ 0.02522 0.02517
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.32471 0.20719
Bitwuzla-MachBV-base unsat ✅ 0.32849 0.21224
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.40626 0.28550
BVDecide bv_decide unsat ✅ 7.45915 7.29294
bv_decide-nokernel unsat ✅ 3.99311 3.82367
cvc5 cvc5 unsat ✅ 0.60458 0.48676
SMTInterpol SMTInterpol unknown ❌ 1201.74843 1226.51899
Yices2 Yices2 unsat ✅ 0.30873 0.17345
Z3alpha Z3-alpha unsat ✅ 0.39435 0.29466
Z3 Z3-alpha-base unsat ✅ 0.29744 0.17487
Z3-Owl-base unsat ✅ 0.33465 0.20674
z3siri-base unsat ✅ 0.27514 0.15739
Z3-Owl Z3-Owl unsat ✅ 0.81638 0.69323