Benchmark

non-incremental/QF_BV/sage/app7/bench_1728.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1212760
Compressed Size94844
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1212752
Compressed Size94851
Max. Term Depth4652
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1517 and1
=2056 let4595 extract1198 bvand11332
bvor7304 bvxor1366 bvadd12816 bvmul1
bvsub4119 bvult426 bvule449 bvslt193
bvsle97 bvshl3963 bvashr6984 zero_extend914

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.18546 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.22301 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.22387 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.22590 —
abziz_portfolio_2012_solvers default unsat ✅ 0.22753 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.22245 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.23508 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.28004 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.25224 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 103.77700 —
CVC3-SMT-COMP-2011 default unsat ✅ — —
CVC3-SMT-COMP-2012 default unsat ✅ 90.42170 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.03706 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.74776 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.37519 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.36411 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.46684 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.45172 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.33338 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.80475 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.16232 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.47864 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.18079 —
STP2-SMT-COMP-2012 default unsat ✅ 0.17172 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.17330 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.25043 —
Z3-SMT-COMP-2011 default unsat ✅ 0.21446 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.32793 0.32695
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.67538 2.74658
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.66326 2.73558
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.26107 0.25996
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.98000
STP stp-cryptominisat4 default unsat ✅ 0.16571 0.16497
stp-cmsat4-v15 default unsat ✅ 0.16321 0.16197
stp-cmsat4-mt-v15 default unsat ✅ 0.16463 0.16297
stp-minisat-v15 default unsat ✅ 0.16407 0.16297
Yices2 Yices default unsat ✅ 0.07609 0.07499
Z3 z3 4.4.0 default unsat ✅ 0.23575 0.23596
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.68926 0.68901
ABC_glucose glucose unsat ✅ 0.68185 0.68263
Boolector Boolector boolector unsat ✅ 0.40189 0.40209
Boolector preprop boolector unsat ✅ 0.39231 0.39265
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.63592 2.68831
MapleSTP MapleSTP default unsat ✅ 0.15507 0.15514
MapleSTP-mt default unsat ✅ 0.15522 0.15529
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.23219 0.23331
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.20832 0.20840
Q3B Q3B default unsat ✅ 0.41417 0.97366
STP stp-cms-exp-2016 default unsat ✅ 0.16002 0.16009
stp-cms-mt-2016 default unsat ✅ 0.16200 0.16231
stp-cms-st-2016 default unsat ✅ 0.16150 0.16154
stp-minisat-st-2016 default unsat ✅ 0.16266 0.16272
Yices2 Yices-2.4.2 default unsat ✅ 0.07544 0.07545
Z3 z3-4.4.1 default unsat ✅ 0.24252 0.24402
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.32757 0.32226
Boolector SMT17 final boolector unsat ✅ 0.31513 0.31396
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.74337 2.82281
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.24314 0.24262
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.47484 0.47538
Q3B Q3B default unsat ✅ 0.40383 0.93731
STP stp_st default unsat ✅ 0.20034 0.19912
stp_mt default unsat ✅ 0.20873 0.20445
Yices2 Yices2-Main default unsat ✅ 0.07254 0.07167
Z3 z3-4.5.0 default unsat ✅ 0.26256 0.26117
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.27110 0.27083
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.47321 1.47314
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.23053 0.23166
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.46817 0.46800
Minkeyrink ST_st unsat ✅ 0.47047 0.47027
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.19925 0.19909
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.20022 0.20031
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.19963 0.19963
Yices2 Yices 2.6.0_default unsat ✅ 0.07078 0.07051
Z3 z3-4.7.1_default unsat ✅ 0.29290 0.29277
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.53022 0.43004
cvc5 cvc5 unsat ✅ 0.57761 0.47792
SMTInterpol SMTInterpol unsat ✅ 848.87793 1219.95963
STP STP unsat ✅ 4.96530 4.86528
Yices2 Yices2 unsat ✅ 0.26718 0.16742
Z3alpha Z3-alpha unsat ✅ 0.35522 0.25548
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.50240 0.38001
Bitwuzla-MachBV-base unsat ✅ 0.68682 0.55650
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.65783 0.53275
BVDecide bv_decide unsat ✅ 217.85173 217.71259
bv_decide-nokernel unsat ✅ 187.55633 187.39520
cvc5 cvc5 unsat ✅ 0.54559 0.42924
SMTInterpol SMTInterpol unknown ❌ 1201.89092 3334.86904
Yices2 Yices2 unsat ✅ 0.33249 0.20014
Z3alpha Z3-alpha unsat ✅ 0.55084 0.46304
Z3 Z3-alpha-base unsat ✅ 0.37222 0.25481
Z3-Owl-base unsat ✅ 0.79988 0.65907
z3siri-base unsat ✅ 0.36191 0.24215
Z3-Owl Z3-Owl unsat ✅ 0.92570 0.79693