Benchmark

non-incremental/QF_BV/sage/app1/bench_2243.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size72272
Compressed Size10371
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 72264
Compressed Size10402
Max. Term Depth169
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite74 not72 and1
=187 let159 extract1 bvand38
bvor171 bvadd359 bvmul5 bvsub226
bvult246 bvule537 bvslt2 bvsle42
bvshl172 bvashr5 zero_extend302

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.82329 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.04595 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.05743 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.04686 —
abziz_portfolio_2012_solvers default unsat ✅ 0.04646 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.04536 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.11253 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.11072 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.11263 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 2.08711 —
CVC3-SMT-COMP-2011 default unsat ✅ 1.77914 —
CVC3-SMT-COMP-2012 default unsat ✅ 1.83776 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.55685 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.91926 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.32525 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.77916 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.31444 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.31776 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.21041 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.25741 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.69389 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.21186 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.03912 —
STP2-SMT-COMP-2012 default unsat ✅ 0.03955 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.08162 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.03353 —
Z3-SMT-COMP-2011 default unsat ✅ 0.04001 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.02134 0.02000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.97006 1.88671
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.97049 1.89071
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.85981 0.85887
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.03000
STP stp-cryptominisat4 default unsat ✅ 0.04528 0.04399
stp-cmsat4-v15 default unsat ✅ 0.04369 0.04299
stp-cmsat4-mt-v15 default unsat ✅ 0.04400 0.04299
stp-minisat-v15 default unsat ✅ 0.04352 0.04299
Yices2 Yices default unsat ✅ 0.04118 0.03999
Z3 z3 4.4.0 default unsat ✅ 0.29044 0.28996
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.85721 0.85796
ABC_glucose glucose unsat ✅ 11.14840 11.15470
Boolector Boolector boolector unsat ✅ 0.02338 0.02335
Boolector preprop boolector unsat ✅ 0.02201 0.02262
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.01175 3.69991
MapleSTP MapleSTP default unsat ✅ 0.04292 0.04290
MapleSTP-mt default unsat ✅ 0.04100 0.04100
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.70767 0.70907
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.05446 0.05445
Q3B Q3B default unsat ✅ 0.38263 0.87660
STP stp-cms-exp-2016 default unsat ✅ 0.04230 0.04226
stp-cms-mt-2016 default unsat ✅ 0.04286 0.04285
stp-cms-st-2016 default unsat ✅ 0.04150 0.04149
stp-minisat-st-2016 default unsat ✅ 0.04142 0.04138
Yices2 Yices-2.4.2 default unsat ✅ 0.04075 0.04074
Z3 z3-4.4.1 default unsat ✅ 0.29690 0.29857
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.02356 0.02303
Boolector SMT17 final boolector unsat ✅ 0.02345 0.02276
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.04726 2.04114
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.64304 0.64328
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.04070 0.04013
Q3B Q3B default unsat ✅ 0.41765 0.97855
STP stp_st default unsat ✅ 0.06673 0.06617
stp_mt default unsat ✅ 0.06871 0.06798
Yices2 Yices2-Main default unsat ✅ 0.04125 0.04007
Z3 z3-4.5.0 default unsat ✅ 0.33137 0.33028
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.01682 0.01673
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.04666 2.04663
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.59417 0.59523
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04398 0.04401
Minkeyrink ST_st unsat ✅ 0.04348 0.04355
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.07895 0.07899
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.07875 0.07877
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.07851 0.07855
Yices2 Yices 2.6.0_default unsat ✅ 0.03957 0.03952
Z3 z3-4.7.1_default unsat ✅ 0.30288 0.30278
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.03913 0.03909
Poolector-wrapped-sq_default unsat ✅ 0.17807 0.24900
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.03487 0.03490
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.89705 0.89725
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.05244 0.05258
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.05008 0.05017
Par4 Par4-wrapped-sq_default unsat ✅ 0.02605 0.00604
STP STP-2019-wrapped-sq_default unsat ✅ 0.08824 0.08836
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.08698 0.08713
stp-minisat-wrapped-sq_default unsat ✅ 0.08728 0.08743
stp-mt-wrapped-sq_default unsat ✅ 0.08739 0.08754
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.08755 0.08769
stp-riss-wrapped-sq_default unsat ✅ 0.08720 0.08734
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.04275 0.04273
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.04262 0.04259
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.04351 0.04351
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.09350 0.09352
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.04236 0.04238
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.34206 0.34185
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.25888 0.15893
cvc5 cvc5 unsat ✅ 1.11547 1.01588
SMTInterpol SMTInterpol unsat ✅ 825.10185 862.85512
STP STP unsat ✅ 0.26357 0.16378
Yices2 Yices2 unsat ✅ 0.23669 0.13672
Z3alpha Z3-alpha unsat ✅ 0.31934 0.21964
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.32550 0.19150
Bitwuzla-MachBV-base unsat ✅ 0.29727 0.17802
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.47124 0.34513
BVDecide bv_decide unsat ✅ 14.21998 14.06813
bv_decide-nokernel unsat ✅ 7.49951 7.34675
cvc5 cvc5 unsat ✅ 0.89308 0.76127
SMTInterpol SMTInterpol unknown ❌ 1201.58549 1228.18564
Yices2 Yices2 unsat ✅ 0.29472 0.17431
Z3alpha Z3-alpha unsat ✅ 0.43110 0.38980
Z3 Z3-alpha-base unsat ✅ 0.30412 0.18519
Z3-Owl-base unsat ✅ 0.35670 0.23765
z3siri-base unsat ✅ 0.30715 0.18232
Z3-Owl Z3-Owl unsat ✅ 0.86242 0.73493