Benchmark

non-incremental/QF_BV/sage/app7/bench_441.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3257053
Compressed Size204747
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3257045
Compressed Size204753
Max. Term Depth12460
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2003 and1
=2670 let12355 extract1433 bvand33892
bvor22365 bvxor1746 bvadd35963 bvmul2
bvsub11690 bvsdiv3 bvult477 bvule513
bvslt211 bvsle121 bvshl11490 bvashr21795
zero_extend1155

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.48446 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.48563 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.48529 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.49129 —
abziz_portfolio_2012_solvers default unsat ✅ 0.49066 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.48812 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.65704 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.79258 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.69437 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 172.84000 —
CVC3-SMT-COMP-2011 default unsat ✅ 146.12200 —
CVC3-SMT-COMP-2012 default unsat ✅ 152.82100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.81386 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.44760 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.97378 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.93595 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.21293 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.17882 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.84568 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.88439 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.08273 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.32948 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.51278 —
STP2-SMT-COMP-2012 default unsat ✅ 0.48586 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.51379 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.52439 —
Z3-SMT-COMP-2011 default unsat ✅ 0.48189 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.87631 0.87523
Boolector SMT17 final boolector unsat ✅ 0.85530 0.85429
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.63063 7.42341
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.62906 0.62932
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.24752 1.24663
Q3B Q3B default unsat ✅ 0.85440 2.10000
STP stp_st default unsat ✅ 0.61853 0.61784
stp_mt default unsat ✅ 0.57544 0.57185
Yices2 Yices2-Main default unsat ✅ 0.18234 0.18154
Z3 z3-4.5.0 default unsat ✅ 0.76268 0.75727
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.77643 0.77643
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.86064 3.86021
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.61540 0.61648
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.24394 1.24382
Minkeyrink ST_st unsat ✅ 1.24411 1.24418
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.56310 0.56307
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.56210 0.56216
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.56283 0.56285
Yices2 Yices 2.6.0_default unsat ✅ 0.16955 0.16947
Z3 z3-4.7.1_default unsat ✅ 0.80840 0.80823
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.59951 1.59959
Poolector-wrapped-sq_default unsat ✅ 1.79416 6.70579
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.23610 1.23600
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.95571 3.95583
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.86480 0.86489
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.86288 0.86289
Par4 Par4-wrapped-sq_default unsat ✅ 0.18332 0.00698
STP STP-2019-wrapped-sq_default unsat ✅ 0.58300 0.58317
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.57324 0.57338
stp-minisat-wrapped-sq_default unsat ✅ 0.58136 0.58149
stp-mt-wrapped-sq_default unsat ✅ 0.61133 0.61142
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.57224 0.57232
stp-riss-wrapped-sq_default unsat ✅ 0.58286 0.58295
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.17834 0.17835
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.17873 0.17863
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.18038 0.18027
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.17770 0.17759
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.17916 0.17901
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.52725 0.52570
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.21132 1.21124
Boolector Boolector-wrapped-sq_default unsat ✅ 1.51358 1.51352
Poolector-wrapped-sq_default unsat ✅ 1.78468 6.72000
CVC4 CVC4-sq-final_default unsat ✅ 5.25983 5.25917
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.77734 0.77722
MathSAT MathSAT5_default.sh unsat ✅ 0.64413 0.64399
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.71964 0.71975
MinkeyRink Solver 2020.3_default unsat ✅ 0.75252 0.75256
STP STP_default unsat ✅ 0.53732 0.53743
STP ++ Mergsat v1_default unsat ✅ 0.53032 0.53199
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.21303 0.21299
Z3 z3-4.8.8_default unsat ✅ 0.51091 0.51084
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.20069 1.20048
Bitwuzla-wrapped_default unsat ✅ 1.29818 1.29801
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.10652 4.10684
MathSAT MathSAT-5.6.8_default unsat ✅ 0.66089 0.66079
STP STP 2022.4_default unsat ✅ 0.60768 0.60772
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.21580 0.21572
Z3++BV z3++bv_0702_default unsat ✅ 0.69298 0.69281
Z3 z3-4.8.17_default unsat ✅ 0.61670 0.61853