Benchmark

non-incremental/QF_BV/sage/app12/bench_3557.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size21716
Compressed Size2648
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 21708
Compressed Size2661
Max. Term Depth39
Asserts 1
Declared Functions0
Declared Constants142
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite21 not59 and1
=113 let29 bvor66 bvadd73
bvsub55 bvult70 bvule52 bvslt1
bvshl66 zero_extend149

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.20752 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.14018 —
abziz_portfolio_2011_solvers_2 default unknown ❌ — —
abziz_portfolio_2012_minfeatures default sat ✅ 0.13416 —
abziz_portfolio_2012_solvers default sat ✅ 0.13309 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.13866 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 5.04187 —
Boolector-SMT-COMP-2011 default sat ✅ 2.53323 —
Boolector-SMT-COMP-2012 default sat ✅ 0.02700 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 11.61840 —
CVC3-SMT-COMP-2011 default sat ✅ 10.32860 —
CVC3-SMT-COMP-2012 default sat ✅ 10.51670 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default sat ✅ 17.43610 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.11572 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.10693 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default sat ✅ 1.06802 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.13615 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.10320 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.06820 —
STP2-SMT-COMP-2012 default sat ✅ 0.14350 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 0.26177 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.17318 —
Z3-SMT-COMP-2011 default sat ✅ 0.13286 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 3.84541 3.84641
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.39112 0.75588
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.37556 0.72589
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.47041 0.46993
SMT-RAT SMT-RAT-final default sat ✅ 156.27000 156.34400
STP stp-cryptominisat4 default sat ✅ 0.11221 0.11098
stp-cmsat4-v15 default sat ✅ 0.11040 0.10898
stp-cmsat4-mt-v15 default unknown ❌ 0.09026 0.08899
stp-minisat-v15 default sat ✅ 0.10452 0.10398
Yices2 Yices default sat ✅ 0.01281 0.01200
Z3 z3 4.4.0 default sat ✅ 0.13231 0.13198
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 0.22626 0.22663
ABC_glucose glucose sat ✅ 1.70151 1.70263
Boolector Boolector boolector sat ✅ 6.24192 6.24541
Boolector preprop boolector sat ✅ 6.09382 6.09727
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.27384 0.52464
MapleSTP MapleSTP default sat ✅ 0.19815 0.19822
MapleSTP-mt default sat ✅ 0.21871 0.56334
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.44762 0.44927
MinkeyRink Minkeyrink 2016 default sat ✅ 0.29283 0.45121
Q3B Q3B default unknown ❌ 2400.02000 7203.61000
STP stp-cms-exp-2016 default sat ✅ 0.24497 0.24509
stp-cms-mt-2016 default sat ✅ 0.28693 0.51034
stp-cms-st-2016 default sat ✅ 0.20241 0.20249
stp-minisat-st-2016 default sat ✅ 0.35170 0.35185
Yices2 Yices-2.4.2 default sat ✅ 0.01438 0.01437
Z3 z3-4.4.1 default sat ✅ 0.14166 0.14301
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.25060 1.24913
Boolector SMT17 final boolector sat ✅ 5.53721 5.53575
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.39016 0.73886
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.60706 0.60723
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.16943 0.12865
Q3B Q3B default unknown ❌ 600.09600 1799.64000
STP stp_st default sat ✅ 0.99930 0.99472
stp_mt default sat ✅ 1.47920 3.31524
Yices2 Yices2-Main default sat ✅ 0.01249 0.01243
Z3 z3-4.5.0 default sat ✅ 0.42778 0.42713
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.52810 0.52804
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.66311 0.66324
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.46739 0.46825
MinkeyRink Minkeyrink MT_mt sat ✅ 0.06987 0.08600
Minkeyrink ST_st sat ✅ 0.06499 0.06524
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.41010 0.40989
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.49039 0.83820
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.20877 1.20881
Yices2 Yices 2.6.0_default sat ✅ 0.01471 0.01465
Z3 z3-4.7.1_default sat ✅ 0.34964 0.34957
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 1.09454 1.09453
Poolector-wrapped-sq_default sat ✅ 0.58215 1.93000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 2.30965 2.30979
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.17009 0.17032
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.06632 0.07857
MinkeyRink ST-wrapped-sq_default sat ✅ 0.05899 0.05906
Par4 Par4-wrapped-sq_default sat ✅ 0.02229 0.00591
STP STP-2019-wrapped-sq_default sat ✅ 0.43215 0.43251
stp-mergesat-fixed-wrapped-sq_default sat ✅ 0.93722 0.93745
stp-minisat-wrapped-sq_default sat ✅ 0.52035 0.52052
stp-mt-wrapped-sq_default sat ✅ 0.49763 0.83680
stp-portfolio-fixed-wrapped-sq_default sat ✅ 1.03280 1.39080
stp-riss-wrapped-sq_default unknown ❌ 0.37167 0.37192
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.01649 0.01651
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.03249 0.03250
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.07400 0.07402
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 0.26543 0.26518
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.03207 0.03204
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.39311 0.39311
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.91317 0.91311
Bitwuzla-wrapped_default sat ✅ 0.04959 0.04953
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.20002 0.20054
MathSAT MathSAT-5.6.8_default sat ✅ 0.13527 0.13392
STP STP 2022.4_default sat ✅ 0.07026 0.06961
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.03480 0.03471
Z3++BV z3++bv_0702_default sat ✅ 0.10848 0.10841
Z3 z3-4.8.17_default sat ✅ 0.37210 0.37392
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.28118 0.18164
cvc5 cvc5 sat ✅ 0.39283 0.29320
SMTInterpol SMTInterpol unknown ❌ 1201.75159 1268.93347
STP STP sat ✅ 0.39152 0.29182
Yices2 Yices2 sat ✅ 0.24615 0.14630
Z3alpha Z3-alpha sat ✅ 0.34169 0.24174
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.30354 0.17524
Bitwuzla-MachBV-base sat ✅ 0.31860 0.19901
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.78198 0.65920
BVDecide bv_decide sat ✅ 3.05835 2.88624
bv_decide-nokernel sat ✅ 2.96702 2.79169
cvc5 cvc5 sat ✅ 0.41751 0.29448
SMTInterpol SMTInterpol unknown ❌ 1201.48474 1307.00154
Yices2 Yices2 sat ✅ 0.29207 0.16429
Z3alpha Z3-alpha sat ✅ 0.48689 0.63786
Z3 Z3-alpha-base sat ✅ 0.66625 0.54489
Z3-Owl-base sat ✅ 1.76261 1.63594
z3siri-base sat ✅ 0.75525 0.62700
Z3-Owl Z3-Owl sat ✅ 4.71464 4.58479