Benchmark

non-incremental/QF_BV/sage/app8/bench_239.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size48474
Compressed Size8587
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 48466
Compressed Size8589
Max. Term Depth146
Asserts 1
Declared Functions0
Declared Constants155
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite2 not163 and1
=232 let136 extract3 bvand9
bvor63 bvadd465 bvmul11 bvsub129
bvult140 bvule324 bvslt6 bvsle11
bvshl71 zero_extend147 sign_extend1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.73235 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.98033 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.97801 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.98051 —
abziz_portfolio_2012_solvers default unsat ✅ 0.97996 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.99760 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.24367 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.75836 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.11485 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 7.89158 —
CVC4-SMT-EVAL-2013 default unsat ✅ 8.75742 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.16282 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.76693 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.16022 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.17727 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.26247 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.13461 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.66449 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.32125 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.21300 —
STP2-SMT-COMP-2012 default unsat ✅ 0.38063 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.77143 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 1.05120 —
Z3-SMT-COMP-2011 default unsat ✅ 0.95240 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.26944 0.26896
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.78535 1.53277
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.74515 3.45547
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.38320 0.38194
SMT-RAT SMT-RAT-final default unsat ✅ 78.68820 78.71500
STP stp-cryptominisat4 default unsat ✅ 0.27642 0.27596
stp-cmsat4-v15 default unsat ✅ 0.29291 0.29196
stp-cmsat4-mt-v15 default unknown ❌ 0.22845 0.22696
stp-minisat-v15 default unsat ✅ 0.23694 0.23596
Yices2 Yices default unsat ✅ 0.03125 0.02999
Z3 z3 4.4.0 default unsat ✅ 0.70591 0.70589
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.63333 0.63342
ABC_glucose glucose unsat ✅ 5.59249 5.59543
Boolector Boolector boolector unsat ✅ 0.16737 0.16739
Boolector preprop boolector unsat ✅ 0.17993 0.18003
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.23138 2.42928
MapleSTP MapleSTP default unsat ✅ 0.38439 0.38459
MapleSTP-mt default unsat ✅ 0.38366 0.91923
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.34484 0.34601
MinkeyRink Minkeyrink 2016 default unsat ✅ 1.70751 2.36647
Q3B Q3B default unsat ✅ 29.56650 88.41000
STP stp-cms-exp-2016 default unsat ✅ 0.45126 0.45143
stp-cms-mt-2016 default unsat ✅ 0.40123 0.97740
stp-cms-st-2016 default unsat ✅ 0.36674 0.36688
stp-minisat-st-2016 default unsat ✅ 0.32342 0.32358
Yices2 Yices-2.4.2 default unsat ✅ 0.03602 0.03602
Z3 z3-4.4.1 default unsat ✅ 0.90610 0.90782
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.29152 0.29060
Boolector SMT17 final boolector unsat ✅ 0.29105 0.29023
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.01774 1.99517
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.32676 0.32715
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.60027 0.57936
Q3B Q3B default unsat ✅ 27.09410 80.88000
STP stp_st default unsat ✅ 0.86231 0.86202
stp_mt default unsat ✅ 1.02142 2.29957
Yices2 Yices2-Main default unsat ✅ 0.03037 0.02943
Z3 z3-4.5.0 default unsat ✅ 1.05330 1.05263
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.24602 0.24598
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.73833 1.73833
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.33460 0.33565
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.32514 0.45699
Minkeyrink ST_st unsat ✅ 0.30045 0.30047
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.48391 0.48392
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.45994 1.06256
STP-Riss-st-2018_riss-no-stderr unsat ✅ 1.06346 1.06335
Yices2 Yices 2.6.0_default unsat ✅ 0.03748 0.03739
Z3 z3-4.7.1_default unsat ✅ 0.71875 0.71864
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.00738 1.00734
Poolector-wrapped-sq_default unsat ✅ 0.27964 0.27565
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.16582 0.16583
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.42539 1.42554
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.06367 0.06381
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.06135 0.06141
Par4 Par4-wrapped-sq_default unsat ✅ 0.05280 0.00594
STP STP-2019-wrapped-sq_default unsat ✅ 0.55012 0.55050
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 6.94916 6.94872
stp-minisat-wrapped-sq_default unsat ✅ 0.48224 0.48248
stp-mt-wrapped-sq_default unsat ✅ 0.51642 1.20673
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 6.94506 7.52841
stp-riss-wrapped-sq_default unknown ❌ 0.27214 0.27236
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.04695 0.04696
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.06715 0.06716
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.06143 0.06141
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.10000 2400.20000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.08699 0.08695
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.92513 0.92510
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.38988 0.38979
MathSAT mathsat-5.6.6_default unsat ✅ 0.19276 0.19274
STP STP 2021.0_default unsat ✅ 0.21473 0.27552
Z3 z3-4.8.11_default unsat ✅ 1.05870 1.05859
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.46998 0.46992
Bitwuzla-wrapped_default unsat ✅ 0.42095 0.42088
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.58880 1.58795
MathSAT MathSAT-5.6.8_default unsat ✅ 0.16871 0.16866
STP STP 2022.4_default unsat ✅ 0.24265 0.24265
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.05202 0.05199
Z3++BV z3++bv_0702_default unsat ✅ 0.33266 0.33257
Z3 z3-4.8.17_default unsat ✅ 0.62313 0.62501
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.12313 2.12320
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.61567 1.61601
STP STP 2022.4_default unsat ✅ 0.22121 0.22122
STP 2022.4_default unsat ✅ 0.22131 0.22125
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 5.13412 14.42860
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.04020 0.04014
Z3-Owl z3-Owl-Final_default unsat ✅ 21.18660 21.17910
z3-Owl-Final_default unsat ✅ 18.51050 18.50700
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 1.73130 1.60475
Bitwuzla-MachBV-base unsat ✅ 2.13546 2.00014
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.62614 1.50693
BVDecide bv_decide unsat ✅ 11.11682 10.96364
bv_decide-nokernel unsat ✅ 6.19402 6.04552
cvc5 cvc5 unsat ✅ 1.45754 1.32851
SMTInterpol SMTInterpol unsat ✅ 301.49664 320.77621
Yices2 Yices2 unsat ✅ 0.40126 0.27474
Z3alpha Z3-alpha unsat ✅ 15.16256 58.57432
Z3 Z3-alpha-base unsat ✅ 11.67334 11.55399
Z3-Owl-base unsat ✅ 46.23966 46.10160
z3siri-base unsat ✅ 11.98544 11.85499
Z3-Owl Z3-Owl unsat ✅ 10.83993 10.71233