Benchmark

non-incremental/QF_BV/sage/app7/bench_1399.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1578947
Compressed Size115610
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1578939
Compressed Size115600
Max. Term Depth6103
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1647 and1
=2227 let6002 extract1256 bvand15363
bvor9970 bvxor1447 bvadd16982 bvmul1
bvsub5445 bvult438 bvule474 bvslt204
bvsle99 bvshl5282 bvashr9596 zero_extend969

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.22169 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.24678 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.24399 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.24833 —
abziz_portfolio_2012_solvers default unsat ✅ 0.25307 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.25200 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.30237 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.36779 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.32182 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 51.71960 —
CVC3-SMT-COMP-2011 default unsat ✅ 43.79570 —
CVC3-SMT-COMP-2012 default unsat ✅ 45.78240 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.29417 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.12489 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.47538 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.45418 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.59634 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.58103 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.42313 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.31253 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.88369 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.62425 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.23591 —
STP2-SMT-COMP-2012 default unsat ✅ 0.23049 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.22932 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.26278 —
Z3-SMT-COMP-2011 default unsat ✅ 0.24004 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.43365 0.43293
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.10119 6.66448
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.10833 3.44048
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.33750 0.33695
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.96000
STP stp-cryptominisat4 default unsat ✅ 0.21423 0.21297
stp-cmsat4-v15 default unsat ✅ 0.21237 0.21097
stp-cmsat4-mt-v15 default unsat ✅ 0.21309 0.21197
stp-minisat-v15 default unsat ✅ 0.21129 0.20997
Yices2 Yices default unsat ✅ 0.09715 0.09598
Z3 z3 4.4.0 default unsat ✅ 0.31860 0.31895
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.89944 0.90014
ABC_glucose glucose unsat ✅ 0.88851 0.88895
Boolector Boolector boolector unsat ✅ 0.54559 0.54581
Boolector preprop boolector unsat ✅ 0.52603 0.52692
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.05644 3.36014
MapleSTP MapleSTP default unsat ✅ 0.20130 0.20135
MapleSTP-mt default unsat ✅ 0.20256 0.20247
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.30312 0.30423
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.27396 0.27409
Q3B Q3B default unsat ✅ 0.53171 0.52954
STP stp-cms-exp-2016 default unsat ✅ 0.20802 0.20804
stp-cms-mt-2016 default unsat ✅ 0.20967 0.20969
stp-cms-st-2016 default unsat ✅ 0.20942 0.20946
stp-minisat-st-2016 default unsat ✅ 0.21079 0.21087
Yices2 Yices-2.4.2 default unsat ✅ 0.09544 0.09546
Z3 z3-4.4.1 default unsat ✅ 0.28501 0.28675
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.43709 0.43631
Boolector SMT17 final boolector unsat ✅ 0.39174 0.39079
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.05470 3.30961
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.31651 0.31225
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.61408 0.61327
Q3B Q3B default unsat ✅ 0.49766 0.49862
STP stp_st default unsat ✅ 0.27387 0.27332
stp_mt default unsat ✅ 0.25717 0.25655
Yices2 Yices2-Main default unsat ✅ 0.09142 0.09064
Z3 z3-4.5.0 default unsat ✅ 0.31307 0.31221
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.35234 0.35221
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.91374 1.91376
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.30072 0.30179
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.61826 0.61809
Minkeyrink ST_st unsat ✅ 0.62298 0.62089
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.26032 0.26034
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.26082 0.26088
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.26066 0.26069
Yices2 Yices 2.6.0_default unsat ✅ 0.08821 0.08811
Z3 z3-4.7.1_default unsat ✅ 0.34984 0.34970
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.68600 0.68603
Poolector-wrapped-sq_default unsat ✅ 0.88585 3.13822
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.54719 0.54721
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.98708 1.98730
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.45888 0.45895
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.45835 0.45847
Par4 Par4-wrapped-sq_default unsat ✅ 0.09632 0.00575
STP STP-2019-wrapped-sq_default unsat ✅ 0.26955 0.26964
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.26700 0.26713
stp-minisat-wrapped-sq_default unsat ✅ 0.26877 0.26892
stp-mt-wrapped-sq_default unsat ✅ 0.26958 0.26974
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.26606 0.26622
stp-riss-wrapped-sq_default unsat ✅ 0.26855 0.26865
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.09229 0.09228
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.09202 0.09206
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.09234 0.09236
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.09271 0.09271
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.09268 0.09270
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.28791 0.28785
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.54437 0.54431
Boolector Boolector-wrapped-sq_default unsat ✅ 0.68295 0.68295
Poolector-wrapped-sq_default unsat ✅ 0.87864 3.13624
CVC4 CVC4-sq-final_default unsat ✅ 2.58248 2.58231
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.37779 0.37776
MathSAT MathSAT5_default.sh unsat ✅ 0.31392 0.31389
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.37938 0.37948
MinkeyRink Solver 2020.3_default unsat ✅ 0.39280 0.39272
STP STP_default unsat ✅ 0.24808 0.24823
STP ++ Mergsat v1_default unsat ✅ 0.24488 0.24668
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.10895 0.10889
Z3 z3-4.8.8_default unsat ✅ 0.25827 0.25818
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.57621 0.47633
cvc5 cvc5 unsat ✅ 0.57569 0.47629
SMTInterpol SMTInterpol unsat ✅ 994.59238 1442.47710
STP STP unsat ✅ 7.79296 7.69280
Yices2 Yices2 unsat ✅ 0.28060 0.18049
Z3alpha Z3-alpha unsat ✅ 0.39173 0.29213
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.60823 0.48094
Bitwuzla-MachBV-base unsat ✅ 0.60895 0.49161
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.77928 0.65170
BVDecide bv_decide unsat ✅ 414.62196 414.44186
bv_decide-nokernel unsat ✅ 377.05179 376.87893
cvc5 cvc5 unsat ✅ 0.58247 0.46801
SMTInterpol SMTInterpol unknown ❌ 1201.89140 3239.79770
Yices2 Yices2 unsat ✅ 0.31706 0.19244
Z3alpha Z3-alpha unsat ✅ 0.62926 0.55516
Z3 Z3-alpha-base unsat ✅ 0.40695 0.28735
Z3-Owl-base unsat ✅ 0.97413 0.85621
z3siri-base unsat ✅ 0.43193 0.31148
Z3-Owl Z3-Owl unsat ✅ 0.96620 0.84131