Benchmark

non-incremental/QF_BV/Sage2/bench_9656.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size631860
Compressed Size48613
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 631852
Compressed Size48603
Max. Term Depth2819
Asserts 1089
Declared Functions0
Declared Constants768
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite512 not541 =1387
let12945 bvor256 bvadd4248 bvmul1388
bvult40 bvule40 bvugt40 bvuge43
bvsle9 bvsgt41 bvshl256 bvlshr1199
zero_extend4033

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 40.02300 40.02310
Boolector SMT17 final boolector unsat ✅ 37.12450 37.11750
CVC4 CVC4-smtcomp2017-main default unsat ✅ 25.44490 50.73690
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 28.49040 28.48900
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.30288 0.14903
Q3B Q3B default unknown ❌ 600.04800 1799.37000
STP stp_st default unsat ✅ 0.10394 0.10351
stp_mt default unsat ✅ 0.10432 0.10303
Yices2 Yices2-Main default unsat ✅ 1.74220 1.74129
Z3 z3-4.5.0 default unknown ❌ 600.02300 599.92000
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default unsat ✅ 27.86560 27.85610
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 11.85280 11.85330
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 38.72120 38.71800
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.13672 0.13675
Minkeyrink ST_st unsat ✅ 0.13855 0.13860
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.09925 0.09930
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.10109 0.10042
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.09986 0.09991
Yices2 Yices 2.6.0_default unsat ✅ 1.45972 1.45961
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.96000
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 7.55152 7.55136
Poolector-wrapped-sq_default unsat ✅ 3.51981 13.58000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 36.23150 36.23140
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 19.20340 19.20360
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.15649 0.15656
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.15638 0.15647
Par4 Par4-wrapped-sq_default unsat ✅ 1.72431 5.00000
STP STP-2019-wrapped-sq_default unsat ✅ 0.10667 0.10680
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.10693 0.10706
stp-minisat-wrapped-sq_default unsat ✅ 0.10733 0.10749
stp-mt-wrapped-sq_default unsat ✅ 0.10705 0.10721
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.10787 0.10801
stp-riss-wrapped-sq_default unsat ✅ 0.10695 0.10706
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 1.54509 1.54472
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 4.47725 4.47693
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 2.20933 2.20921
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.01000 2399.90000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 9.69368 9.69342
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 166.68300 166.61100
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 6.77684 6.77451
Boolector Boolector-wrapped-sq_default unsat ✅ 6.57838 6.57797
Poolector-wrapped-sq_default unsat ✅ 3.38810 12.95000
CVC4 CVC4-sq-final_default unsat ✅ 15.62730 15.62800
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.01000 1199.87000
MathSAT MathSAT5_default.sh unsat ✅ 17.32410 17.32340
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.12423 0.12435
MinkeyRink Solver 2020.3_default unsat ✅ 0.13018 0.13029
STP STP_default unsat ✅ 0.09816 0.09821
STP ++ Mergsat v1_default unsat ✅ 0.09209 0.09373
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 2.99499 2.99480
Z3 z3-4.8.8_default unsat ✅ 50.01470 50.01260
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 7.09700 7.09668
Bitwuzla-wrapped_default unsat ✅ 6.96254 6.96194
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 10.42800 10.42780
MathSAT MathSAT-5.6.8_default unsat ✅ 25.70600 25.70510
STP STP 2022.4_default unsat ✅ 0.17883 0.17886
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 2.79729 2.79678
Z3++BV z3++bv_0702_default unsat ✅ 3.99596 3.99331
Z3 z3-4.8.17_default unsat ✅ 41.38070 41.37850
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 11.09580 11.09470
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 11.87930 11.87970
STP STP 2022.4_default unsat ✅ 0.23867 0.23576
STP 2022.4_default unsat ✅ 0.17739 0.17740
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1252.39000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 1.56138 1.56123
Z3-Owl z3-Owl-Final_default unsat ✅ 113.73300 113.71300
z3-Owl-Final_default unsat ✅ 134.88500 134.85800
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 3.37435 3.25443
Bitwuzla-MachBV-base unsat ✅ 5.25485 5.12903
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 4.27059 4.14635
BVDecide bv_decide unsat ✅ 82.01352 81.82420
bv_decide-nokernel unsat ✅ 26.70478 26.57679
cvc5 cvc5 unsat ✅ 10.15717 10.02582
SMTInterpol SMTInterpol unknown ❌ 1201.44249 1227.38435
Yices2 Yices2 unsat ✅ 4.66665 4.54692
Z3alpha Z3-alpha unsat ✅ 451.89480 1799.44298
Z3 Z3-alpha-base unsat ✅ 104.63687 104.50311
Z3-Owl-base unsat ✅ 421.28899 421.12835
z3siri-base unsat ✅ 108.55577 108.39890
Z3-Owl Z3-Owl unsat ✅ 75.12823 74.99598