Benchmark

non-incremental/QF_BV/Sage2/bench_1334.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size219108
Compressed Size18276
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 219100
Compressed Size18068
Max. Term Depth29
Asserts 688
Declared Functions0
Declared Constants490
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not69 =234 let4133
bvand24 bvor298 bvadd2762 bvmul259
bvult109 bvule75 bvugt6 bvuge236
bvslt2 bvsle1 bvsgt20 bvsge4
bvshl305 bvlshr6 zero_extend410

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.67085 0.67028
Boolector SMT17 final boolector unsat ✅ 7.13424 7.13409
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.13000 1206.08000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 2.82164 2.82192
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.77138 0.75871
Q3B Q3B default unknown ❌ 600.04000 1788.70000
STP stp_st default unknown ❌ 600.09000 600.00900
stp_mt default unknown ❌ 600.08700 1912.85000
Yices2 Yices2-Main default unsat ✅ 0.12145 0.12063
Z3 z3-4.5.0 default unsat ✅ 10.20040 10.19460
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.37707 0.37705
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 17.16120 17.16040
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 5.07874 5.07981
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.47052 0.78284
Minkeyrink ST_st unsat ✅ 0.47681 0.47706
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 1030.01000 1030.02000
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 975.68100 3877.49000
STP-Riss-st-2018_riss-no-stderr unsat ✅ 798.77500 798.65300
Yices2 Yices 2.6.0_default unsat ✅ 0.21491 0.21486
Z3 z3-4.7.1_default unsat ✅ 7.63837 7.63773
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.83521 0.83521
Poolector-wrapped-sq_default unsat ✅ 0.60017 1.92000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 6.88633 6.88612
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 10.13130 10.13150
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.44385 0.88762
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.42237 0.42246
Par4 Par4-wrapped-sq_default unsat ✅ 0.11161 0.00591
STP STP-2019-wrapped-sq_default unsat ✅ 857.21500 857.24500
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 1558.85000 1558.81000
stp-minisat-wrapped-sq_default unknown ❌ 2400.01000 2399.79000
stp-mt-wrapped-sq_default unsat ✅ 949.66600 3773.56000
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 2400.11000 5167.46000
stp-riss-wrapped-sq_default unknown ❌ 0.68059 0.68055
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.11445 0.11441
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.10586 0.10585
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.16394 0.16393
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 2307.27000 2307.31000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.23221 0.23222
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 6.86787 6.86679
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.79584 0.79578
Boolector Boolector-wrapped-sq_default unsat ✅ 0.83145 0.83145
Poolector-wrapped-sq_default unsat ✅ 0.48940 0.42401
CVC4 CVC4-sq-final_default unsat ✅ 789.49100 789.31400
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 395.75300 395.68900
MathSAT MathSAT5_default.sh unsat ✅ 2.68680 2.68662
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.31431 0.31452
MinkeyRink Solver 2020.3_default unsat ✅ 0.38763 0.57625
STP STP_default unsat ✅ 0.38617 0.53049
STP ++ Mergsat v1_default unsat ✅ 0.35558 0.35727
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.31899 0.31897
Z3 z3-4.8.8_default unsat ✅ 2.96608 2.96581
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.76793 0.76780
MathSAT mathsat-5.6.6_default unsat ✅ 2.78797 2.78784
STP STP 2021.0_default unsat ✅ 0.40465 0.62109
Z3 z3-4.8.11_default unsat ✅ 9.03652 9.03573
SMT-COMP 2024 0.33 (4/6) Bitwuzla Bitwuzla unsat ✅ 0.71259 0.61136
cvc5 cvc5 unsat ✅ 491.24880 491.02073
SMTInterpol SMTInterpol unknown ❌ 1201.74946 1234.08418
STP STP unsat ✅ 0.57550 0.47538
Yices2 Yices2 unsat ✅ 0.54757 0.44787
Z3alpha Z3-alpha unknown ❌ 1201.74068 1201.12907
SMT-COMP 2025 0.44 (5/9) Bitwuzla Bitwuzla unsat ✅ 0.40517 0.27956
Bitwuzla-MachBV-base unsat ✅ 0.45662 0.34090
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.51429 0.39399
BVDecide bv_decide unsat ✅ 18.37736 18.21351
bv_decide-nokernel unsat ✅ 7.16294 6.99544
cvc5 cvc5 unsat ✅ 396.88555 396.72430
SMTInterpol SMTInterpol unknown ❌ 1201.58517 1227.47003
Yices2 Yices2 unsat ✅ 0.85290 0.73424
Z3alpha Z3-alpha unknown ❌ 1201.00611 4801.33460
Z3 Z3-alpha-base unknown ❌ 1201.30498 1200.96737
Z3-Owl-base unknown ❌ 1201.26541 1200.98064
z3siri-base unknown ❌ 1201.27482 1201.02845
Z3-Owl Z3-Owl unknown ❌ 1201.75369 1201.00202