Benchmark

non-incremental/QF_BV/Sage2/bench_9231.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size661191
Compressed Size16362
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 661183
Compressed Size16352
Max. Term Depth171
Asserts 471
Declared Functions0
Declared Constants204
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not79 =85 let14817
extract4 bvand2 bvor14 bvadd5491
bvmul459 bvult66 bvule103 bvugt16
bvuge187 bvsgt6 bvsge7 bvshl3705
bvlshr104 bvashr9 zero_extend4950

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.83869 0.81803
Boolector SMT17 final boolector sat ✅ 18.03410 18.03360
CVC4 CVC4-smtcomp2017-main default sat ✅ 3.99308 7.70875
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 270.25700 270.21000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.42663 1.43191
Q3B Q3B default unknown ❌ 600.02800 1200.01000
STP stp_st default sat ✅ 3.30453 3.30101
stp_mt default sat ✅ 3.82516 13.23850
Yices2 Yices2-Main default sat ✅ 0.18885 0.18809
Z3 z3-4.5.0 default sat ✅ 14.51060 14.50860
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.55270 0.55260
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 3.82248 3.82247
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 192.80300 192.80700
MinkeyRink Minkeyrink MT_mt sat ✅ 0.80157 1.86070
Minkeyrink ST_st sat ✅ 0.71047 0.71034
STP STP-CMS-st-2018_default-no-stderr sat ✅ 2.50267 2.49927
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 1.80595 5.13867
STP-Riss-st-2018_riss-no-stderr sat ✅ 2.91547 2.91530
Yices2 Yices 2.6.0_default sat ✅ 0.13660 0.13656
Z3 z3-4.7.1_default sat ✅ 22.60080 22.59860
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 3.08300 3.08316
Poolector-wrapped-sq_default sat ✅ 1.90409 6.96921
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 24.41160 24.40860
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 5.22470 5.22494
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.79351 1.95049
MinkeyRink ST-wrapped-sq_default sat ✅ 0.83040 0.83041
Par4 Par4-wrapped-sq_default sat ✅ 0.43015 0.00627
STP STP-2019-wrapped-sq_default sat ✅ 1.51403 1.51442
stp-mergesat-fixed-wrapped-sq_default sat ✅ 8.68604 8.67301
stp-minisat-wrapped-sq_default sat ✅ 0.95526 0.95544
stp-mt-wrapped-sq_default sat ✅ 1.84886 5.51897
stp-portfolio-fixed-wrapped-sq_default sat ✅ 8.99270 10.68720
stp-riss-wrapped-sq_default unknown ❌ 0.57724 0.57745
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.40173 0.40152
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.78597 0.78599
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 1.20204 1.20201
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.01000 2399.66000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.33910 0.33910
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 22.90700 22.90670
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 2.76525 2.76509
Boolector Boolector-wrapped-sq_default sat ✅ 2.90813 2.90809
Poolector-wrapped-sq_default sat ✅ 1.79297 6.73560
CVC4 CVC4-sq-final_default sat ✅ 7.55701 7.55622
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.09000 1200.06000
MathSAT MathSAT5_default.sh sat ✅ 174.93900 174.90000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.40125 0.40135
MinkeyRink Solver 2020.3_default sat ✅ 0.87885 2.27715
STP STP_default sat ✅ 0.84244 2.28212
STP ++ Mergsat v1_default sat ✅ 0.64926 0.65103
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.63118 0.63106
Z3 z3-4.8.8_default sat ✅ 3.50852 3.50867
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.91923 0.91914
MathSAT mathsat-5.6.6_default sat ✅ 472.45900 472.29800
STP STP 2021.0_default sat ✅ 0.68113 1.65324
Z3 z3-4.8.11_default sat ✅ 11.94600 11.94550
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default sat ✅ 2.74929 2.74892
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 10.77170 10.77160
STP STP 2022.4_default sat ✅ 1.21266 1.21266
STP 2022.4_default sat ✅ 1.21125 1.21125
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default sat ✅ 38.16220 61.66240
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.17187 0.17180
Z3-Owl z3-Owl-Final_default sat ✅ 37.81390 37.80840
z3-Owl-Final_default sat ✅ 49.53530 49.53130
SMT-COMP 2025 Bitwuzla Bitwuzla sat ✅ 1.35280 1.23048
Bitwuzla-MachBV-base sat ✅ 0.79704 0.68137
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.85081 0.71606
BVDecide bv_decide sat ✅ 7.74823 7.58776
bv_decide-nokernel sat ✅ 7.61373 7.48017
cvc5 cvc5 sat ✅ 6.28508 6.15631
SMTInterpol SMTInterpol sat ✅ 22.28561 36.80795
Yices2 Yices2 sat ✅ 0.91552 0.79070
Z3alpha Z3-alpha sat ✅ 4.37787 15.81663
Z3 Z3-alpha-base sat ✅ 39.34446 39.22185
Z3-Owl-base sat ✅ 164.77275 164.61181
z3siri-base sat ✅ 39.82145 39.68872
Z3-Owl Z3-Owl sat ✅ 16.67452 16.55061