Benchmark

non-incremental/QF_BV/Sage2/bench_15881.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size655002
Compressed Size27266
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 654994
Compressed Size27277
Max. Term Depth510
Asserts 895
Declared Functions0
Declared Constants453
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not161 =361
let13623 extract17 bvand29 bvor167
bvadd6356 bvmul2543 bvult151 bvule191
bvugt65 bvuge136 bvshl182 bvlshr59
zero_extend4089

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 2.76852 2.76776
Boolector SMT17 final boolector sat ✅ 63.73850 63.73450
CVC4 CVC4-smtcomp2017-main default sat ✅ 80.98940 162.49100
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 84.97030 84.94610
MinkeyRink MinkeyRink 2017.3a default sat ✅ 6.82023 8.14000
Q3B Q3B default unknown ❌ 600.03300 1799.78000
STP stp_st default sat ✅ 178.54400 178.48700
stp_mt default sat ✅ 41.77070 156.38000
Yices2 Yices2-Main default sat ✅ 3.54817 3.54704
Z3 z3-4.5.0 default sat ✅ 217.23000 217.20000
SMT-COMP 2018 Boolector Boolector_default sat ✅ 2.52995 2.52972
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 19.00830 19.00690
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 92.94230 92.94280
MinkeyRink Minkeyrink MT_mt sat ✅ 3.37228 11.86790
Minkeyrink ST_st sat ✅ 4.79603 4.79592
STP STP-CMS-st-2018_default-no-stderr sat ✅ 269.56900 269.53200
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 533.27200 2111.86000
STP-Riss-st-2018_riss-no-stderr sat ✅ 35.15180 35.14830
Yices2 Yices 2.6.0_default sat ✅ 3.34533 3.34505
Z3 z3-4.7.1_default sat ✅ 772.25900 772.22600
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 4.77856 4.77838
Poolector-wrapped-sq_default sat ✅ 3.61225 13.98000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 54.61480 54.61390
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 14.90980 14.90980
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 17.38500 67.65740
MinkeyRink ST-wrapped-sq_default sat ✅ 25.97660 25.97570
Par4 Par4-wrapped-sq_default sat ✅ 2.27467 6.59000
STP STP-2019-wrapped-sq_default sat ✅ 114.75200 114.71900
stp-mergesat-fixed-wrapped-sq_default sat ✅ 51.44610 51.44590
stp-minisat-wrapped-sq_default sat ✅ 46.12940 46.12570
stp-mt-wrapped-sq_default sat ✅ 56.97990 220.41200
stp-portfolio-fixed-wrapped-sq_default sat ✅ 121.63900 238.35000
stp-riss-wrapped-sq_default unknown ❌ 1.91334 1.91359
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 2.71655 2.71663
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 1.33687 1.33681
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 2.99600 2.99571
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.01000 2399.69000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 1.57049 1.57058
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 163.60100 163.59100
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 23.26440 23.26280
Boolector Boolector-wrapped-sq_default sat ✅ 8.19261 8.18636
Poolector-wrapped-sq_default sat ✅ 3.08714 11.79000
CVC4 CVC4-sq-final_default sat ✅ 18.53660 18.53510
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.06000 1200.01000
MathSAT MathSAT5_default.sh sat ✅ 19.37460 19.37260
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.48625 0.48644
MinkeyRink Solver 2020.3_default sat ✅ 2.02389 6.53004
STP STP_default sat ✅ 6.40427 36.25920
STP ++ Mergsat v1_default sat ✅ 9.17061 9.17167
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.96623 0.96615
Z3 z3-4.8.8_default sat ✅ 126.75700 126.66900
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 4.20448 4.20430
Bitwuzla-wrapped_default sat ✅ 3.01910 3.01906
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 14.27030 14.27060
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.09000 1199.79000
STP STP 2022.4_default sat ✅ 5.30913 5.30869
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.68832 0.68698
Z3++BV z3++bv_0702_default sat ✅ 8.65302 8.65165
Z3 z3-4.8.17_default sat ✅ 23.45600 23.45490
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 4.76915 4.76877
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 29.03250 29.02670
STP STP 2022.4_default sat ✅ 6.91045 6.90919
STP 2022.4_default sat ✅ 6.89930 6.89898
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.12000 1246.94000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 4.53620 4.53611
Z3-Owl z3-Owl-Final_default sat ✅ 204.71200 204.67800
z3-Owl-Final_default sat ✅ 206.00200 205.98600
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla sat ✅ 1.95107 1.83350
Bitwuzla-MachBV-base sat ✅ 10.21497 10.09645
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 10.15879 10.04111
BVDecide bv_decide sat ✅ 17.96594 17.83757
bv_decide-nokernel sat ✅ 17.11135 16.95942
cvc5 cvc5 sat ✅ 9.81058 9.68390
SMTInterpol SMTInterpol unknown ❌ 1201.45818 1226.25052
Yices2 Yices2 sat ✅ 1.01963 0.90164
Z3alpha Z3-alpha sat ✅ 225.27125 884.77849
Z3 Z3-alpha-base sat ✅ 89.33797 89.18865
Z3-Owl-base sat ✅ 347.40988 347.22206
z3siri-base sat ✅ 91.05731 90.91552
Z3-Owl Z3-Owl unknown ❌ 1201.75400 1201.22398