fix: do not spam the log with checksum related INFO messages when downloading using transfer_manager by rafalh · Pull Request #1357 · googleapis/python-storage
bot
added
size: xs
labels
Oct 2, 2024
rafalh
changed the title
Fix checksum related INFO messages spamming the log when downloading …
Fix checksum related INFO messages spamming the log when downloading using transfer_manager
rafalh
changed the title
Fix checksum related INFO messages spamming the log when downloading using transfer_manager
fix: do not spam the log with checksum related INFO messages when downloading using transfer_manager
rafalh
marked this pull request as ready for review
…nloading using transfer_manager `download_chunks_concurrently` function does not allow to set `checksum` field in `download_kwargs`. It also does not set it on its own so it takes the default value of `"md5"` (see `Blob._prep_and_do_download`). Because ranged downloads do not return checksums it results in a lot of INFO messages (tens/hundreds): ``` INFO google.resumable_media._helpers - No MD5 checksum was returned from the service while downloading ... (which happens for composite objects), so client-side content integrity checking is not being performed. ``` To fix it set the `checksum` field to `None` which means no checksum checking for individual chunks. Note that `transfer_manager` has its own checksum checking logic (enabled by `crc32c_checksum` argument)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters