v3.0.0

Compare Source

⚠ BREAKING CHANGES

Please consult the README for details on this major version release.

• The default checksum strategy for uploads has changed from None to "auto" (#​1383)
• The default checksum strategy for downloads has changed from "md5" to "auto" (#​1383)
• Deprecated positional argument "num_retries" has been removed (#​1377)
• Deprecated argument "text_mode" has been removed (#​1379)
• Blob.download_to_filename() now deletes the empty destination file on a 404 (#​1394)
• Media operations now use the same retry backoff, timeout and custom predicate system as non-media operations, which may slightly impact default retry behavior (#​1385)
• Retries are now enabled by default for uploads, blob deletes and blob metadata updates (#​1400)

Features

• Add "auto" checksum option and make default (#​1383) (5375fa0)
• Blob.download_to_filename() deletes the empty destination file on a 404 (#​1394) (066be2d)
• Enable custom predicates for media operations (#​1385) (f3517bf)
• Integrate google-resumable-media (#​1283) (bd917b4)
• Retry by default for uploads, blob deletes, metadata updates (#​1400) (0426005)

Bug Fixes

• Cancel upload when BlobWriter exits with exception (#​1243) (df107d2)
• Changed name of methods Blob.from_string() and Bucket.from_string() to from_uri() (#​1335) (58c1d03)
• Correctly calculate starting offset for retries of ranged reads (#​1376) (7b6c9a0)
• Filter download_kwargs in BlobReader (#​1411) (0c21210)
• Remove deprecated num_retries argument (#​1377) (58b5040)
• Remove deprecated text_mode argument (#​1379) (4d20a8e)

Documentation

• Correct formatting and update README.rst (#​1427) (2945853)
• Fix issue with exceptions.py documentation (#​1328) (22b8c30)

v2.19.0

Compare Source

Features

• Add integration test for universe domain (#​1346) (02a972d)
• Add restore_bucket and handling for soft-deleted buckets (#​1365) (ab94efd)
• Add support for restore token (#​1369) (06ed15b)
• IAM signBlob retry and universe domain support (#​1380) (abc8061)

Bug Fixes

• Allow signed post policy v4 with service account and token (#​1356) (8ec02c0)
• Do not spam the log with checksum related INFO messages when downloading using transfer_manager (#​1357) (42392ef)

v2.18.2

Compare Source

Bug Fixes

• Add regression test for range read retry issue and bump dependency to fix (#​1338) (0323647)

v2.18.1

Compare Source

Bug Fixes

• Properly escape URL construction for XML MPU API (#​1333) (bf4d0e0)

v2.18.0

Compare Source

Features

• Add OpenTelemetry Tracing support as a preview feature (#​1288) (c2ab0e0)

Bug Fixes

• Allow Protobuf 5.x (#​1317) (152b249)
• Correct notification error message (#​1290) (1cb977d), closes #​1289

v2.17.0

Compare Source

Features

• Support HNS enablement in bucket metadata (#​1278) (add3c01)
• Support page_size in bucket.list_blobs (#​1275) (c52e882)

Bug Fixes

• Remove deprecated methods in samples and tests (#​1274) (4db96c9)

Documentation

• Reference Storage Control in readme (#​1254) (3d6d369)
• Update DEFAULT_RETRY_IF_GENERATION_SPECIFIED docstrings (#​1234) (bdd426a)

v2.16.0

Compare Source

Features

• Add support for soft delete (#​1229) (3928aa0)
• Support includeFoldersAsPrefixes (#​1223) (7bb8065)

v2.15.0

Compare Source

Features

• Support custom universe domains/TPC (#​1212) (f4cf041)

Bug Fixes

• Add "updated" as property for Bucket (#​1220) (ae9a53b)
• Remove utcnow usage (#​1215) (8d8a53a)

v2.14.0

Compare Source

Features

• Add support for Python 3.12 (#​1187) (ecf4150)
• Support object retention lock (#​1188) (a179337)

Bug Fixes

• Clarify error message and docstrings in Blob class method (#​1196) (92c20d3)
• Propagate timeout in BlobWriter (#​1186) (22f36da), closes #​1184
• Use native namespace to avoid pkg_resources warnings (#​1176) (2ed915e)

v2.13.0

Compare Source

Features

• Add Autoclass v2.1 support (#​1117) (d38adb6)
• Add support for custom headers (#​1121) (2f92c3a)

Bug Fixes

• Blob.from_string parse storage uri with regex (#​1170) (0a243fa)
• Bucket.delete(force=True) now works with version-enabled buckets (#​1172) (0de09d3)
• Fix typo in Bucket.clear_lifecycle_rules() (#​1169) (eae9ebe)

Documentation

• Fix exception field in tm reference docs (#​1164) (eac91cb)

v2.12.0

Compare Source

Features

• Add additional_blob_attributes to upload_many_from_filenames (#​1162) (c7229f2)
• Add crc32c_checksum argument to download_chunks_concurrently (#​1138) (fc92ad1)
• Add skip_if_exists to download_many (#​1161) (c5a983d)
• Launch transfer manager to GA (#​1159) (5c90563)

Bug Fixes

• Bump python-auth version to fix issue and remove workaround (#​1158) (28c02dd)
• Mark _deprecate_threads_param as a wrapper to unblock introspection and docs (#​1122) (69bd4a9)

Documentation

• Add snippets for upload_chunks_concurrently and add chunk_size (#​1135) (3a0f551)
• Update formatting and wording in transfer_manager docstrings (#​1163) (9e460d8)

v2.11.0

Compare Source

Features

• Add gccl-gcs-cmd field to X-Goog-API-Client header for Transfer Manager calls (#​1119) (14a1909)
• Add transfer_manager.upload_chunks_concurrently using the XML MPU API (#​1115) (56aeb87)
• Support configurable retries in upload_chunks_concurrently (#​1120) (1271686)

Bug Fixes

• Split retention period tests due to caching change (#​1068) (cc191b0)

Documentation

• Add Transfer Manager documentation in c.g.c (#​1109) (c1f8724)

v2.10.0

Compare Source

Features

• Add matchGlob parameter to list_blobs (#​1055) (d02098e)
• Allow exceptions to be included in batch responses (#​1043) (94a35ba)

Bug Fixes

• Extend wait for bucket metadata consistency in system tests (#​1053) (d78586c)

Documentation

• Add clarification to batch module (#​1045) (11f6024)

v2.9.0

Compare Source

Features

• Un-deprecate blob.download_to_file(), bucket.create(), and bucket.list_blobs() (#​1013) (aa4f282)

Bug Fixes

• Avoid pickling processed credentials (#​1016) (7935824)
• Improve test error message for missing credentials (#​1024) (892481a)

Documentation

• Add sample and sample test for transfer manager (#​1027) (4698799)
• Remove threads in transfer manager samples (#​1029) (30c5146)

v2.8.0

Compare Source

Features

• Add multiprocessing and chunked downloading to transfer manager (#​1002) (e65316b)

Bug Fixes

• Add trove classifier for python 3.11 (#​971) (7886376)
• Remove use of deprecated cgi module (#​1006) (3071832)

Documentation

• Add clarifications to read timeout (#​873) (8fb26f4)
• Fix c.g.c structure (#​982) (d5a2931)
• Update c.g.c docs and guides (#​994) (62b4a50)

v2.7.0

Compare Source

Features

• Add "transfer_manager" module for concurrent uploads and downloads, as a preview feature (#​943) (9998a5e)
• Add use_auth_w_custom_endpoint support (#​941) (5291c08)

Bug Fixes

• Implement closed property on fileio.py classes (#​907) (64406ca)

v2.6.0

Compare Source

Features

• Add Autoclass support and samples (#​791) (9ccdc5f), closes #​797
• Add predefined_acl to create_resumable_upload_session (#​878) (2b3e8f9)
• Enable delete_blobs() to preserve generation (#​840) (8fd4c37), closes #​814
• Make tests run against environments other than prod (#​883) (7dfeb62)

Bug Fixes

• Align bucket bound hostname url builder consistency (#​875) (8a24add)
• BlobWriter.close() will do nothing if already closed (#​887) (7707220)
• Remove client side validations (#​868) (928ebbc)

Documentation

• Update comments in list_blobs sample (#​866) (9469f5d)
• Clarify prefixes entity in list_blobs usage (#​837) (7101f47)
• Streamline docs for migration (#​876) (7c8a178)
• Update docstring for lifecycle_rules to match generator behavior (#​841) (36fb81b)

v2.5.0

Compare Source

Features

• Custom Placement Config Dual Region Support (#​819) (febece7)

Documentation

• open file-like objects in byte mode for uploads (#​824) (4bd3d1d)

v2.4.0

Compare Source

Features

• add AbortIncompleteMultipartUpload lifecycle rule (#​765) (b2e5150)
• support OLM Prefix/Suffix (#​773) (187cf50)

Bug Fixes

• fix rewrite object in CMEK enabled bucket (#​807) (9b3cbf3)

Documentation

• fix changelog header to consistent size (#​802) (4dd0907)
• samples: Update the Recovery Point Objective (RPO) sample output (#​725) (b0bf411)
• Update generation_metageneration.rst with a missing space (#​798) (1e7cdb6)
• update retry docs (#​808) (c365d5b)

v2.3.0

Compare Source

Features

• add dual region bucket support and sample (#​748) (752e8ab)
• track invocation id for retry metrics (#​741) (bd56931)

Bug Fixes

• deps: drop pkg_resources (#​744) (e963f33)

Documentation

• fix links in blob module (#​759) (9b29314)

v2.2.1

Compare Source

Bug Fixes

• remove py.typed marker file for PEP 561 (#​735) (f77d2f7), closes #​734

v2.2.0

Compare Source

Features

• allow no project in client methods using storage emulator (#​703) (bcde0ec)

Bug Fixes

• add user agent in python-storage when calling resumable media (c7bf615)
• deps: require google-api-core>=1.31.5, >=2.3.2 (#​722) (e9aab38)
• Fix BlobReader handling of interleaved reads and seeks (#​721) (5d1cfd2)
• retry client side requests timeout (#​727) (e0b3b35)

Documentation

• fixed download_blob_to_file example (#​704) (2c94d98)

v2.1.0

Compare Source

Features

• add turbo replication support and samples (#​622) (4dafc81)
• avoid authentication with storage emulator (#​679) (8789afa)
• remove python 3.6 support (#​689) (8aa4130)

v2.0.0

Compare Source

⚠ BREAKING CHANGES

• Remove Python 2 support (#​657)

Features

• Remove Python 2 support (#​657) (b611670)

v1.44.0

Compare Source

Features

• add raw_download kwarg to BlobReader (#​668) (10cdad6)

Documentation

• Describe code sample more specifically (#​660) (0459cb4)
• refresh readme instructions (#​667) (ceb9314)
• This is just a simple PR to better describe what the code is doing in the comments. (0459cb4)
• use writeable streamin example for 'download_blob_to_file' (#​676) (96092d4)

v1.43.0

Compare Source

Features

• add ignore_flush parameter to BlobWriter (#​644) (af9c9dc)
• add support for Python 3.10 (#​615) (f81a2d0)

Bug Fixes

• raise a ValueError in BucketNotification.create() if a topic name is not set (#​617) (9dd78df)

Documentation

• add contributing and authoring guides under samples/ (#​633) (420591a)
• add links to samples and how to guides (#​641) (49f78b0)
• add README to samples subdirectory (#​639) (58af882)
• update samples readme with cli args (#​651) (75dda81)

v1.42.3

Compare Source

Bug Fixes

• changeover unspecified to inherited (#​603) (283a419)
• check response code in batch.finish (#​609) (318a286)
• skip tests that use unspecified pap until we get the change in (#​600) (38b9b55)

v1.42.2

Compare Source

Bug Fixes

• add preconditions and retry config support to ACL patch operationss (#​586) (4333caf)
• add unpinned protobuf for python3 (#​592) (53f7ad0)
• pin six as a required dependency (#​589) (9ca97bf)

v1.42.1

Compare Source

Bug Fixes

• do not append duplicates to user agent string (#​570) (57cf3a1)

Documentation

• pass explicit 'client' in '{Blob.Bucket}.from_string' examples (#​545) (6eff22d)

v1.42.0

Compare Source

Features

• add 'page_size' parameter to 'Bucket.list_blobs, list_buckets (#​520) (c5f4ad8)

Bug Fixes

• deps: add explicit ranges for 'google-api-core' and 'google-auth' (#​530) (310f207)
• downloading no longer marks metadata fields as 'changed' (#​523) (160d1ec)
• make 'requests.exceptions.ChunkedEncodingError retryable by default (#​526) (4abb403)

Documentation

• update supported / removed Python versions in README (#​519) (1f1b138)

v1.41.1

Compare Source

Bug Fixes

• deps: pin {api,cloud}-core, auth to allow 2.x versions on Python 3 (#​512) (4d7500e)
• remove trailing commas from error message constants (#​505) (d4a86ce), closes #​501

Documentation

• replace usage of deprecated function download_as_string in docs (#​508) (8dfa4d4)

v1.41.0

Compare Source

Features

• add support for Etag headers on reads (#​489) (741d3fd)

Bug Fixes

• deps: update minimum dependency versions to pick up bugfixes (#​496) (92251a5), closes #​494
• populate etag / generation / metageneration properties during download (#​488) (49ba14c)
• revise and rename is_etag_in_json(data) (#​483) (0a52546)

v1.40.0

Compare Source

Features

• add preconditions and retry configuration to blob.create_resumable_upload_session (#​484) (0ae35ee)
• add public access prevention to bucket IAM configuration (#​304) (e3e57a9)

Bug Fixes

• replace default retry for upload operations (#​480) (c027ccf)

v1.39.0

Compare Source

Features

• media operation retries can be configured using the same interface as with non-media operation (#​447) (0dbbb8a)

Bug Fixes

• add ConnectionError to default retry (#​445) (8344253)
• apply idempotency policies for ACLs (#​458) (2232f38)
• replace python lifecycle action parsing ValueError with warning (#​437) (2532d50)
• revise blob.compose query parameters if_generation_match (#​454) (70d19e7)

Documentation

• streamline 'timeout' / 'retry' docs in docstrings (#​461) (78b2eba)
• streamline docstrings for conditional parmas (#​464) (6999370)

v1.38.0

Compare Source

Features

• add getters and setters for encryption_key and kms_key_name (#​409) (2adfb59)

Bug Fixes

• retry auth.TransportError errors (#​418) (23a8db8)

Documentation

• revise docstrings for generate_signed_url (#​408) (f090548)

v1.37.1

Compare Source

Bug Fixes

• Ensure consistency check in test runs even if expected error occurs (#​402) (416bcd4)
• silence expected errors for routine operations on BlobReader (#​400) (d52853b)

v1.37.0

Compare Source

Features

• add blob.open() for file-like I/O (#​385) (440a0a4), closes #​29

Bug Fixes

• update user_project usage and documentation in bucket/client class methods (#​396) (1a2734b)