The Bag Partition is now configurable. by alxmrs · Pull Request #33805

The Bag Partition is now configurable. by alxmrs · Pull Request #33805 · apache/beam

Configuring the number of partitions in the Dask runner is very important to tune performance. This CL gives users control over this parameter.

tomstepp pushed a commit to tomstepp/apache-beam that referenced this pull request

Feb 3, 2025

* The Bag Partition is now configurable.

Configuring the number of partitions in the Dask runner is very important to tune performance. This CL gives users control over this parameter.

* Apply formatter.

* Passing lint via the `run_pylint.sh` script.

* Implementing review feedback.

* Attempting to pass lint/fmt check.

* Fixing isort issues by reading CI output.

* More indentation.

* rm blank like for isort.

VardhanThigle pushed a commit to VardhanThigle/beam that referenced this pull request

Mar 21, 2025

* The Bag Partition is now configurable.

Configuring the number of partitions in the Dask runner is very important to tune performance. This CL gives users control over this parameter.

* Apply formatter.

* Passing lint via the `run_pylint.sh` script.

* Implementing review feedback.

* Attempting to pass lint/fmt check.

* Fixing isort issues by reading CI output.

* More indentation.

* rm blank like for isort.