[Managed Iceberg] Support writing to partitioned tables by ahmedabu98 · Pull Request #32102 · apache/beam

@ahmedabu98

@ahmedabu98

@ahmedabu98 ahmedabu98 changed the title [Managed Iceberg] Support writing partitioned data [Managed Iceberg] Support writing to partitioned tables

Aug 13, 2024

@ahmedabu98

@ahmedabu98

kennknowles

@ahmedabu98

@ahmedabu98

liferoad

kennknowles

@ahmedabu98

reeba212 pushed a commit to reeba212/beam that referenced this pull request

Dec 4, 2024
* support writing partitioned data

* trigger integration tests

* partitioned record writer to manage writers for different partitions

* partitioned record writer

* reject rows when we are saturated with record writers

* refactor record writer manager

* add tests

* add more tests

* make record writer manager transient

* clean up test path

* cleanup

* cleanup

* address comments

* revert readability change

* add to changes md