[BEAM-14035] Convert BigQuery SchemaIO to SchemaTransform by damondouglas · Pull Request #17607 · apache/beam
Please check #17181 for more context on the code changes.
This PR, currently work-in-progress, closes BEAM-14035 by creating:
-
BigQuerySchemaTransformReadConfiguration- Configuration for reading from BigQuery. -
BigQuerySchemaTransformReadProvider- an implementation of TypedSchemaTransformProvider -
BigQuerySchemaTransformWriteConfiguration- Configuration for writing to BigQuery. -
BigQuerySchemaTransformWriteProvider- an implementation of TypedSchemaTransformProvider
Note I created https://issues.apache.org/jira/browse/BEAM-14168 to handle additional BigQueryIO read and write parameters for a future PR. Additionally, I created https://issues.apache.org/jira/browse/BEAM-14260 to add additional integration tests in a future PR.
I would like to request to following to review this PR:
@angoenka
Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
- Choose reviewer(s) and mention them in a comment (
R: @username). - Format the pull request title like
[BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replaceBEAM-XXXwith the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue. UpdateCHANGES.mdwith noteworthy changes.If this contribution is large, please file an Apache Individual Contributor License Agreement.
See the Contributor Guide for more tips on how to make review process smoother.
To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md
GitHub Actions Tests Status (on master branch)
See CI.md for more information about GitHub Actions CI.