[BEAM-14035] Convert BigQuery SchemaIO to SchemaTransform by damondouglas · Pull Request #17607 · apache/beam

Please check #17181 for more context on the code changes.

This PR, currently work-in-progress, closes BEAM-14035 by creating:

  • BigQuerySchemaTransformReadConfiguration - Configuration for reading from BigQuery.
  • BigQuerySchemaTransformReadProvider - an implementation of TypedSchemaTransformProvider
  • BigQuerySchemaTransformWriteConfiguration - Configuration for writing to BigQuery.
  • BigQuerySchemaTransformWriteProvider - an implementation of TypedSchemaTransformProvider

Note I created https://issues.apache.org/jira/browse/BEAM-14168 to handle additional BigQueryIO read and write parameters for a future PR. Additionally, I created https://issues.apache.org/jira/browse/BEAM-14260 to add additional integration tests in a future PR.

I would like to request to following to review this PR:
@angoenka


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Choose reviewer(s) and mention them in a comment (R: @username).
  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests

See CI.md for more information about GitHub Actions CI.