add oceanbasecdc connector by whhe · Pull Request #1167 · DTStack/chunjun
Purpose of this pull request
Add OceanBase CDC connector.
Which issue you fix
Close #702.
Note that there are still some work to do:
- Implement
OceanBaseCdcColumnConverter.createInternalConverter. The type of log message is not in one-to-one correspondence with the type of flink, so we can't run the json sync task withoutcolumnandtransformerfor now. - Resolve
protobuf-javaversion conflicts. Theoblogclientused in OceanBase CDC connector depends onprotobuf-java-3.18.2, while other packages depend onprotobuf-java-2.5.0, so we can only test the connector using shell (with stream connector) but not in the local-test module (with all connectors) for now. - Add more tests for all types conversion.
I think these issues can be resolved later, and I would love to contribute for it.
Checklist:
- I have executed the 'mvn spotless:apply' command to format my code.
- I have a meaningful commit message (including the issue id, the template of commit message is '[label-type-#issue-id][fixed-module] a meaningful commit message.')
- I have performed a self-review of my own code.
- I have commented my code, particularly in hard-to-understand areas.
- I have made corresponding changes to the documentation.
- I have added tests that prove my fix is effective or that my feature works.
- New and existing unit tests pass locally with my changes.
- I have checked my code and corrected any misspellings.
- My commit is only one. (If there are multiple commits, you can use 'git squash' to compress multiple commits into one.)