GitHub - vmware/versatile-data-kit: One framework to develop, deploy and operate data workflows with Python and SQL.

GitHub - vmware/versatile-data-kit: One framework to develop, deploy and operate data workflows with Python and SQL.

One framework to🧑‍💻 Develop ▶️ Deploy and 📊 Operate
data workflows with Python and SQL

🎯 Write shorter, more readable code.

🔄 Ready-to-use data ETL/ELT patterns.

🧩 Lego-like extensibility.

🚀 Single click deployment.

🛠 Operate and monitor. ️

Introduction to the VDK SDK

Framework to simplify data ingestion and data processing.
Write any code using Python or SQL.
A toolset enabling you to run data jobs.

Get started with VDK SDK:

➡ Install Quickstart VDK. Only requirement is Python 3.7+.

pip install quickstart-vdk
vdk --help

➡ Develop your First Data Job if you are impatient to start quickly.

VDK.SDK.2.mp4

Data Ingestion

Data Transformation

Data Job Deployment (build, deploy, release)

Operations and Monitoring

Lego like extensibility

Support and Contributing

For Support, you can join our Slack channel, create an issue or pull request on GitHub to submit suggestions or changes.
If you are interested in contributing as a developer, visit the contributing page.

Contacts

Message us on Slack:
☝️ Join the CNCF Slack workspace.
✌️ Join the #versatile-data-kit channel.
Join the next Community Meeting
Follow us on Twitter.
Subscribe to the Versatile Data Kit YouTube Channel.
Join our development mailing list, used by developers and maintainers of VDK.

Code of Conduct

Everyone involved in working on the project's source code, or engaging in any issue trackers, Slack channels, and mailing lists is expected to be familiar with and follow the Code of Conduct.