A WebAssembly-based, cloud-native ETL application framework for Cloud DATABASE

1 point

4 years ago

This project is a cloud-native ETL (Extract, Transform, Load) application framework based on the WasmEdge WebAssembly runtime for developers to filter, map, and transform data pipelines going into cloud databases. We are currently targetting the TiDB Cloud as the backend database.

This is a lightweight wasm solution that is secure, fast and cross-platform. My team of 2 engineers wrote it in Rust in 2 days.

Blockchain is one of the use cases that allows developers to upload their own ETL function programs to make trading bots, with serverless deployment, without needing to manually connect to the data source and database.

Now the framework only support Rust. JavaScript is on the way.

The possibilities are infinite!

Demo: https://www.youtube.com/watch?v=sQCRQeTnBgo Github repo: https://github.com/second-state/MEGA Please shoot me with more use cases or suggestions!