We've just released the latest version of our product, which makes it easier for teams to build data pipelines for LLM-based applications. As part of the release, we're also open-sourcing the toolbox for Spark (https://github.com/prophecy-io/spark-ai) that contains useful connectors, transformations, and agents for building Gen-AI applications.

Hopefully, this allows some of you to build your apps easier and make them more robust and scalable from day one. Quick getting started example available here: https://github.com/prophecy-samples/gen-ai-chatbot-template (all code is open-source too).

While our product is already mature, the toolbox shared above is still in a pretty early stage but will be completely OSS. Any thoughts on the concept and ideas for what's important to the community would be super appreciated!