In the recently merged PR, ArkFlow supports Python processors, which allows us to call Python scripts directly in ArkFlow. Using the Pyarrow library allows users to write data processing logic more freely. At the same time, relying on Python's powerful AI ecosystem, ArkFlow will also be able to call any Python machine learning/deep learning library (TensorFlow, PyTorch, etc.) and large models.
We will have more detailed articles to introduce relevant use cases in the future.
1 comment
Show HN: Arkflow(stream processing engine) will soon support Python processors | Heykuki News