We just released new data observability tooling for Apache Flink jobs. We designed it to help people develop, troubleshoot, and audit stream processing programs more easily by being able to see data exactly as it existed during each step of your Flink job.

It is a free cloud-based service, that does the following:

-Visualization of data as it flows through each Flink stream processing operation -Record and replay -Event search -State monitoring -Window analysis - including order of processing, lateness, discarded records, state evolution, and window emits

You can use it with your live Flink jobs, or with some sample tutorial data sets created in every new account.

Here’s how to get started: Get a free Datorios account: https://app.datorios.com/signup

Datorios community Slack channel: https://join.slack.com/t/datorioscommunity/shared_invite/zt-...

We're looking forward to your questions, feedback, and feature requests, thanks!