Show HN: Open-Source LLM Observability and Export to Grafana, Datadog etc.

3 points

2 years ago

Hi Everyone! This is the maintainer of Doku, an open-source LLM Observability tool that you can self-host and run easily (its 3 simple components)

Doku currently can monitor OpenAI, Mistral, Anthropic, Cohere and Azure OpenAI usage like Performance, Costs, Tokens and user interactions. This is a starting point for us, So let us know what you'd like to see in LLM Monitoring.

Also, We fully understand that you are already using some observability tool, So we did build our connections with these which allow auto-export to your Observability tool. Currently Doku can export to Grafana Cloud, DataDog, New Relic, Dynatrace and SigNoz. Too make you job easier, We have build dashboards that you can easily import into all of these. Checkout -> https://docs.dokulabs.com/latest/connections/intro

Doku is self-hosted and Open-source at heart. we’d love for you to try it out and share what you think. Check it out at https://docs.dokulabs.com/

2 comments