Doku currently can monitor OpenAI, Mistral, Anthropic, Cohere and Azure OpenAI usage like Performance, Costs, Tokens and user interactions. This is a starting point for us, So let us know what you'd like to see in LLM Monitoring.
Also, We fully understand that you are already using some observability tool, So we did build our connections with these which allow auto-export to your Observability tool. Currently Doku can export to Grafana Cloud, DataDog, New Relic, Dynatrace and SigNoz. Too make you job easier, We have build dashboards that you can easily import into all of these. Checkout -> https://docs.dokulabs.com/latest/connections/intro
Doku is self-hosted and Open-source at heart. we’d love for you to try it out and share what you think. Check it out at https://docs.dokulabs.com/