Heykuki News
Top
New
Best
Ask
Show
Jobs
Toggle theme
Login
Top
New
Best
Ask
Show
Jobs
Show HN: I built an open source AI gateway that proxy calls to multiple LLMs
github.com/wx-yz
2 points
chintana
a year ago
Clients can talk via HTTP or gRPC. Comes with rate limiting, failover, caching, guardrails, logging and an admin API for configuration
Love to get feedback if this is interesting to you
2 comments
Loading...
Show HN: I built an open source AI gateway that proxy calls to multiple LLMs | Heykuki News