AgentServe is a framework to make hosting scalable AI agents as easy as possible. With 4 lines of code AS wraps your agent (any framework) in a FastAPI and connects it to a Task Queue (celery or redis).

Why Should You Care?

Standardized Communication Pattern: AgentServe proposes that all agents should communicate with each other and the outside world with “Tasks” that can be submitted in a sync or async way. This simple API wil enable

Framework Agnostic: No favorites. OpenAI, LangChain, LlamaIndex, CrewAI are all welcome. AS provides an entry point for the outside world to engage with your agent.

Task Queuing: For when your agents need a little help managing their to-do list. For scale or Asyncronous background agents, AgentServe connects with Redis or Celery Queues.

Batteries Included: AgentServe aims to remove a lot of the boiler plate of writing an API, managing validation, errros ect. Next on the roadmap is introducing a miiddleware pattern to add auth, observability or anything else you can think of.

Why Are We Here?

I want your feedback, your ideas, and maybe even your code contributions. This is an open invitation to our Discord server and give honest burtal feedback.

Join Us!

[Discord](https://discord.gg/JkPrCnExSf)

[GitHub](https://github.com/PropsAI/agentserve) Fork it, star it, or just stare at it. We won't judge.

What's Next?

We're working on streaming responses, detail hosting instructions for each cloud. And eventually created a one click hosting option and managed queue with an AgentServe Cloud (but lets not get ahead of outselves)

Thank you for reading, please check it out and let me know if this is useful.

Cheers,

Peter Kirkham