Show HN: Distill – Migrate LLM agents from expensive to cheap models

1 point

4 months ago

I built an agent with Claude Sonnet ($15/MTok). Works great but costs $200/month. Migrating to GPT-4o-mini ($0.15/MTok) manually took 15 hours.

  Distill automates it:
  - Profiles expensive model (gold standard)
  - Iteratively optimizes prompts for cheap model
  - LLM-as-Judge validates quality
  - Returns optimized agent config

  Real example: Sentiment classifier
  - Before: Sonnet, $0.02/run, 95% success
  - After: GPT-4o-mini, $0.002/run, 100% success
  - Migration: 2 iterations, fully automated

  Built with TypeScript, LangChain, LangGraph. MIT license.