Show HN: Standardising 'Unit Tests' for Prompts

3 points

a year ago

PromptRepository is an open-source framework (Typescript) that illustrates an approach to creating more reliable LLM-based applications through systematic prompt validation, and testing.

Key features:

- Simple JSON schema for externalized prompts with versioning and parameter validation

- Lightweight approach inspired by Anthropic's guidance to "keep it simple" with LLM applications

- 'Unit tests for Prompts' inspired by Chris Benson/Practical AI's recommendations from episode 295.

- Bundled prompts to generate unit tests and evaluations for new prompts built with the framework.

The framework demonstrates a novel approach: bundle tested prompts with a framework that generate code to use the framework.

Repo: https://github.com/jonverrier/PromptRespository

Take a look.