Show HN: Auto-optimizing deterministic LLM outputs using knowledge graphs

7 points

2 years ago

Hi, We are building an open-source framework for loading and structuring LLM context to create accurate and explainable LLM answers using knowledge graphs and vector stores.

We built the tool with four main concepts in mind:

1. Loader -> uses dlt in the backend to load and structure the data

2. Cognify step -> creates a graph with summaries, labels and factoids that are interconnected across the documents and stored as a representation in the vector store

3. Optimizer -> Uses DSPy to optimize LLM queries, and we plan to extend it to most of the knobs we can turn, like chunking etc.

4. Search -> allows for searching using search types supported in graph stores (ex. Neo4j) or hybrid, BM25, or other search types available in vector stores.

We are quite early with the product but we would love to hear feedback on what we can improve.