How does it work? Bettershot aims to detect 3 things:

    Was the question relevant to the data (i.e. filter out questions like "how's the weather?" if the chatbot's purpose was to answer questions on the history of jeans)

    Did the model response invent new information when answering the question (i.e. information that was not in the prompt passed in)
    Did the model refuse to answer the question (e.g. "Sorry as an AI language model...")

Check out the repo to know more https://github.com/ClerkieAI/bettershot