Ask HN: Have you ever needed additional context for LLM?

1 point

3 years ago

I asked ChatGPT-3.5 to write a Python code that will list the top 10 stories from Hacker News. In the response, I got code that used the BeautifulSoup4 package to scrape the Hacker News website. The code wasn't working.

I want to use the HN REST API in the generated code (https://github.com/HackerNews/API). That's why I sent a piece of documentation of HN REST API in the prompt and asked once again for the Python code. The returned code was working fine and was easier to understand (less lines than scraping with BeautifulSoup4).

I started to search the web and it looks like I have used a technique called in-context learning. I provided examples and ChatGPT learned about them on the fly, without updating the weights.

I'm thinking about writing a service for storing ChatGPT contexts. In the service, You will store predefined texts with examples (context) that can be sent to ChatGPT to get better responses. Have you ever needed such a service?

I'm aware that there is an option to provide Custom Instruction for ChatGPT. I'm thinking about something larger, some hierarchical structure of examples - that will be easy to search for LLM. I would be very grateful for any feedback!

1 comment