I’ve been working on a project called Uminal, which lets anyone extend GPT-3 with new apps & capabilities that auto-compose with each other.
Short demo video: https://www.loom.com/share/211327fd8e854513b909b0f69eadd2f8
Online prototype: https://uminal.com
These “apps” are similar to “Alexa skills” but they’re auto-composable (and a bit different in other ways), and enable GPT-3 to interact w/ the real world.
These apps could be anything (as long as it’s accessible via an API endpoint).
For example, these apps could be other LLMs (e.g., Galactica), apps built w/ LLMs (e.g., using something like LangChain [0] or Dust.tt [1]), or just plain old APIs (such as web search).
Anyone can add new apps to Uminal by telling it how & when it should use the app’s API endpoint, and users can browse & enable apps for their account.
Then, when processing a user’s input prompt, Uminal will automatically call any of the user’s enabled apps as needed, & compose their inputs/outputs together.
It will fallback to GPT-3 whenever needed, as part of processing a prompt.
It currently uses MRKL + GPT-3’s zero-shot reasoning to accomplish this, but I’m working to let users also teach it how to process sample input prompts, which would hopefully improve Uminal’s reasoning ability for everyone, using few-shot examples in a scalable manner. Can’t wait to try this on top of GPT-4!
The project’s vision is to build an “intelligent computer” by letting anyone teach/extend LLMs to interact w/ the real world, similar to how iOS apps really expanded the capabilities of the iPhone.
Would really love to hear any ideas/thoughts/honest feedback, etc.! My Twitter DMs are also open: https://twitter.com/subby_tech
Feel free to join our Discord, if you have any questions/feedback or just wanna chat, etc: https://discord.gg/qczbX5rzD8
Project docs/readme: https://dent-mirror-a40.notion.site/Uminal-1d6b4b8fe22b42b28...
Source code for the sample Uminal apps (web search, etc.): https://github.com/thecooltechguy/uminal-sample-apps
Notes on using the online prototype:
Once you sign in, go to the Apps page and enable "Web search" and "Work Q&A". The “Web search” app uses SerpApi to give GPT-3 internet access, while the "Work Q&A" app integrates with a sample company's Notion database to answer work-related questions (e.g., can I work from home?, etc.).
Due to how SerpAPI works, if any queries involving web searches fail, you can try re-running them and it will usually work.
Again, this is a super rough prototype hacked together in a few days, but would love to hear your honest thoughts/feedback/ideas!
Thanks! :D