I recently got into MeshCore, a decentralized LoRa based messaging system with a pretty solid network in the Bay Area, and decided I wanted to try and shoehorn Pokémon into it. PokeMesh is basically "Twitch Plays Pokémon" but over a mesh network. MeshCore only allows for message lengths around ~130 characters and no images, so this projects main focus is turning a live game of Pokémon FireRed into a text based adventure. I use a local VLM running off of an old laptop for the summaries, but the important bit is the preprocessor which makes the screenshots more "digestible" for the otherwise highly inaccurate local model. The preprocessor replaces certain important tiles like doors/grass/items with easier to parse templates which helps the VLM more accurately identify things. I'm sure a fine tuned model would also make things more accurate, but overall it was a fun mini-project and it will be interesting to see if anyone even makes it to getting a starter.
Show HN: MeshCore Plays Pokémon: Collaborative Pokémon, no internet required | Heykuki News