I'm building a simulated fantasy town backed by an LLM. Visitors to the website can vote on what the hero does next, and everyone in the town will react naturally to all of the heroes actions.

Unlike previous efforts in this space, the technique I am using consumes very little context, and I'm hoping to get it running on consumer GPUs.