What's the maximum context size? How do I manage context?

Unlike other AI apps, in Friends & Fables you’re not just chatting with a singular LLM and instead interacting with an AI game engine when you play a campaign.

In a traditional AI chat application, you entirely manage the context through the text you send in a message and a single request is sent to the LLM when you send a message.

In Friends & Fables, when you interact with the game master, the engine usually sends out 10+ requests to various different models and enriches your requests with appropriate game state context such as data about characters, locations, items, etc.

Because of this, from a player perspective context size of a model is not as relevant since the context is multiplied and enriched with appropriate game state data, and also sent to multiple models for processing. The models we use change frequently and have various context window sizes, but generally they’re 128k or larger.

We do our absolute best to provide as much context about the state of your campaign to the AI at the right time. The best way to manage your context is to have concise, rich, and accurate descriptions for things such as characters, locations, memories, and custom instructions.

To learn more about context and how ACE-1 manages it, read What game state can ACE see / update?