Managing your context cache on WyvernChat is crucial for an immersive AI roleplay experience. Your AI character has limited memory, and you must ensure the roleplay continues smoothly without the AI forgetting important details about your story.
You need to manage and optimize your context cache even when using more advanced LLMs through an API provider or a proxy service. And WyvernChat enables you to do this with Chat Summary.
What Is Chat Summary On WyvernChat?
Chat Summary on WyvernChat is a feature that helps you manage your context cache by allowing you to generate or manually enter a summary of your chat. The system then structures content within Chat Summary as permanent tokens and includes it with every message you send to the LLM.
This feature enables your AI character to remember important details even after the relevant chat messages are no longer in the context window.
Also Read: Context Rot: Large Context Size Negatively Impacts AI Roleplay
For example, after 25 to 30 messages, the initial messages you exchanged with your AI character might no longer be within the context window. Your AI character then forgets how they met you and what happened during the early stages of your roleplay.
However, by using Chat Summary on WyvernChat and saving important details from the initial messages, your AI character will always remember those details.
Why Not Use OOC Commands?
Many users use an OOC (out of character) command to ask the AI to summarize their chat and then continue their roleplay. This helps important details from the roleplay stay within the context window, but it is not an effective way to manage your context cache.
Frontends like WyvernChat structure data like character definition, persona, scenario, chat messages, and custom prompts into a single prompt before sending it to the LLM. This prompt, along with any other system instructions, is a part of your context cache.
LLMs don’t treat all content in the context cache equally. They focus more on your latest message, which the frontend structures as the most recent entry in the context window, and on permanent tokens, which the frontend structures as the first entry in the context window.
You can use an OOC command to ask the AI to summarize your chat and then save the summary to your Chat Summary on WyvernChat. However, don’t let it stay just as a part of your chat, because over time, the AI won’t pay much attention to that specific message.
How To Use Chat Summary On WyvernChat
Click the cog icon at the top right corner of the screen, then select the Chat Log & Summaries tab. Scroll down and expand the Chat Summary options, then enable it.
WyvernChat shows your token usage breakdown and your leftover tokens. This information helps you decide when to generate or write a summary to optimize your context cache.
You can click the Generate New button to generate a summary or the Create Manually button to enter a summary manually. WyvernChat’s default prompt for generating a summary works well in most cases, but you can also customize the prompt before generating one.
WyvernChat shows you the range of messages included in the summary and maintains multiple versions of your Chat Summary. You can choose which summary to use by setting it as the Active summary.
Once you have generated your first summary, make sure to click on the Save Settings button to start using Chat Summary on WyvernChat.
Download Chat And Have An AI Assistant Summarize It
If the model you are using on WyvernChat can’t generate a good summary or summarize all your messages, you can use a free AI assistant like DeepSeek to summarize your roleplay.
Click the chevron-down menu icon at the top left corner of the screen, then select the Chat Logs option.
Click on the three vertical dots icon and select the Export TXT option to download your chat as a text file.
You can then upload this text file and ask DeepSeek, Gemini, or ChatGPT to create a summary of your ongoing roleplay. If your chat contains NSFW content, Gemini and ChatGPT may refuse to generate a summary.
Keep It Concise
The system treats Chat Summary as permanent tokens. Having a long summary with irrelevant or unimportant information is bad for context cache management. Keep your summaries concise and include only the essential details needed to maintain your story’s continuity.
Additionally, some LLMs, like DeepSeek, are great at creating summaries. But other smaller models aren’t as good. You may need to double-check the AI-generated summary and edit it as needed.
Maintain An Immersive Experience
Chat Summary is a feature on WyvernChat that helps you manage your context cache. It lets you generate or write summaries, ensuring that important information stays within the context window. The LLM can then use this information to give you an impressive AI roleplay experience.
Using Chat Summary is a more effective way to manage your context cache than generating a summary and leaving it as a message in your roleplay. Remember to keep Chat Summary concise and only include information necessary for the continuity of your story.
Using Chat Summary on WyvernChat allows for long, immersive roleplays where your AI character always remembers important details about your story.
