rare-sapphire•16mo ago
Reference to conversation history
@NiKo | Voiceflow Is there a method in place to mention more than just the last 10 messages between the AI and the user. I'm trying to figure out how to adjust it at certain times so the conversation history can be referenced better. I know you're very busy, but please let me know as soon as possible. Thanks :)
4 Replies
To adjust the conversation history referenced by the AI in Voiceflow, you can manage the memory settings in the AI steps. Here’s how you can do it:
1. Turn Memory On or Off: You can toggle memory on or off via the settings on the Set AI and Response AI steps. This allows you to control whether the AI retains the context of previous interactions.
2. Token Usage: Be mindful of token usage when adjusting memory settings. The Response AI Step with Memory can use between 150 to 2000 tokens, depending on the complexity and length of the conversation history. Without memory, it uses roughly 150 to 300 tokens.
3. Design Considerations: If you require high accuracy and need to reference a larger conversation history, consider using more powerful AI models like GPT-4. However, note that these models consume more tokens, which can quickly deplete your token quota.
4. Adjusting Memory: To better reference conversation history, you can adjust the number of turns the AI remembers. Voiceflow typically saves the last 3 conversation turns, but you can modify this setting based on your needs.
For more detailed information on token calculation and memory settings, you can refer to the following documentation:
- OpenAI Token Documentation
- Anthropic Token Documentation
These adjustments should help you better manage and reference conversation history in your Voiceflow projects.
rare-sapphireOP•16mo ago
@Tico | Voiceflow Assistant I meant the variable {vf_memory}
optimistic-gold•16mo ago
I guess the way for this is to make a new variable and some javascript code that keeps populating that variable more
rare-sapphireOP•16mo ago
Ah
how do I do that.
Wait I know how