wise-white•16mo ago
Can´t change max. token setting in knowledge base
Hi,
my tokens are always reset to 128 max. tokens in knowledge base settings, no matter what I change the token setting to.
Why is this the case and how can it be changed?
1 Reply
If your max token setting in the Knowledge Base is always resetting to 128 tokens, it could be due to a few reasons:
1. Default Settings: The Knowledge Base might have a default maximum token limit set to 128 tokens. This could be a safeguard to ensure that responses are concise and do not consume excessive tokens.
2. Permissions: Ensure that you have the necessary permissions to change the settings. Only users with appropriate permissions can modify these settings.
3. Saving Changes: After adjusting the token settings, make sure to save the changes properly. Sometimes, changes might not be saved if the save button is not clicked or if there is a connectivity issue.
4. System Overrides: There might be system-level overrides that reset the token limit to a default value. This could be part of the platform's design to maintain optimal performance.
To address this issue, you can try the following steps:
- Double-check that you have the necessary permissions to make changes in the Knowledge Base settings.
- Ensure that you are saving the changes correctly after adjusting the token limit.
- If the issue persists, it might be helpful to review any documentation or guidelines provided by Voiceflow regarding token limits and settings.
For more detailed information on how tokens are calculated and managed, you can refer to the following documentation:
- OpenAI Token Documentation
- Anthropic Token Documentation
These resources provide insights into how tokens are calculated and managed, which might help you understand the constraints and settings better.