genetic-orange•2y ago
500 Token limit for response?
I've been trying Voiceflow and was really happy, so I just made the first payment for the pro plan only to realize that I cannot get long LLM answers because of the 500 token limit.
I need to go up to 4000 tokens with Claude 3 Opus. Is there a workaround e. g. with via Relevance Al?
Otherwise, this won't work for me.
3 Replies
To address your concern about the 500 token limit and your need for up to 4000 tokens with Claude 3 Opus, it's important to understand how tokens work within Voiceflow and the options available to you:
- Tokens are used as a form of currency for interactions with AI models in Voiceflow. The Pro Plan, which you're on, provides 2,000,000 tokens monthly.
- The token consumption depends on the AI model used and the complexity of the interactions. Advanced models like GPT-4 consume more tokens than earlier versions such as GPT-3.5.
- If you require more tokens than your current plan provides, you have the option to purchase additional tokens at a rate of $5 per 1 million tokens. These tokens are added to your monthly quota and do not expire.
- For handling larger responses like the ones you're looking for with Claude 3 Opus, consider optimizing your use of tokens by adjusting the complexity of interactions or exploring the possibility of integrating custom Large Language Models (LLMs) through the API step, which might offer more flexibility in terms of token usage.
For more detailed guidance on token usage and calculations, you might find these resources helpful:
- Open AI Token Documentation
- Anthropic Token Documentation
genetic-orangeOP•17mo ago
Unfortunately this is a useless answer.
I am willing to connect to an external service like Relevance AI or MAKE.com
Thanks for nothing, I canecelled my plan.
deep-jade•17mo ago
You can change the slider under Prompt Settings
