VoiceflowVVoiceflow
Powered by
BrakaB
Voiceflow•2w ago•
1 reply
Braka

Quick question

❓AI tokens
Hey guys 👋
Quick Voiceflow question, hope you can help.

We’re still a bit confused about token limits in the AI Agent step.
In almost every agent, we just set 4k tokens, regardless of which LLM we’re using.

Are we overdoing it with that number, or is it actually fine?
What’s the normal / recommended range in practice and does it really matter that much? 😄

Thanks a lot, really appreciate it 🙏
Voiceflow banner
VoiceflowJoin
Voiceflow is your community to get help, stay up to date on product releases, and connect with builders, experts, and the Voiceflow team⚡
13,087Members
Resources
Recent Announcements

Similar Threads

Was this page helpful?
Recent Announcements
jacklyn

# Let your agents search the web 🔎 Hey everyone! We just released the web search tool for the agent step! Your agents can now automatically search the web for information, letting your agent supplement the LLM's knowledge and the data in its knowledge base with live, up-to-date information. Plus.... * You can restrict searches to specific domains, so your agent only searches sites that you own * This is a tool, so you remain in control of when the agent searches the web * Results are automatically summarized in a way that your agent can automatically understand Under the hood, we're using OpenAI's web search API. Give it a try, and let us know what you think! https://docs.voiceflow.com/changelog/native-web-search-tool

jacklyn · 3mo ago

jacklyn

jacklynbiggin's Thread

jacklyn · 3mo ago

hurt-tomato

connor_maclean's Thread

hurt-tomato · 3mo ago

Similar Threads

One question...
improved-purpleIimproved-purple / ❓┃help
2y ago
Subscription cancellation question
slingshotSslingshot / ❓┃help
4mo ago
Question Regarding Credits
DilanDDilan / ❓┃help
5mo ago
Conversation Flow Question
JonsterJJonster / ❓┃help
5mo ago