Counting tokens in VoiceFlow

breezy · 2024-06-22T01:10:25.720Z

I checked the FAQ and searched Discord, but have not found a way to count the number of tokens used during an API call. It is a variable somewhere because when I run the agent in debug mode the Voiceflow chat box responds with how many tokens were used. Can anyone point me to a resource that explains how to use the token_total variable.

# Let your agents search the web 🔎 Hey everyone! We just released the web search tool for the agent step! Your agents can now automatically search the web for information, letting your agent supplement the LLM's knowledge and the data in its knowledge base with live, up-to-date information. Plus.... * You can restrict searches to specific domains, so your agent only searches sites that you own * This is a tool, so you remain in control of when the agent searches the web * Results are automatically summarized in a way that your agent can automatically understand Under the hood, we're using OpenAI's web search API. Give it a try, and let us know what you think! https://docs.voiceflow.com/changelog/native-web-search-tool

jacklyn · 4mo ago

jacklynbiggin's Thread

jacklyn · 4mo ago

connor_maclean's Thread

hurt-tomato · 4mo ago

Similar Threads