Voiceflow PartnersVPVoiceflow Partners
Powered by
ConnerC
Voiceflow Partners•2y ago•
1 reply
Conner

LLM Intent "listening" on every response

I'm testing out the new LLM intents, and it seems to be working great from an "intent trigger" standpoint.

But I noticed as I continued through the conversation, every single step of the assistant picks up the NLU + LLM Combination.

Text block, Response AI block, capture, doesn't matter. Every single step of the conversation is charging me with a token hit of 384.

Is this working as intended, or am I missing something?

387 multiplied by every route in the conversation is kind of insane, especially when I only need to access the Intents in a choice step.
image.png
image.png
Voiceflow Partners banner
Voiceflow PartnersJoin
Exclusive community for Voiceflow Solutions Providers & Content Creators.
13,076Members
Resources
Recent Announcements

Similar Threads

Was this page helpful?
Recent Announcements
jacklyn

# Let your agents search the web 🔎 Hey everyone! We just released the web search tool for the agent step! Your agents can now automatically search the web for information, letting your agent supplement the LLM's knowledge and the data in its knowledge base with live, up-to-date information. Plus.... * You can restrict searches to specific domains, so your agent only searches sites that you own * This is a tool, so you remain in control of when the agent searches the web * Results are automatically summarized in a way that your agent can automatically understand Under the hood, we're using OpenAI's web search API. Give it a try, and let us know what you think! https://docs.voiceflow.com/changelog/native-web-search-tool

jacklyn · 4mo ago

jacklyn

jacklynbiggin's Thread

jacklyn · 4mo ago

hurt-tomato

connor_maclean's Thread

hurt-tomato · 4mo ago

Similar Threads

New LLM Intent Matching - NO MATCH ?
MikeMMike / ❓┃ask-a-question
2y ago
Always on Intent
progressive-amaranthPprogressive-amaranth / ❓┃ask-a-question
2y ago
What’s causing LLM Response Timeout?
ltd-scarletLltd-scarlet / ❓┃ask-a-question
2y ago
LLM recognized the Intent but didn't triggered the flow
abstract-purpleAabstract-purple / ❓┃ask-a-question
2y ago