VoiceflowVVoiceflow
Powered by
ltd-scarletL
Voiceflow•2y ago•
6 replies
ltd-scarlet

What’s causing LLM Response Timeout?

Hello. I’m just a newbie here so forgive me if my question is so basic. I’m using my own Assitants API in the first part of my workflow (screenshot 1) but I also made an Intent for “book Appointment” (screenshot 2) but I’m using VF’s LLMs for intent classification.

It was working well earliee but after a few hours, I started receiving LLM Response Timeout and the conversations ended.

1) what could be the cause?
2) is it because I exceeded 2M tokens already?
3) is there a way for me to totally access my own OpenAI API Assistant so that I’ll use my token allowance majority of the time?

Thank you for all your help. This is all new to me.
main_wf.png
book_appt.png
Voiceflow banner
VoiceflowJoin
Voiceflow is your community to get help, stay up to date on product releases, and connect with builders, experts, and the Voiceflow team⚡
13,087Members
Resources
Recent Announcements

Similar Threads

Was this page helpful?
Recent Announcements
jacklyn

# Let your agents search the web 🔎 Hey everyone! We just released the web search tool for the agent step! Your agents can now automatically search the web for information, letting your agent supplement the LLM's knowledge and the data in its knowledge base with live, up-to-date information. Plus.... * You can restrict searches to specific domains, so your agent only searches sites that you own * This is a tool, so you remain in control of when the agent searches the web * Results are automatically summarized in a way that your agent can automatically understand Under the hood, we're using OpenAI's web search API. Give it a try, and let us know what you think! https://docs.voiceflow.com/changelog/native-web-search-tool

jacklyn · 3mo ago

jacklyn

jacklynbiggin's Thread

jacklyn · 3mo ago

hurt-tomato

connor_maclean's Thread

hurt-tomato · 3mo ago

Similar Threads

LLM Intent "listening" on every response
ConnerCConner / ❓┃help
2y ago
Open Source LLM
Leotrim ZumerajLLeotrim Zumeraj / ❓┃help
4mo ago
LLM Streaming Question
MarlonMMarlon / ❓┃help
7mo ago
2min timeout
batlzBbatlz / ❓┃help
4mo ago