KB-Only Responses – How Can I Exclude LLM Answers?
Hey guys,
I’m using Google Sheets as my KB via public links (since direct file uploads aren’t supported).
Organized across ~160 rows with key fields like question, answer, source, tags, and last updated
The main user interaction happens through an Agent Step.
Both the Instruction Prompt and the System Prompt in the KB settings clearly state that responses must be based solely on KB content, with no freely generated LLM answers allowed.
➡️ The goal is to completely prevent the use of general LLM knowledge, all responses should be based exclusively on the KB.
I’m not a developer, and my solution is probably quite basic compared to what many of you are doing.
There seem to be countless ways to handle this and since Voiceflow is constantly evolving and improving, it’s hard to keep track of what the current best practice is.
Can this behavior be reliably enforced through prompt design alone, or are you building additional flows for this?
Is this video (https://www.youtube.com/watch?v=k8EnIVd_r4k) still up to date?
2 Replies
The agent step is currently designed to try and answer the question first and if it can't then it will use KB. You can use the agent step to classify the intent of the user and then follow the corresponding path afterwards without any llm interaction.
afraid-scarlet•3mo ago
You could also use the API to query the Knowledge Base directly. Then you could have an agent evaulate if the information can be used to answer the question. If not then have it take a path exiting the response.