rival-black•2y ago
Hallucination in Response AI
Hi, I’m trying to create a chatbot that looks at a student’s essay and provides feedback based on a rubric.
I’ve keyed in the rubrics into response AI under the “prompt” but when I get it to analyze the {last_utterance}, the response gives inaccurate feedback by writing things not in the {last_utterance}
How do I get the response AI to analyze what is only in the {last_utterance}?
4 Replies
To ensure your Response AI analyzes only what is in the
{last_utterance} and provides accurate feedback based on your rubric, you should configure your step to use the "Use Prompt only" option. This configuration ensures that only the prompt you provide is passed to the LLM (Large Language Model) for generating a response, without including any additional context from the conversation memory. This approach is particularly useful when you need the LLM to perform a specific function or generate a specific response based on the exact content of the {last_utterance}.
Here are the key points to consider:
- Use the "Use Prompt only" option to ensure only the data you want is analyzed.
- This option prevents the inclusion of conversation memory, which could lead to inaccurate feedback.
- It's ideal for tasks requiring specific responses or functions from the LLM.
By following this configuration, you can better align the AI's analysis and feedback with the specific requirements of your rubric.automatic-azure•2y ago
@euniquely look at the video by Peter Isaacs on Wells Fargo. This deals with hallucinations very effectively as I have found. You may have to rearrange your vf project structure by putting the rubrics in as KB content.
https://www.google.com/url?sa=t&source=web&rct=j&opi=89978449&url=https://m.youtube.com/watch%3Fv%3DBHxhFd1vqkg&ved=2ahUKEwjY4c230qOFAxUENlkFHf91By0QwqsBegQIERAG&usg=AOvVaw3IhJYVDXUEE3VsDvDDuH74
rival-blackOP•2y ago
Sorry if I’m clueless but if I put it in the KB, won’t it just copy the rubrics out? I thought that KB meant that they would just use whatever that’s in it to write an answer
automatic-azure•2y ago
@euniquely I'm assuming that the rubrics remain consistent (but can be changed if required) and can be added as a document to the KB. When a student's essay comes in it can be added to the prompt and the system asked to check it against the stored rubrics. I have done this successfully with chatGPT, albeit openAI have a handy file upload function (the paperclip by the prompt window). VoiceFlow are working on something like this currently and it is in beta. I'm hoping the production version will be as simple to use as openAI's.
So the key issue is how you get the essay into be analysed. Pasting it will work but it is a clumsy solution.