secure-lavender•15mo ago
Unable to generate response preview when using preview function
SOLVED:
I had run out of tokens. Maybe the error message should be changed from "Unable to generate response preview" or "Unable to reach knowledge base" to "You have run out of tokens".
Response AI block: When using the Preview function, the knowledge base returns "Unable to generate response preview" I used a new response AI block with the default settings. What is the problem here, please?
Response AI block: When using the Preview function, the knowledge base returns "Unable to generate response preview" I used a new response AI block with the default settings. What is the problem here, please?
3 Replies
When previewing your Knowledge Base responses, there are several factors to consider to ensure the accuracy and relevance of your AI Assistant's responses:
1. Test with Variety: Use a wide range of queries, including those phrased differently, to ensure robustness in the AI’s responses.
2. Check for Consistency: Ensure that the responses are consistent with previous answers and with the data provided.
3. Test with different settings: View the previewing process as iterative. The goal is to continuously enhance the AI’s ability to respond accurately. Remember, changes made in Preview are temporary and will not impact the KB's overall settings.
4. Overriding Defaults: To test different behaviours, you can adjust the AI model, temperature, max tokens, instructions and system prompt which will override the global KB settings.
5. Knowledge Base Content: Ensure that your Knowledge Base has sufficient and relevant content. The AI relies on the data within the Knowledge Base to generate responses.
6. Integration Management: If you are using integrations (e.g., Zendesk), ensure that the connections are properly configured and active. Any issues with integrations might affect the response generation.
If you are satisfied with the preview results, you must manually update these preferences in the KB Settings to apply them globally.
For more detailed guidance, you can refer to the following articles:
- Response AI
- How the Knowledge Base Works
secure-lavenderOP•15mo ago
When I test preview in the knowledge base it says "Unable to reach knowledge base"
Someone had the same problem. I had run out of tokens. Maybe the error message should be changed to "You have run out of tokens". See here: https://discord.com/channels/1079548823610871889/1249143778053455914/1249555074829779034
@Daniel @bamelement Good idea about the token part of the error.