foreign-sapphire•14mo ago

bot keeps getting confused

I've been working for a few days on trying to get the chatbot to respond good but it seems like it's always throwing an error. My KB is fairly diverse and very well structured. I've maxed out my token, temperature, tried various models (sonnet 3.5 seeming to be the best) But it seems like if the bot doesn't have access to the exact answer, it just fails. How do I make the bot answer in an 'educated guess' manner? I know it might seem like a simple fix but I've been at this for days now. I don't think my KB is the problem. How can I make the bot give answers even though it doesn't have the exact answer? I've used other chatbots that seem to give answers even if it's not perfectly confident but it seems no matter what I do or how I do it, it refuses to make educated guesses. This is regarding a realtor bot that is intended just to help with 'sales' or give confidence to the user that our agency is a good option to choose. I tried a cheapo bot from appsumo and it seemed to of never get confused even when it was using gpt 3.5

17 Replies

foreign-sapphireOP•14mo ago

it seems the buttons step virtually never is able to produce an answer, and the reponse ai step is a 50/50

Steve B. | IntelleSync.ai•14mo ago

@Deleted User It would be helpful to see your prompting inside your response ai. might sound silly but you've definitely set it to respond from KB?

foreign-sapphireOP•14mo ago

hello Steve thanks very much for the reply yes I will show you now as for the KB I spent 20 hours building it, I think it's solid

foreign-sapphireOP•14mo ago

Steve B. | IntelleSync.ai•14mo ago

In your response AI, First I would remove the instruction prompt as it's a system prompt which you already have. In the instructions you set the task at hand and in system the role and tone of the assistant.

foreign-sapphireOP•14mo ago

I made the change you suggested but please be aware I've been trying out many different prompts in many different combinations often coming to the same results

Steve B. | IntelleSync.ai•14mo ago

I appreciate you have spent along time to create your KB but a simple Q: & A: in markdown format is super effective. I've never had any issues... e.g

**Q:** Do your services comply with GDPR? Do your services comply with SOC II? Do your services comply with ISO 27001? What data security standards do your systems comply with?

**A:** Yes, our systems comply with several important data security standards:

- **GDPR (General Data Protection Regulation):** Ensuring the protection of personal data and privacy for individuals within the European Union.
- **SOC II (Service Organization Control 2):** Ensuring the management of customer data based on five "trust service principles"—security, availability, processing integrity, confidentiality, and privacy.
- **ISO 27001 (International Organization for Standardization 27001):** Providing a framework for managing and protecting sensitive company information.

By adhering to these standards, we ensure that your data is handled with the highest level of security and compliance.

**Q:** Do your services comply with GDPR? Do your services comply with SOC II? Do your services comply with ISO 27001? What data security standards do your systems comply with?

**A:** Yes, our systems comply with several important data security standards:

- **GDPR (General Data Protection Regulation):** Ensuring the protection of personal data and privacy for individuals within the European Union.
- **SOC II (Service Organization Control 2):** Ensuring the management of customer data based on five "trust service principles"—security, availability, processing integrity, confidentiality, and privacy.
- **ISO 27001 (International Organization for Standardization 27001):** Providing a framework for managing and protecting sensitive company information.

By adhering to these standards, we ensure that your data is handled with the highest level of security and compliance.

foreign-sapphireOP•14mo ago

thank you for the tip

Steve B. | IntelleSync.ai•14mo ago

You can always use chatgpt to help convert a sample size and experiment with it

foreign-sapphireOP•14mo ago

I've followed your suggestions and it still gets stuck on basic questions. I'm highly disappointed with this outcome. It has more than enough training data to answer simple quetions. for example it has no idea how to answer "how much can you get for my house?" It gets absolutely stumped. It should mention we will do our best to get the highest market price due to our strategies based around getting a high price. almost all of the data is based off getting high sell prices. the cheap appsumo bot answers every quetion without problem, I thought voiceflow would be better.

Steve B. | IntelleSync.ai•14mo ago

Check your DM

continuing-cyan•14mo ago

Hey do still need some help with this? If you are looking for accuracy on answers based on your knowledge base, I found Claude 3-haiku to be the best. Also temperature near to 0 since you don't want it to come up with other answers (unless you do) Furthermore I created intents that had response AI from Knowledge base and I prompted it for every subject

foreign-sapphireOP•14mo ago

hey sure would love to get your take on this as well. I'm really stressed out having to choose between 2 chatbot services. Steve was really helpful but I would love your feedback as well

continuing-cyan•14mo ago

Yes tell me more about your usecase and how you have your KB structured

foreign-sapphireOP•14mo ago

check dm

bot keeps getting confused

Did you find this page helpful?