Is it normal for each AI response to use around 1400 - 1800 tokens?
Just wondering if I should be using the knowledge base query api, or if using the KB response in the UI is the same thing.
I'm a bit nervous about launching my bot and destroying the quota when our users start trying it out.
2 Replies
That is normal
You could try using Haiku or GPT-3.5-turbo
You should be fine. Just make sure you are limiting your AI steps to where only necessary.
Okay, thanks for the confirmation (: