Is it normal for each AI response to use around 1400 - 1800 tokens?

Just wondering if I should be using the knowledge base query api, or if using the KB response in the UI is the same thing.

I'm a bit nervous about launching my bot and destroying the quota when our users start trying it out.

W. Williams (SFT)•4/16/24, 4:26 PM

That is normal

W. Williams (SFT)•4/16/24, 4:26 PM

You could try using Haiku or GPT-3.5-turbo

W. Williams (SFT)•4/16/24, 4:27 PM

You should be fine. Just make sure you are limiting your AI steps to where only necessary.

BrandersnatcherOP•4/16/24, 6:40 PM

Okay, thanks for the confirmation (: