ambitious-aqua•17mo ago
More than 200 URLs?
I uploaded an Sitemap with 2k URLs, but i get a message that only 200 is possible. Is that a Sandbox restriction or is more possible in the paid version? thanks
5 Replies
Voiceflow's Knowledge Base feature does have a limit on the number of URLs that can be uploaded at once. Currently, the limit is set to 200 URLs per upload. This is not a restriction specific to the Sandbox version, but applies to all versions, including the paid ones.
The reason for this limit is to manage the load on our servers and ensure optimal performance for all users. Uploading a large number of URLs at once can be resource-intensive and potentially slow down the system.
If you have a Sitemap with more than 200 URLs, you would need to split it into smaller parts and upload them separately. This way, you can still include all your URLs in the Knowledge Base, but it will just take a bit more time and effort.
Remember, each URL you add is treated as a separate data source and will consume tokens based on the amount of text it contains. So, it's also important to monitor your token usage, especially if you're dealing with a large number of URLs.
For more information on how to add data sources to your Knowledge Base, you can refer to this document: How to implement the Knowledge Base.
I'm guessing you are on a trial. That defaults to Pro. Pro has a limit of 200 KB docs / urls.
You really should not have that many urls in your kb.
Are these info urls or product urls?
ambitious-aquaOP•17mo ago
these are blog urls, the source url should be mentioned in an llm answer
For this kind of usage I will suggest using a search API instead (Tavily, Brave, Perplexity, Google search...) limited to the blog domain. You can then pass the source and the content of the page as context to your LLM prompt. This will avoid you to upload thousand of URLs (and manually check/upload for new ones).
ambitious-aquaOP•17mo ago
Nice. You have an example for that?
@NiKo | Voiceflow