KB population with gpt-Crawler
I have run into a problem that I did not experience before the new update of Voiceflow.
I created gpt-crawler from https://github.com/BuilderIO/gpt-crawler.git repository. The basic premise of such a function is to crawl a website and upload links to the knowledge base without having to copy and paste many links manually. Since we are using such a function to crawl and upload links for real estate agencies' listings and they change every month this function seems to fit us the most. Now after the recent voiceflow update, this function does not enrich my knowledge base with new links, I checked that API key and Project ID is correct and website links are still present. Can you suggest any options for how I can enrich my knowledge base without having to pay for Tavily AI?
If you have any other Ideas please let me know.
