rare-sapphire•2y ago
Expanding External Knowledge Base for Chatbot Vector Search
Hey Voiceflow Community!
We're currently navigating a complex challenge in our chatbot project. Our bot is designed to perform similarity searches using segments from podcast transcripts. As our project progresses, we've found that our internal knowledge base is nearing its capacity, prompting us to explore external expansion.
We are considering tools like MeiliSearch or Pinecone to facilitate this growth. However, the transition to an external knowledge base requires careful consideration, especially since our requirements are multi-faceted:
- Multilingual Knowledge Bases: We need to manage separate knowledge bases for different languages.
- Vector Search Capabilities: It's crucial for our system to support vector search for efficient and accurate similarity matching.
Given these specifics, I have a few questions for this knowledgeable community:
- Integration Experiences: Has anyone here successfully integrated an external knowledge base with their chatbot? What challenges did you face during this process?
- Tool Recommendations: What tools did you use, particularly those that support multilingual content and vector search? Would you recommend these tools?
- Best Practices: Are there any best practices or strategies for managing extensive, multifaceted external knowledge bases?
Your insights and shared experiences would be immensely helpful in guiding us through this expansion phase. Thank you in advance for your assistance and valuable advice!
Best regards,
Silas
mstr.nl
0 Replies