Sort of. I basically found the reason - Voiceflow assigns a unique user ID to every visitor and stores their chat history so if they ever come back, the chatbot will continue from where they left off. That's why it was providing responses based on past instructions. I opened the chatbot from a different browser and it's working as expected.
It would be helpful if anyone knows how to delete old user data.