An Approach Integrating Artificial Intelligence & Virtual Reality

Tech Stack: Amazon EC2, Google Cloud Platform, Python, PyMumble, Socket, Transformers, PyTorch, Flask, Gunicorn, NGINX

• Created a virtual reality assistant capable of understanding the user intent based and carrying out complex downstream tasks.
• Implemented RASA, a cutting-edge dialogue management framework, which includes a natural language understanding model for extracting intent & entities and a policy for guiding the conversation.
• Developed Audio emotions, Natural answer generation, and Text polarity modules and deployed them via APIs on a Gunicorn server.
• Designed and deployed a scalable backend architecture on EC2 for real-time analysis of multimodal data from the Virtual Reality headsets.