#4176

Poster Session

Developing an AI-Powered VR Chatbot for Immersive Medical English Training and Beyond

Time not set

This poster session will detail the design and development of an innovative AI-Powered Virtual Reality Chatbot, specifically created for English-speaking practice. The VR simulation application aims to provide an immersive and interactive platform for EFL learners to enhance their English communication skills without a need for an English speaking human partner. This VR simulation can be applied to any speaking scenario. Here, we created a VR medical environment for the purpose of training for interviewing a patient in English, where the chatbot will play the role of the patient.

The poster covers key aspects of the development process, including the integration of text-to-speech and speech-to-text technology to successfully communicate with the AI (ChatGPT) patient, the creation of the 3D VR environment, the implementation of user-friendly controls, and design decisions based on feedback from experts in medical education. Preliminary user testing results and feedback are shared, highlighting the application's potential to improve medical English proficiency, to address the lack of human speaking practice partners and to reduce language learning anxiety.

Participants will have the opportunity to experience the simulation themselves.

  • James York

    Associate Professor at Meiji University || York Game Lab founder || Ludic Language Pedagogy editor || #games #play #pedagogy #PICO-8 #PETSCII #chiptune

  • Jeanette Dennisson

    She is focused on her government-funded project that integrates SR technology and chatbots in the development of medical communication skills.