John Blake
About
No profileSessions
Poster Session Biosignal-Adaptive Language Learning In Virtual Reality more
We introduce an innovative approach to adaptive language learning using embodied intelligent virtual agents as personalized tutors within an immersive extended reality environment. At the core of our innovation is the use of real-time biosignals, specifically heart rate data collected through wearable devices like the Samsung Watch 7, to personalize educational interactions. By continuously monitoring changes in the learner's emotional and cognitive states, indicated through fluctuations in heart rate, the virtual tutor can adapt its instructional approach. For example, if a Japanese learner's heart rate increases when correcting written errors, indicating possible stress or difficulty, the tutor might slow down speech or simplify language tasks to help the learner remain comfortable and engaged. Currently, our adaptation method primarily uses average heart rate data, but we are also exploring more detailed analyses, such as examining heartbeat intervals over time and detecting patterns in specific heart rhythm frequencies. Additionally, we are investigating how additional biosignals such as electrocardiogram and photoplethysmography can further improve the accuracy of stress prediction. Our comprehensive system integrates digital human tutors powered by ConvAI, advanced language models, XR environments, and efficient data handling. Early results demonstrate significant potential for enhancing language learning through personalized, engaging, and responsive experiences.
Presentation DynaWrite: Computerized Dynamic Assessment for L2 Writing more
This presentation introduces the results of an online web application we designed to leverage large language models to provide language learners with real-time feedback on learner writing. The tool, called DynaWrite, is designed to deliver feedback that begins implicitly and gradually increases in explicitness if the learner is unable to identify and correct errors, thereby utilizing the benefits of dynamic assessment. While the benefits of dynamic assessment are well-documented and proven empirically, its implementation in real-life classrooms has been limited due to its lack of scalability. Computerized dynamic assessment (CDA) offers a scalable solution, yet previous CDA systems focused on the receptive skills of reading and listening. To the best of our knowledge, DynaWrite is the first CDA system to address grammatical errors in extended writing, addressing an important gap. In this presentation we first provide a brief explanation of how the tool is used and the educational theories underpinning the approach. We then present examples of the tool tracking the development of adult Japanese language learners as they use the tool over a course of English language study.
