You are here

Automatic Assessment Of Cognitive And Emotional States In Virtual Reality-based Flexibility Training For Four Adolescents With Autism

Title: Automatic Assessment Of Cognitive And Emotional States In Virtual Reality-based Flexibility Training For Four Adolescents With Autism.
3 views

Inaccessible until Mar 1, 2022 due to copyright restrictions.

Name(s): Moon, Jewoong, author
Ke, Fengfeng, author
Sokolikj, Zlatko, author
Type of Resource: text
Genre: Journal Article
Text
Journal Article
Date Issued: 2020-09
Physical Form: computer
online resource
Extent: 1 online resource
Language(s): English
Abstract/Description: Tracking students' learning states to provide tailored learner support is a critical element of an adaptive learning system. This study explores how an automatic assessment is capable of tracking learners' cognitive and emotional states during virtual reality (VR)-based representational-flexibility training. This VR-based training program aims to promote the flexibility of adolescents with autism spectrum disorder (ASD) in interpreting, selecting and creating multimodal representations during STEM-related design problem solving. For the automatic assessment, we used both natural language processing (NLP) and machine-learning techniques to develop a multi-label classification model. We then trained the model with the data from a total of audio- and video-recorded 66 training sessions of four adolescents with ASD. To validate the model, we implemented both k-fold cross-validations and the manual evaluations by expert reviewers. The study finding suggests the feasibility of implementing the NLP and machine-learning driven automatic assessment to track and assess the cognitive and emotional states of individuals with ASD during VR-based flexibility training. The study finding also denotes the importance and viability of providing adaptive supports to maintain learners' cognitive and affective engagement in a highly interactive digital learning environment.
Identifier: FSU_libsubv1_wos_000549762700001 (IID), 10.1111/bjet.13005 (DOI)
Keywords: children, spectrum disorder, design, intervention, students, experiences, recognition, classification, memory
Publication Note: The publisher's version of record is availible at https://doi.org/10.1111/bjet.13005
Persistent Link to This Record: http://purl.flvc.org/fsu/fd/FSU_libsubv1_wos_000549762700001
Host Institution: FSU
Is Part Of: British Journal of Educational Technology.
0007-1013
Issue: iss. 5, vol. 51

Choose the citation style.
Moon, J., Ke, F., & Sokolikj, Z. (2020). Automatic Assessment Of Cognitive And Emotional States In Virtual Reality-based Flexibility Training For Four Adolescents With Autism. British Journal Of Educational Technology. Retrieved from http://purl.flvc.org/fsu/fd/FSU_libsubv1_wos_000549762700001