Using Deep Learning and Native Mobile App to Assist Autistic Students’ Educational Experience

Zeina Thabet, Hurmat Ansari, Sara Albashtawi, Nur Siyam, Sherief Abdallah

2023

Abstract

Apart from difficulties with social communication, children with autism spectrum disorder (ASD) tend to have limited interest in academic activities. The challenges faced by the educators of these students are abundant, including selecting motivating items or activities that can prompt them to complete a task. In addition to this challenge, the educators also face the issue of the lack of coordination between the teachers, therapists, and parents. This issue is imperative as significant learning opportunities are lost for lack of communication. To address these two issues, we have created a distributed system consisting of a mobile application that tracks the academic objectives and behavioural progress of the students which allows for a centralized place of information for easier coordination between educators, as well as suggesting effective motivators using a Deep Neural Network (DNN), specifically a Deep Q Network, to help autistic students regain their focus in the class. The Deep Q Network is constructed with a custom environment that takes in the state as input and then, based on the current state, calculates the best motivator to suggest. The mobile application was created with an aim of assisting school educators in tracking a student’s progress. Moreover, the system includes a staff dashboard to manage users and provide visualizations depicting students’ progress. This project is the first of its kind and will help educators select effective motivators in moments that the students need them as well as aid the flow of information between the stakeholders.

Paper Citation

in Harvard Style

Thabet Z., Ansari H., Albashtawi S., Siyam N. and Abdallah S. (2023). Using Deep Learning and Native Mobile App to Assist Autistic Students’ Educational Experience. In Proceedings of the 15th International Conference on Computer Supported Education - Volume 2: CSEDU, ISBN 978-989-758-641-5, SciTePress, pages 96-103. DOI: 10.5220/0011748800003470

in Bibtex Style

@conference{csedu23,
author={Zeina Thabet and Hurmat Ansari and Sara Albashtawi and Nur Siyam and Sherief Abdallah},
title={Using Deep Learning and Native Mobile App to Assist Autistic Students’ Educational Experience},
booktitle={Proceedings of the 15th International Conference on Computer Supported Education - Volume 2: CSEDU,},
year={2023},
pages={96-103},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011748800003470},
isbn={978-989-758-641-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Conference on Computer Supported Education - Volume 2: CSEDU,
TI - Using Deep Learning and Native Mobile App to Assist Autistic Students’ Educational Experience
SN - 978-989-758-641-5
AU - Thabet Z.
AU - Ansari H.
AU - Albashtawi S.
AU - Siyam N.
AU - Abdallah S.
PY - 2023
SP - 96
EP - 103
DO - 10.5220/0011748800003470
PB - SciTePress