Multi-Modal Framework for Autism Severity Assessment Using Spatio-Temporal Graph Transformers

Kush Gupta, Amir Aly, Emmanuel Ifeachor

2025

Abstract

Diagnosing Autism Spectrum Disorder (ASD) remains challenging, as it often relies on subjective evaluations and traditional methods using fMRI data. This paper proposes an innovative multi-modal framework that leverages spatiotemporal graph transformers to assess ASD severity using skeletal and optical flow data from the MMASD dataset. Our approach captures movement synchronization between children with ASD and therapists during play therapy interventions. The framework integrates a spatial encoder, a temporal transformer, and an I3D network for comprehensive motion analysis. Through this multi-modal approach, we aim to deliver reliable ASD severity scores, enhancing diagnostic accuracy and offering a scalable, robust alternative to traditional techniques.

Paper Citation

in Harvard Style

Gupta K., Aly A. and Ifeachor E. (2025). Multi-Modal Framework for Autism Severity Assessment Using Spatio-Temporal Graph Transformers. In Proceedings of the 18th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 2: HEALTHINF; ISBN 978-989-758-731-3, SciTePress, pages 686-693. DOI: 10.5220/0013236900003911

in Bibtex Style

@conference{healthinf25,
author={Kush Gupta and Amir Aly and Emmanuel Ifeachor},
title={Multi-Modal Framework for Autism Severity Assessment Using Spatio-Temporal Graph Transformers},
booktitle={Proceedings of the 18th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 2: HEALTHINF},
year={2025},
pages={686-693},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013236900003911},
isbn={978-989-758-731-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 2: HEALTHINF
TI - Multi-Modal Framework for Autism Severity Assessment Using Spatio-Temporal Graph Transformers
SN - 978-989-758-731-3
AU - Gupta K.
AU - Aly A.
AU - Ifeachor E.
PY - 2025
SP - 686
EP - 693
DO - 10.5220/0013236900003911
PB - SciTePress