AI-Integrated Learning and Support Platform for Individuals with Autism

Abstract

This paper presents an AI-driven assistive system designed to support autistic individuals by leveraging multi-modal artificial intelligence (AI) technologies for communication enhancement, emotional well-being, and social interaction. The system comprises four core modules: Speak and Learn, See and Learn, Collaborations, and ASD Community, each integrating advanced AI methodologies. The Speak and Learn module utilizes speech-to-text (STT) and text-to-speech (TTS) technologies, reinforced by a Natural Language Processing (NLP) model, to facilitate real-time, adaptive communication. A custom chatbot trained on predefined conversational patterns enhances user engagement and interaction with 95% Accuracy. The See and Learn module employs a TensorFlow Lite (TFLite)-based deep learning model for real-time emotion detection, classifying emotions into angry, sad, and happy categories. Based on the detected emotional state, the system dynamically suggests curated videos and GIFs to promote emotional regulation and engagement with 95% accuracy. The Collaborations module features a secure, low-latency real-time messaging system, enabling direct communication between autistic individuals and psychologists for tailored professional support. Lastly, the ASD Community module serves as an interactive, AI-powered social engagement platform where users can share experiences, provide feedback, and connect with peers. The system is optimized for low-latency performance using resource-efficient AI models, making it compatible with mobile and embedded platforms. By integrating NLP-driven conversational agents, deep learning-based emotion recognition, and secure communication channels, this application creates a comprehensive, intelligent ecosystem tailored to the needs of autistic users. Experimental results demonstrate the system's efficiency, accuracy, and real-time performance, ensuring seamless user experiences across diverse deployment environments.

Country : India

1 Thamba Meshach W2 S Aswini

  1. Professor, Department of Computer Science, Prathyusha Engineering College, India
  2. PG Scholar, Department of Computer Science, Prathyusha Engineering College, India

IRJIET, Volume 9, Special Issue of INSPIRE’25 April 2025 pp. 14-23

doi.org/10.47001/IRJIET/2025.INSPIRE03

References

  1. Alim Abbas, ford Garberson, Stuart Liu-Mayo, eric Glover & Dennis p. Wall ―Multi-modular Ai Approach to Streamline Autism Diagnosis in Young children‖ published on 2020, doi: 10.1038/s41598-020-61213-w.
  2. Zhong Zhao1, PhD; Haiming Tang1; Xiaobin Zhang2, PhD; Xingda Qu1, PhD; Xinyao Hu1, PhD; Jianping Lu ―Classification of Children With Autism and Typical Development Using Eye-Tracking Data From Face-to-Face Conversations: Machine Learning Model Development and Performance Evaluation‖ published year 2021, doi: 10.2196/29328.
  3. Nadire Cavus, Abdulmalik A. Lawan, Zurki Ibrahim, Abdullahi Dahiru, Sadiya Tahir Usama Ishaq Abdulrazak and AdamuHussaini ―A Systematic Literature Review on the Application of Machine-Learning Models in Behavioral Assessment of Autism Spectrum Disorder‖ published on 2021, doi: 10.3390/jpm11040299.
  4. S. M. Mahedy Hasan, MD Palash Uddin, Mdalmamun, Muhammad IMRAN SHARIF, ANWAAR ULHAQ, AND GOVINDKRISHNAMOORTHY, ―A Machine Learning Framework for Early-Stage Detection of Autism Spectrum Disorders‖ Published on 2022, doi:10.1109/ACCESS.2022.3232490.
  5. Manukohli , (Member, IEEE), Arpan Kumar Kar, And Shuchi Sinha,‖The Role of Intelligent Technologies in Early Detection of Autism Spectrum Disorder (ASD): A Scoping Review‖ published on 2022, doi: 10.1109/ACCESS.2022.3208587.
  6. Catherine Lord, Susan Risi, Linda Lambrecht, Edwin H. Cook, Jr Bennett L. Leventhal, Pamela C. DiLavore, Andrew Pickles, and Michael Rutter ―The Autism Diagnostic Observation Schedule–Generic: A Standard Measure of Social and Communication Deficits Associated with the Spectrum of Autism‖ published year 2023. Doi: 10.1109/TNSRE.2020.3027756.
  7. Chuangao Tang, Student Member, IEEE, Wenming Zheng, Senior Member, IEEE, Yuan Zong, Nana Qiu, Cheng Lu, Xilei Zhang, Xiaoyan Ke, Cuntai Guan, Fellow, IEEE ―Automatic Identification of High-Risk Autism Spectrum Disorder: A Feasibility Study Using Video and Audio Data under the Still-Face Paradigm‖ published on 2023 doi: 10.1109/TNSRE.2020.3027756.
  8. Amit Sundas, Sumit Badotra, Shalli Rani and Raymond Gyaang, ―Evaluation of Autism Spectrum Disorder Based on the Healthcare by Using Artificial Intelligence Strategies‖ published on 2023. doi: 10.1155/2023/5382375.
  9. Minqiang Yang, Yushan Wu, Yongfeng Tao, Xiping Hu, and Bin Hu, ‖Trial Selection Tensor Canonical Correlation Analysis (TSTCCA) for Depression Recognition with Facial Expression and Pupil Diameter‖ published on 2024. doi: 10.1109/jbhi.2023.3322271.
  10. Shi Chen, Ming Jiang, and QiZhao, ‖ Deep Learning to Interpret Autism Spectrum Disorder Behind the Camera, published on 2024. doi: 10.1109/tcds.2024.3386656.