An Assistive Technology Based on Object Detection for Automated Task List Generation

Frédéric Rayar

2024

Abstract

People suffering from Intellectual Disability (ID) face challenges to perform sequential tasks in their daily life, impacting their education and employability. To help them, the usage of Assistive Technology (AT) on mobile devices is a promising direction. However, most of them do not take advantage of the important recent advances in Artificial Intelligence. In this paper, we address this lack by presenting a prototype of an embed AT system that leverage computer vision advances to assist a user suffering from ID to perform sequential tasks in a guesthouse rooms’ tiding-up activity. It first relies on a state-of-the-art object detector, namely YOLOv7, that we have adapted for a real-time usage on mobile devices. Then, using a ”spot the difference” approach, it identifies objects of interest that are either present, absent or displaced, compared to a template image. A list of tasks to be achieved is automatically generated and conveyed to the user using an accessible and ergonomic interface. Early qualitative experiments of this ongoing work lead us to believe that our contribution could improve the life of people suffering from ID, allowing them to improve both their functioning and independence.

Paper Citation

in Harvard Style

Rayar F. (2024). An Assistive Technology Based on Object Detection for Automated Task List Generation. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP; ISBN 978-989-758-679-8, SciTePress, pages 601-605. DOI: 10.5220/0012453200003660

in Bibtex Style

@conference{visapp24,
author={Frédéric Rayar},
title={An Assistive Technology Based on Object Detection for Automated Task List Generation},
booktitle={Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP},
year={2024},
pages={601-605},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012453200003660},
isbn={978-989-758-679-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP
TI - An Assistive Technology Based on Object Detection for Automated Task List Generation
SN - 978-989-758-679-8
AU - Rayar F.
PY - 2024
SP - 601
EP - 605
DO - 10.5220/0012453200003660
PB - SciTePress