The Multipurpose Autonomous Agent Project: Experiential Learning for Engineering Assistive Artificial Intelligence

Chad Mello, James Maher, Troy Weingart

2023

Abstract

Assistive Technologies (AT) and Artificial Intelligence (AI) that support humans in decision making and in difficult or dangerous tasks are in high demand. We created a two-semester capstone project, for undergraduate seniors, providing the opportunity to build an assistive AI algorithm implemented on a skid-steer rover platform. By the end of the program, students created a system with the potential for assisting humans in dangerous indoor situations such as: gas leaks, bomb threats, fires, and active shooters. Our unique approach allowed the skid-steer rovers to autonomously navigate indoor areas never before encountered or previously mapped. Students used deep behavioral cloning techniques coupled with deep reinforcement learning to train the rovers for speed, steering control, and cornering. Outfitted with nothing more than a depth-sensing optical camera, an inexpensive autopilot, and an onboard, assistive NVIDIA Jetson Xavier NX computer, the rover quickly scanned and oriented to a new environment and then located objects of interest. The students’ final product demonstrated impressive abilities and skills demanded by industry in developing AT and AI platforms for mission-critical applications. Herein we share our approach, technology stack, experiences, and artifacts produced by our students at the end of the project.

Paper Citation

in Harvard Style

Mello C., Maher J. and Weingart T. (2023). The Multipurpose Autonomous Agent Project: Experiential Learning for Engineering Assistive Artificial Intelligence. In Proceedings of the 15th International Conference on Computer Supported Education - Volume 2: CSEDU, ISBN 978-989-758-641-5, SciTePress, pages 252-263. DOI: 10.5220/0011715500003470

in Bibtex Style

@conference{csedu23,
author={Chad Mello and James Maher and Troy Weingart},
title={The Multipurpose Autonomous Agent Project: Experiential Learning for Engineering Assistive Artificial Intelligence},
booktitle={Proceedings of the 15th International Conference on Computer Supported Education - Volume 2: CSEDU,},
year={2023},
pages={252-263},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011715500003470},
isbn={978-989-758-641-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Conference on Computer Supported Education - Volume 2: CSEDU,
TI - The Multipurpose Autonomous Agent Project: Experiential Learning for Engineering Assistive Artificial Intelligence
SN - 978-989-758-641-5
AU - Mello C.
AU - Maher J.
AU - Weingart T.
PY - 2023
SP - 252
EP - 263
DO - 10.5220/0011715500003470
PB - SciTePress