An Approach to Teaching Applied Machine Learning with Autonomous Systems Integration

Chad Mello, Adrian De Freitas, Troy Weingart

2022

Abstract

We propose an applied machine learning course that teaches students with no machine learning background how to train and use deep learning models for deploying aerial drones (multi-copters). Our unique, hands-on curriculum gives students insight into the algorithms that power autonomous systems as well as the hardware technology on which they execute. Students learn how to integrate Python code with serial communications for streaming sensors and imagery to deep learning models. Students use OpenCV, Keras, and TensorFlow to learn about computer vision and deep learning. The final project (see Figure 1) provides the opportunity for students to plan and develop an end-to-end, fully autonomous, self-contained product (i.e. all systems physically residing on the drone itself) that is integrated with heavy-payload drones and computer vision in a scenario centered around an outdoor search and rescue mission. With no human in the loop, students deploy drones in search of a missing person. The drone locates and identifies the individual, delivers a care package to their location, and then reports the individual’s geolocation to ground rescuers before returning home. The novel helper code and solutions are built in-house using Python and open technologies. Results from a pilot offering in the spring of 2021 indicate that our approach is effective and engaging for computer and cyber science students who have previously taken a basic artificial intelligence course and who have 1-2 years of programming experience. This paper details the design, focus, and methodology behind our Autonomous Systems Integration curriculum as well as the challenges we encountered during its debut.

Paper Citation

in Harvard Style

Mello C., De Freitas A. and Weingart T. (2022). An Approach to Teaching Applied Machine Learning with Autonomous Systems Integration. In Proceedings of the 14th International Conference on Computer Supported Education - Volume 2: CSEDU, ISBN 978-989-758-562-3, pages 204-212. DOI: 10.5220/0011092700003182

in Bibtex Style

@conference{csedu22,
author={Chad Mello and Adrian De Freitas and Troy Weingart},
title={An Approach to Teaching Applied Machine Learning with Autonomous Systems Integration},
booktitle={Proceedings of the 14th International Conference on Computer Supported Education - Volume 2: CSEDU,},
year={2022},
pages={204-212},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011092700003182},
isbn={978-989-758-562-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Conference on Computer Supported Education - Volume 2: CSEDU,
TI - An Approach to Teaching Applied Machine Learning with Autonomous Systems Integration
SN - 978-989-758-562-3
AU - Mello C.
AU - De Freitas A.
AU - Weingart T.
PY - 2022
SP - 204
EP - 212
DO - 10.5220/0011092700003182