Real-Time 3D Object Detection and Recognition using a Smartphone

Jin Chen, Zhigang Zhu, Zhigang Zhu

2022

Abstract

Real-time detection of 3D obstacles and recognition of humans and other objects is essential for blind or low- vision people to travel not only safely and independently but also confidently and interactively, especially in a cluttered indoor environment. Most existing 3D obstacle detection techniques that are widely applied in robotic applications and outdoor environments often require high-end devices to ensure real-time performance. There is a strong need to develop a low-cost and highly efficient technique for 3D obstacle detection and object recognition in indoor environments. This paper proposes an integrated 3D obstacle detection system implemented on a smartphone, by utilizing deep-learning-based pre-trained 2D object detectors and ARKit- based point cloud data acquisition to predict and track the 3D positions of multiple objects (obstacles, humans, and other objects), and then provide alerts to users in real time. The system consists of four modules: 3D obstacle detection, 3D object tracking, 3D object matching, and information filtering. Preliminary tests in a small house setting indicated that this application could reliably detect large obstacles and their 3D positions and sizes in the real world and small obstacles’ positions, without any expensive devices besides an iPhone.

Paper Citation

in Harvard Style

Chen J. and Zhu Z. (2022). Real-Time 3D Object Detection and Recognition using a Smartphone. In Proceedings of the 2nd International Conference on Image Processing and Vision Engineering - Volume 1: IMPROVE, ISBN 978-989-758-563-0, pages 158-165. DOI: 10.5220/0011060600003209

in Bibtex Style

@conference{improve22,
author={Jin Chen and Zhigang Zhu},
title={Real-Time 3D Object Detection and Recognition using a Smartphone},
booktitle={Proceedings of the 2nd International Conference on Image Processing and Vision Engineering - Volume 1: IMPROVE,},
year={2022},
pages={158-165},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011060600003209},
isbn={978-989-758-563-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 2nd International Conference on Image Processing and Vision Engineering - Volume 1: IMPROVE,
TI - Real-Time 3D Object Detection and Recognition using a Smartphone
SN - 978-989-758-563-0
AU - Chen J.
AU - Zhu Z.
PY - 2022
SP - 158
EP - 165
DO - 10.5220/0011060600003209