Hand-Drawn Diagram Correction Using Machine Learning

Tenga Yoshida, Hiroyuki Kobayashi

2023

Abstract

This paper introduces a real-time correction technique for hand-drawn diagrams on tablets, leveraging machine learning to mitigate inaccuracies caused by hand tremors. A novel fusion of classification and regression models is proposed; initially, the classification model discerns the geometric shape being drawn, aiding the regression model in making precise corrective predictions during the drawing process. Additionally, a unique Mean Angle of Vector (MAV) loss function is introduced to minimize angle changes in vectors formed by consecutive points, thereby reducing hand tremors especially in straight line segments. The MAV function not only facilitates real-time corrections but also preserves the drawing fluidity, enhancing user satisfaction. Experimental results highlight improved correction accuracy, particularly when employing classification alongside regression. However, the MAV function may round off sharp corners, indicating areas for further refinement. This work paves the way for more intuitive and user-friendly digital sketching and diagramming applications.

Paper Citation

in Harvard Style

Yoshida T. and Kobayashi H. (2023). Hand-Drawn Diagram Correction Using Machine Learning. In Proceedings of the 20th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO; ISBN 978-989-758-670-5, SciTePress, pages 346-351. DOI: 10.5220/0012239300003543

in Bibtex Style

@conference{icinco23,
author={Tenga Yoshida and Hiroyuki Kobayashi},
title={Hand-Drawn Diagram Correction Using Machine Learning},
booktitle={Proceedings of the 20th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO},
year={2023},
pages={346-351},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012239300003543},
isbn={978-989-758-670-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 20th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO
TI - Hand-Drawn Diagram Correction Using Machine Learning
SN - 978-989-758-670-5
AU - Yoshida T.
AU - Kobayashi H.
PY - 2023
SP - 346
EP - 351
DO - 10.5220/0012239300003543
PB - SciTePress