ChartSight: An Automated Scheme for Assisting Visually Impaired in Understanding Scientific Charts

Mandhatya Singh, Puneet Goyal

2021

Abstract

The visual or Non-Textual components like charts, graphs, and plots are frequently used to represent the latent information in digital documents. These components bolster in better comprehension of the underlying complex information. However, these data visualization techniques are of not much use to visually impaired. Visually impaired people, especially in developing countries, rely on braille, tactile, or other conventional tools for reading purposes. Through these approaches, the understanding of Non-Textual components is a burdensome process with serious limitations. In this paper, we present ChartSight, an automated and interactive chart understanding system. ChartSight extracts and classifies the document images into different chart categories, and then uses heuristics-based content extraction methods optimized for line and bar charts. It finally represents the summarized content in audio format to the visually impaired users. We have presented a densely connected convolution network-based data-driven scheme for the chart classification problem, which shows comparatively better performance with the baseline models. Multiple datasets of chart images are used for the performance analysis. A comparative analysis of supporting features has also been performed with the other existing approaches.

Paper Citation

in Harvard Style

Singh M. and Goyal P. (2021). ChartSight: An Automated Scheme for Assisting Visually Impaired in Understanding Scientific Charts. In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP; ISBN 978-989-758-488-6, SciTePress, pages 309-318. DOI: 10.5220/0010201203090318

in Bibtex Style

@conference{visapp21,
author={Mandhatya Singh and Puneet Goyal},
title={ChartSight: An Automated Scheme for Assisting Visually Impaired in Understanding Scientific Charts},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP},
year={2021},
pages={309-318},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010201203090318},
isbn={978-989-758-488-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP
TI - ChartSight: An Automated Scheme for Assisting Visually Impaired in Understanding Scientific Charts
SN - 978-989-758-488-6
AU - Singh M.
AU - Goyal P.
PY - 2021
SP - 309
EP - 318
DO - 10.5220/0010201203090318
PB - SciTePress