The Design and Development of Electronic Text Natural Language Processing System Based on Deep Learning

Dan Liu, Jianmin Hao, Jiayi Li

2022

Abstract

In this paper, the author takes the upstream task text classification of natural language processing as the research object, and completes the collection, cleaning and distributed storage processing of electronic texts with the help of HDHF and HBase components under Hadoop cluster. The MapReduce component is used to call the deep learning algorithm FastText to complete the supervised text classification operation, and finally Echarts technology is selected to show the classification results in the form of charts. Besides, the running environment of the whole text classification process is Java environment, and the server side will be built according to the Spring framework, so as to ensure that all API data interfaces can be encapsulated and called reasonably, thus forming the electronic text natural language processing system on the Web side. The system will quickly realize the capture, cleaning, classification and visualization of electronic text information, reduce the problem of information overload in the downstream task execution of natural language, and improve the information retrieval efficiency.

Paper Citation

in Harvard Style

Liu D., Hao J. and Li J. (2022). The Design and Development of Electronic Text Natural Language Processing System Based on Deep Learning. In Proceedings of the 2nd International Conference on New Media Development and Modernized Education - Volume 1: NMDME; ISBN 978-989-758-630-9, SciTePress, pages 197-202. DOI: 10.5220/0011909000003613

in Bibtex Style

@conference{nmdme22,
author={Dan Liu and Jianmin Hao and Jiayi Li},
title={The Design and Development of Electronic Text Natural Language Processing System Based on Deep Learning},
booktitle={Proceedings of the 2nd International Conference on New Media Development and Modernized Education - Volume 1: NMDME},
year={2022},
pages={197-202},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011909000003613},
isbn={978-989-758-630-9},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 2nd International Conference on New Media Development and Modernized Education - Volume 1: NMDME
TI - The Design and Development of Electronic Text Natural Language Processing System Based on Deep Learning
SN - 978-989-758-630-9
AU - Liu D.
AU - Hao J.
AU - Li J.
PY - 2022
SP - 197
EP - 202
DO - 10.5220/0011909000003613
PB - SciTePress