AnimaChaotic: AI-based Automatic Conversion of Children’s Stories to Animated 3D Videos

Reem Abdel-Salam, Reem Gody, Mariam Maher, Hagar Hosny, Ahmed S. Kaseb

2022

Abstract

Stories are an effective and entertaining way of teaching children about real-life experiences in an engaging way. Although many children’s stories are supplemented with graphical illustrations, having animated 3D video illustrations can effectively boost the learning process, especially for visual learners. However, producing animated 3D videos is a hard, expensive, and time-consuming process, so there is a need to automate this process. In this paper, we introduce AnimaChaotic, a story visualization system designed to automatically convert children’s short stories to animated 3D videos by leveraging Artificial Intelligence (AI) and computer graphics. Our Natural Language Processing (NLP) pipeline extracts visualizable information from the story such as actors and actions. Then, our object positioning algorithm determines the initial positions of the objects in the scene. Finally, the system animates the scene using different techniques including AI behaviors. A quantitative analysis of our system demonstrates a high precision and recall in extracting visualizable information. It also shows that our system outperforms existing solutions in terms of static scene generation. A qualitative analysis of the system shows that its output is visually acceptable and outperforms similar solutions.

Paper Citation

in Harvard Style

Abdel-Salam R., Gody R., Maher M., Hosny H. and S. Kaseb A. (2022). AnimaChaotic: AI-based Automatic Conversion of Children’s Stories to Animated 3D Videos. In Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-547-0, pages 226-235. DOI: 10.5220/0010815100003116

in Bibtex Style

@conference{icaart22,
author={Reem Abdel-Salam and Reem Gody and Mariam Maher and Hagar Hosny and Ahmed S. Kaseb},
title={AnimaChaotic: AI-based Automatic Conversion of Children’s Stories to Animated 3D Videos},
booktitle={Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2022},
pages={226-235},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010815100003116},
isbn={978-989-758-547-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - AnimaChaotic: AI-based Automatic Conversion of Children’s Stories to Animated 3D Videos
SN - 978-989-758-547-0
AU - Abdel-Salam R.
AU - Gody R.
AU - Maher M.
AU - Hosny H.
AU - S. Kaseb A.
PY - 2022
SP - 226
EP - 235
DO - 10.5220/0010815100003116