Integrating a LLaMa-based Chatbot with Augmented Retrieval Generation as a Complementary Educational Tool for High School and College Students

Darío Cabezas, Rigoberto Fonseca-Delgado, Iván Reyes-Chacón, Paulina Vizcaino-Imacaña, Manuel Morocho-Cayamcela, Manuel Morocho-Cayamcela

2024

Abstract

In the current educational landscape, the transition from traditional paradigms to more interactive and personalized learning experiences has been accelerated by technological advancements, particularly in artificial intelligence (AI). This paper explores integrating large language models (LLMs) with retrieval augmented generation techniques (RAG) to develop an educational chatbot to enhance students’ learning experiences. Leveraging the LLaMa 7B-chat model and RAG technique, our system incorporates a structured mathematical database supplemented with relevant audiovisual resources. Furthermore, leveraging the Pinecone API enhances information retrieval efficiency through cosine similarity. This capability empowers the chatbot to deliver precise and relevant responses to students’ inquiries by accessing documents from Pinecone. Moreover, incorporating system prompts and memory functionality contributes to a more personalized learning experience, enriching student interaction with the educational assistant. The findings suggest these assistants can enhance student engagement and facilitate knowledge acquisition.

Paper Citation

in Harvard Style

Cabezas D., Fonseca-Delgado R., Reyes-Chacón I., Vizcaino-Imacaña P. and Morocho-Cayamcela M. (2024). Integrating a LLaMa-based Chatbot with Augmented Retrieval Generation as a Complementary Educational Tool for High School and College Students. In Proceedings of the 19th International Conference on Software Technologies - Volume 1: ICSOFT; ISBN 978-989-758-706-1, SciTePress, pages 395-402. DOI: 10.5220/0012763000003753

in Bibtex Style

@conference{icsoft24,
author={Darío Cabezas and Rigoberto Fonseca-Delgado and Iván Reyes-Chacón and Paulina Vizcaino-Imacaña and Manuel Morocho-Cayamcela},
title={Integrating a LLaMa-based Chatbot with Augmented Retrieval Generation as a Complementary Educational Tool for High School and College Students},
booktitle={Proceedings of the 19th International Conference on Software Technologies - Volume 1: ICSOFT},
year={2024},
pages={395-402},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012763000003753},
isbn={978-989-758-706-1},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 19th International Conference on Software Technologies - Volume 1: ICSOFT
TI - Integrating a LLaMa-based Chatbot with Augmented Retrieval Generation as a Complementary Educational Tool for High School and College Students
SN - 978-989-758-706-1
AU - Cabezas D.
AU - Fonseca-Delgado R.
AU - Reyes-Chacón I.
AU - Vizcaino-Imacaña P.
AU - Morocho-Cayamcela M.
PY - 2024
SP - 395
EP - 402
DO - 10.5220/0012763000003753
PB - SciTePress