Agentic AI for Behavior-Driven Development Testing Using Large Language Models

Ciprian Paduraru, Miruna Zavelca, Alin Stefanescu, Alin Stefanescu

2025

Abstract

Behavior-driven development (BDD) testing significantly improves communication and collaboration between developers, testers and business stakeholders, and ensures that software functionality meets business requirements. However, the benefits of BDD are often overshadowed by the complexity of writing test cases, making it difficult for non-technical stakeholders. To address this challenge, we propose BDDTestAIGen, a framework that uses Large Language Models (LLMs), Natural Language Processing (NLP) techniques, human-in-the-loop and Agentic AI methods to automate BDD test creation. This approach aims to reduce manual effort and effectively involve all project stakeholders. By fine-tuning an open-source LLM, we improve domain-specific customization, data privacy and cost efficiency. Our research shows that small models provide a balance between computational efficiency and ease of use. Contributions include the innovative integration of NLP and LLMs into BDD test automation, an adaptable open-source framework, evaluation against industry-relevant scenarios, and a discussion of the limitations, challenges and future directions in this area.

Paper Citation

in Harvard Style

Paduraru C., Zavelca M. and Stefanescu A. (2025). Agentic AI for Behavior-Driven Development Testing Using Large Language Models. In Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART; ISBN 978-989-758-737-5, SciTePress, pages 805-815. DOI: 10.5220/0013374400003890

in Bibtex Style

@conference{icaart25,
author={Ciprian Paduraru and Miruna Zavelca and Alin Stefanescu},
title={Agentic AI for Behavior-Driven Development Testing Using Large Language Models},
booktitle={Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART},
year={2025},
pages={805-815},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013374400003890},
isbn={978-989-758-737-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART
TI - Agentic AI for Behavior-Driven Development Testing Using Large Language Models
SN - 978-989-758-737-5
AU - Paduraru C.
AU - Zavelca M.
AU - Stefanescu A.
PY - 2025
SP - 805
EP - 815
DO - 10.5220/0013374400003890
PB - SciTePress