Q-Learning Based LQR Occupant-Centric Control of Non-Residential Buildings

Oumaima Ait-Essi, Joseph Yamé, Hicham Jamouli, Frédéric Hamelin

2024

Abstract

We propose a novel approach to the control of variable-air-volume (VAV)-HVAC systems for the regulation of thermal comfort in rooms of a non-residential building where the number of occupants may vary considerably and randomly during the day. Specifically, we develop a reinforcement learning control algorithm based on model-free optimal linear quadratic control. We leverage the quality function, the so-called Q-function, derived from Bellman dynamic programming, to develop a learning control algorithm based solely on system-generated data including building dynamics and its occupants. Simulations are carried out on a new HVAC-VAV system installed in a building at the University of Lorraine, demonstrating the potential of the proposed method for maintaining climatic conditions and the comfort of room occupants while optimizing the airflow demand of VAV boxes, which is correlated with the energy consumed per room.

Paper Citation

in Harvard Style

Ait-Essi O., Yamé J., Jamouli H. and Hamelin F. (2024). Q-Learning Based LQR Occupant-Centric Control of Non-Residential Buildings. In Proceedings of the 21st International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO; ISBN 978-989-758-717-7, SciTePress, pages 494-502. DOI: 10.5220/0013066800003822

in Bibtex Style

@conference{icinco24,
author={Oumaima Ait-Essi and Joseph Yamé and Hicham Jamouli and Frédéric Hamelin},
title={Q-Learning Based LQR Occupant-Centric Control of Non-Residential Buildings},
booktitle={Proceedings of the 21st International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO},
year={2024},
pages={494-502},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013066800003822},
isbn={978-989-758-717-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 21st International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO
TI - Q-Learning Based LQR Occupant-Centric Control of Non-Residential Buildings
SN - 978-989-758-717-7
AU - Ait-Essi O.
AU - Yamé J.
AU - Jamouli H.
AU - Hamelin F.
PY - 2024
SP - 494
EP - 502
DO - 10.5220/0013066800003822
PB - SciTePress