loading
Papers

Research.Publish.Connect.

Paper

Paper Unlock

Author: Alexandru E. Şuşu

Affiliation: EPFL, Switzerland

ISBN: 978-989-8425-00-3

Keyword(s): Wireless Sensor Nodes, Energy Harvesting, Constrained Markov Decision Processes, Multi-epoch Actions.

Related Ontology Subjects/Areas/Topics: Discrete Event Systems ; Environmental Monitoring and Control ; Informatics in Control, Automation and Robotics ; Intelligent Control Systems and Optimization ; Optimization Algorithms ; Signal Processing, Sensors, Systems Modeling and Control ; Time Series and System Modeling

Abstract: The controller of an environmentally powered wireless sensor node (WSN) seeks to maximize the quality of the data measurements and to communicate frequently with the network, while balancing the uncertain energy intake with the consumption. To devise such system manager we use the Markov Decision Process (MDP) optimization framework. However, our problem has physical characteristics that are not captured in the standard MDP model: namely, the radio interface takes a non-negligible amount of time to synchronize with the network before starting to transmit the acquired data, which translates into MDP actions spanning over multiple epochs. Optimizing without considering this multi-epoch actions requirement results in suboptimal MDP policies, which, under certain conditions described in the paper, waste on average 50% of the radio activity. Therefore, we incorporate this new constraint in the MDP formulation, and obtain an optimal policy that performs on average 83% better than a standard MDP policy. This solution outperforms also some heuristic policies we use for comparison by 14% and 154%. (More)

PDF ImageFull Text

Download
CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.227.249.234

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
E. Şuşu A. and (2010). STOCHASTIC OPTIMIZATION FOR ENVIRONMENTALLY POWERED WSNS USING MDP MODELS WITH MULTI-EPOCH ACTIONS.In Proceedings of the 7th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO, ISBN 978-989-8425-00-3, pages 238-243. DOI: 10.5220/0002940802380243

@conference{icinco10,
author={Alexandru {E. Şuşu}},
title={STOCHASTIC OPTIMIZATION FOR ENVIRONMENTALLY POWERED WSNS USING MDP MODELS WITH MULTI-EPOCH ACTIONS},
booktitle={Proceedings of the 7th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,},
year={2010},
pages={238-243},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002940802380243},
isbn={978-989-8425-00-3},
}

TY - CONF

JO - Proceedings of the 7th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,
TI - STOCHASTIC OPTIMIZATION FOR ENVIRONMENTALLY POWERED WSNS USING MDP MODELS WITH MULTI-EPOCH ACTIONS
SN - 978-989-8425-00-3
AU - E. Şuşu, A.
PY - 2010
SP - 238
EP - 243
DO - 10.5220/0002940802380243

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.