ADAPTIVE RESOURCES CONSUMPTION IN A DYNAMIC AND UNCERTAIN ENVIRONMENT - An Autonomous Rover Control Technique using Progressive Processing

Simon Le Gloannec, Abdel Illah Mouaddib, François Charpillet

2008

Abstract

This paper address the problem of an autonomous rover that have limited consumable resources to accomplish a mission. The robot has to cope with limited resources: it must decide the resource among to spent at each mission step. The resource consumption is also uncertain. Progressive processing is a meta level reasoning model particulary adapted for this kind of mission. Previous works have shown how to obtain an optimal resource consumption policy using a Markov decision process (MDP). Here, we make the assumption that the mission can dynamically change during execution time. Therefore, the agent must adapt to the current situation, in order to save resources for the most interesting future tasks. Because of the dynamic environment, the agent cannot calculate a new optimal policy online. However, it is possible to compute an approximate value function. We will show that the robot will behave as good as if it knew the optimal policy.

References

  1. Arnt, A., Zilberstein, S., Allan, J., and Mouaddib, A. (2004). Dynamic composition of information retrieval techniques. Journal of Intelligent Information Systems, 23(1):67-97.
  2. Dean, T. and Lin, S. H. (1995). Decomposition techniques for planning in stochastic domains. In proceedings of the 14th International Joint Conference on Artificial Intelligence (IJCAI), pages 1121-1127, Montreal, Quebec, Canada.
  3. Feng, Z., Dearden, R., Meuleau, N., and Washington, R. (2004). Dynamic programming for structured continuous markov decision problems. In proceedings of UAI 2004, pages 154-161.
  4. Meuleau, N., Hauskrecht, M., Kim, K., Peshkin, L., Kealbling, L., Dean, T., and Boutilier, C. (1998). Solving very large weakly coupled markov decision processes. In proceedings of the 14th Conference on Uncertainty in Artificial Intelligence, Madison, WI.
  5. Mouaddib, A. I. and Zilberstein, S. (1998). Optimal scheduling for dynamic progressive processing. In proceedings of ECAI, pages 499-503.
  6. Parr, R. (1998). Flexible decomposition algorithms for weakly coupled markov decision process. In proceedings of the 14th Conference on Uncertainty in Artificial Intelligence, Madison, WI.
  7. Pineau, J., Gordon, G. J., and Thrun, S. (2003). Point-based value iteration: An anytime algorithm for pomdps. In proceedings of the 18th International Joint Conference on Artificial Intelligence IJCAI, pages 1025- 1032.
  8. Zilberstein, S., Washington, R., Berstein, D., and Mouaddib, A. (2002). Decision-theoretic control of planetary rovers. LNAI, 2466(1):270-289.
Download


Paper Citation


in Harvard Style

Le Gloannec S., Illah Mouaddib A. and Charpillet F. (2008). ADAPTIVE RESOURCES CONSUMPTION IN A DYNAMIC AND UNCERTAIN ENVIRONMENT - An Autonomous Rover Control Technique using Progressive Processing . In Proceedings of the Fifth International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO, ISBN 978-989-8111-30-2, pages 200-206. DOI: 10.5220/0001492802000206


in Bibtex Style

@conference{icinco08,
author={Simon Le Gloannec and Abdel Illah Mouaddib and François Charpillet},
title={ADAPTIVE RESOURCES CONSUMPTION IN A DYNAMIC AND UNCERTAIN ENVIRONMENT - An Autonomous Rover Control Technique using Progressive Processing},
booktitle={Proceedings of the Fifth International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,},
year={2008},
pages={200-206},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001492802000206},
isbn={978-989-8111-30-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Fifth International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,
TI - ADAPTIVE RESOURCES CONSUMPTION IN A DYNAMIC AND UNCERTAIN ENVIRONMENT - An Autonomous Rover Control Technique using Progressive Processing
SN - 978-989-8111-30-2
AU - Le Gloannec S.
AU - Illah Mouaddib A.
AU - Charpillet F.
PY - 2008
SP - 200
EP - 206
DO - 10.5220/0001492802000206