COALITION FORMATION WITH UNCERTAIN TASK EXECUTION

Hosam Hanna

2006

Abstract

We address the problem of coalition formation in environments where tasks’ executions are uncertain. Although previous works provide good solutions for coalition formation problem, the uncertain task execution problem is not taken into account. In environments where task execution is uncertain, an agent can’t be sure whether he will be able to execute all the subtasks that are allocated to him or he will ignore some of them. That is why forming coalition to maximize the real reward is an unrealizable operation. In this paper, we propose a theoretical approach to form coalition with uncertain task execution. We view the formation of a coalition to execute a task as (1) a decision to make and (2) as an uncertain source of gain. We associate then the allocation of a task to a coalition with an expected reward that represents what agents expect to gain by forming this coalition to execute this task. Also, the agents’ aim is to form coalition to maximize the expected reward instead of the real reward. To reach this objective, we formalize the coalition formation problem by a Markov Decision Process (MDP). We consider the situation where decisions are taken by one agent that develops and solves the corresponding MDP. An optimal coalition formation which maximizes the agents’ expected reward is then obtained.

References

  1. Aumann, R. (1959). Acceptable points in general cooperative n-person games. volume IV of Contributions to the Theory of Games. Princeton University Press.
  2. Bellman, R. E. (1957). A markov decision process. journal of Mathematical Mechanics, pages 6:679-684.
  3. Bernheim, B., Peleg, B., and Whinson, M. (1987). Coalition-proof nash equilibria: I concepts. Journal of Economic Theory, 42(1):1-12.
  4. Blankenburg, B. and Klusch, M. (2004). On safe kernel stable coalition formation among agents. In Proceedings of International Joint conference on Autonomous Agents & Multi-Agent Systems, AAMAS04.
  5. Blankenburg, B., Klusch, M., and Shehory, O. (2003). Fuzzy kernel-stable coalition formation between rational agents. In Proceedings of International Joint conference on Autonomous Agents & Multi-Agent Systems, AAMAS03.
  6. Chalkiadakis, G. and Boutilier, C. (2004). Bayesian reinforcement learning for coalition formation under uncertainty. In Proceedings of International Joint conference on Autonomous Agents & Multi-Agent Systems, AAMAS04.
  7. Kahan, J. and Rapoport, A. (1984). Theories of Coalition Formation. Lawrence Erlbaum Associations Publishers.
  8. Ketchpel, S. (1994). Forming coalition in the face of uncertain rewards. In Proceedings of AAAI, pages 414-419.
  9. Klusch, M. and Shehory, O. (1996). A polynomial kerneloriented coalition formation algorithm for rational information agents. In Proceedings of ICMAS, pages 157-164.
  10. Kraus, S., Shehory, O., and Taase, G. (2003). Coalition formation with uncertain heterogeneous information. In Proceedings of the Second International Joint conference on Autonomous Agents and Multi-Agent Systems, AAMAS03, Australia.
  11. Kraus, S., Shehory, O., and Taase, G. (2004). The advantages of compromising in coalition formation with incomplete information. In Proceedings of International Joint conference on Autonomous Agents & Multi-Agent Systems, AAMAS04.
  12. Learman, K. and Shehory, O. (2000). Coalition formation for large-scale electronic markets. In Proceedings of the Fourth International Conference on Multiagent Systems.
  13. Papoulis, A. (1984). Signal Analysis. International student edition, McGraw Hill Book Company.
  14. Puterman, M. L. (1994). Markov Decision Processes. John Wiley & Sons, New York.
  15. Shehory, O. and Kraus, S. (1998). Methods for task allocation via agent coalition formation. Artificial Intelligence, 101:165-200.
  16. Sutton, R. S. and Barto, A. G. (1998). Reinforcement Learning: An Introduction. MIT Press, Cambridge MA. ISBN 0-262-19398-1.
  17. Zlotkin, G. and Rosenschein, J. (1994). Coalition, cryptography, and stability: mechanisms for coalition formation in task orientd domains. In Proceedings of AAAI, pages 432-437.
Download


Paper Citation


in Harvard Style

Hanna H. (2006). COALITION FORMATION WITH UNCERTAIN TASK EXECUTION . In Proceedings of the Eighth International Conference on Enterprise Information Systems - Volume 2: ICEIS, ISBN 978-972-8865-42-9, pages 164-169. DOI: 10.5220/0002459601640169


in Bibtex Style

@conference{iceis06,
author={Hosam Hanna},
title={COALITION FORMATION WITH UNCERTAIN TASK EXECUTION},
booktitle={Proceedings of the Eighth International Conference on Enterprise Information Systems - Volume 2: ICEIS,},
year={2006},
pages={164-169},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002459601640169},
isbn={978-972-8865-42-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Eighth International Conference on Enterprise Information Systems - Volume 2: ICEIS,
TI - COALITION FORMATION WITH UNCERTAIN TASK EXECUTION
SN - 978-972-8865-42-9
AU - Hanna H.
PY - 2006
SP - 164
EP - 169
DO - 10.5220/0002459601640169