Risk-aware Planning in BDI Agents

Ronan Killough, Kim Bauters, Kevin McAreavey, Weiru Liu, Jun Hong

2016

Abstract

The ability of an autonomous agent to select rational actions is vital in enabling it to achieve its goals. To do so effectively in a high-stakes setting, the agent must be capable of considering the risk and potential reward of both immediate and future actions. In this paper we provide a novel method for calculating risk alongside utility in online planning algorithms. We integrate such a risk-aware planner with a BDI agent, allowing us to build agents that can set their risk aversion levels dynamically based on their changing beliefs about the environment. To guide the design of a risk-aware agent we propose a number of principles which such an agent should adhere to and show how our proposed framework satisfies these principles. Finally, we evaluate our approach and demonstrate that a dynamically risk-averse agent is capable of achieving a higher success rate than an agent that ignores risk, while obtaining a higher utility than an agent with a static risk attitude.

References

  1. Auer, P., Cesa-Bianchi, N., and Fischer, P. (2002). Finitetime analysis of the multiarmed bandit problem. ML, 47(2-3):235-256.
  2. Bauters, K., Liu, W., Hong, J., Sierra, C., and Godo, L. (2014). CAN(PLAN)+: Extending the operational semantics of the BDI architecture to deal with uncertain information. In Proc. of UAI'14, pages 52-61.
  3. Bratman, M. (1987). Intention, Plans, and Practical Reason. Harvard University Press.
  4. Browne, C. B., Powley, E., Whitehouse, D., Lucas, S. M., Cowling, P. I., Rohlfshagen, P., Tavener, S., Perez, D., Samothrakis, S., and Colton, S. (2012). A survey of Monte Carlo tree search methods. IEEE Transactions on comp. intell. and AI in games, 4(1):1-43.
  5. Chen, Y., Bauters, K., Liu, W., Hong, J., McAreavey, K., Sierra, C., and Godo, L. (2014). AgentSpeak+: AgentSpeak with probabilistic planning. In Proc. of CIMA'14, pages 15-20.
  6. Dastani, M. (2008). 2APL: a practical agent programming language. JAAMAS, 16(3).
  7. Galichet, N., Sebag, M., and Teytaud, O. (2014). Exploration vs exploitation vs safety: Risk-averse multiarmed bandits. JMLR: Workshop and Conference Proceedings, 29:245-260.
  8. Johansen, I. L. and Rausand, M. (2014). Foundations and choice of risk metrics. Safety science, 62:386-399.
  9. Keller, T. and Eyerich, P. (2012). PROST: Probabilistic planning based on UCT. In Proc. of ICAPS.
  10. Kocsis, L. and Szepesvári, C. (2006). Bandit based MonteCarlo planning. In Proc. of ECML'06, pages 282-293.
  11. Liu, Y. and Koenig, S. (2008). An exact algorithm for solving MDPs under risk-sensitive planning objectives with one-switch utility functions. In Proc. of AAMAS'08, pages 453-460.
  12. Rao, A. S. (1996). AgentSpeak (L): BDI agents speak out in a logical computable language. In Agents Breaking Away, pages 42-55. Springer.
  13. Rao, A. S. and Georgeff, M. P. (1991). Modeling rational agents within a BDI-architecture. KR, 91:473-484.
  14. Sardina, S., de Silva, L., and Padgham, L. (2006). Hierarchical planning in BDI agent programming languages: A formal approach. In Proc. of AAMAS'06, pages 1001-1008.
  15. Welford, B. (1962). Note on a method for calculating corrected sums of squares and products. Technometrics, 4(3):419-420.
Download


Paper Citation


in Harvard Style

Killough R., Bauters K., McAreavey K., Liu W. and Hong J. (2016). Risk-aware Planning in BDI Agents . In Proceedings of the 8th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-172-4, pages 322-329. DOI: 10.5220/0005703103220329


in Bibtex Style

@conference{icaart16,
author={Ronan Killough and Kim Bauters and Kevin McAreavey and Weiru Liu and Jun Hong},
title={Risk-aware Planning in BDI Agents},
booktitle={Proceedings of the 8th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2016},
pages={322-329},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005703103220329},
isbn={978-989-758-172-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 8th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - Risk-aware Planning in BDI Agents
SN - 978-989-758-172-4
AU - Killough R.
AU - Bauters K.
AU - McAreavey K.
AU - Liu W.
AU - Hong J.
PY - 2016
SP - 322
EP - 329
DO - 10.5220/0005703103220329