A MULTI-AGENT BASED FRAMEWORK FOR SUPPORTING LEARNING IN ADAPTIVE AUTOMATED NEGOTIATION

Rômulo Oliveira, Herman Gomes, Alan Silva, Ig Bittencourt, Evandro Costa

Abstract

We propose a multi-agent based framework for supporting adaptive bilateral automated negotiation during buyer-seller agent interactions. In this work, these interactions are viewed as a cooperative game (from the idea of two-person game theory, nonzerosum game), where the players try to reach an agreement about a certain negotiation object that is offered by one player to another. The final agreement is assumed to be satisfactory to both parts. To achieve effectively this goal, we modelled each player as a multi-agent system with its respective environment. In doing so, we aim at providing an effective means to collect relevant information to help agents to make good decisions, that is, how to choose the “best way to play” among a set of alternatives. Then we define a mechanism to model the opponent player and other mechanisms for monitoring relevant variables from the player´ environment. Also, we maintain the context of the current game and keep the most relevant information of previous games. Additionally, we integrate all the information to be used in the refinement of the game strategies governing the multi-agent system.

References

  1. Bartolini, C., Preist, C., and Jennings, N. R. (2004). A Software Framework for Automated Negotiation. In Choren, R., Garcia, A., Lucena, C., and Romanovsky, A., editors, Software Engineering for Large-Scale Multi-Agent Systems, volume 3390 of Lecture Notes in Computer Science, pages 213-235. Springer-Verlag.
  2. Bianchi, R. A. C., Ribeiro, C. H. C., and Costa, A. H. R. (2004). Heuristically accelerated q-learning: A new approach to speed up reinforcement learning. In Bazzan, A. L. C. and Labidi, S., editors, 17th Brazilian Symposium on Artificial Intelligence, volume 3171 of Lecture Notes in Computer Science, pages 245-254. Springer.
  3. Debenham, J. K. (2003). An eNegotiation Framework. In Australian Conference on Artificial Intelligence, pages 833-846.
  4. Faratin, P., Sierra, C., and Jennings, N. R. (2002). Using Similarity Criteria to Make Issue Trade-offs in Automated Negotiations. Artificial Intelligence, 142(2):205-237.
  5. Fatima, S. S., Wooldridge, M., and Jennings, N. R. (2004). An Agenda Based Framework for Multi-issues Negotiation. Artificial Intelligence, 152(1):1-45.
  6. Filho, R. R. G. N. and Costa, E. B. (2003). A DecisionMaking Model to Support Negotiation in Electronic Commerce. In 3rd International Interdisciplinary Conference on Electronic Commerce (ECOM-03), pages 16-18, Gdansk, Poland.
  7. Jennings, N. R., Faratin, P., Lomuscio, A. R., Parsons, S., Wooldridge, M., and Sierra, C. (2001). Automated Negotiation: Prospects Methods and Challenges. Group Decision and Negotiation, 10(2):199- 215.
  8. Klein, M., Faratin, P., Sayama, H., and Bar-Yam, Y. (2003). Protocols for Negotiating Complex Contracts. IEEE Intelligent Systems, 18(6):32-38.
  9. Narayanan, V. and Jennings, N. R. (2005). An adaptive bilateral negotiation model for e-commerce settings. In Seventh IEEE International Conference on E-Commerce Technology.
  10. Sardinha, J. A. R. P., Milidiú, R. L., Paranhos, P. M., Cunha, P. M., and de Lucena, C. J. P. (2005). An Agent Based Architecture for Highly Competitive Electronic Markets. In Russell, I. and Markov, Z., editors, FLAIRS Conference, pages 326-332. AAAI Press.
  11. Wong, W. Y., Zhang, D. M., and Kara-Ali, M. (2000). Negotiating With Experience. In CSIRO Mathematical and Information Sciences.
  12. Zeng, D. and Sycara, K. (1997). Benefits of Learning in Negotiation. In Proceedings of the 14th National Conference on Artificial Intelligence and 9th Innovative Applications of Artificial Intelligence Conference (AAAI97/IAAI-97), pages 36-42, Menlo Park. AAAI Press.
  13. Zhang, S., Ye, S., Makedon, F., and Ford, J. (2004). A Hybrid Negotiation Strategy Mechanism in an Automated Negotiation System. In Breese, J. S., Feigenbaum, J., and Seltzer, M. I., editors, EC 7804: Proceedings of the 5th ACM conference on Electronic commerce, pages 256-257, New York, NY, USA. ACM Press.
Download


Paper Citation


in Harvard Style

Oliveira R., Gomes H., Silva A., Bittencourt I. and Costa E. (2006). A MULTI-AGENT BASED FRAMEWORK FOR SUPPORTING LEARNING IN ADAPTIVE AUTOMATED NEGOTIATION . In Proceedings of the Eighth International Conference on Enterprise Information Systems - Volume 4: ICEIS, ISBN 978-972-8865-44-3, pages 153-158. DOI: 10.5220/0002452601530158


in Bibtex Style

@conference{iceis06,
author={Rômulo Oliveira and Herman Gomes and Alan Silva and Ig Bittencourt and Evandro Costa},
title={A MULTI-AGENT BASED FRAMEWORK FOR SUPPORTING LEARNING IN ADAPTIVE AUTOMATED NEGOTIATION},
booktitle={Proceedings of the Eighth International Conference on Enterprise Information Systems - Volume 4: ICEIS,},
year={2006},
pages={153-158},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002452601530158},
isbn={978-972-8865-44-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Eighth International Conference on Enterprise Information Systems - Volume 4: ICEIS,
TI - A MULTI-AGENT BASED FRAMEWORK FOR SUPPORTING LEARNING IN ADAPTIVE AUTOMATED NEGOTIATION
SN - 978-972-8865-44-3
AU - Oliveira R.
AU - Gomes H.
AU - Silva A.
AU - Bittencourt I.
AU - Costa E.
PY - 2006
SP - 153
EP - 158
DO - 10.5220/0002452601530158