Silvano Cincotti, Giulia Gallo


The paper presents an agent-based framework for modeling and simulating power exchanges, the Genoa Artificial Power Exchange (GAPEX). The framework is implemented in MATLAB using the OOP paradigm, which allows one to define classes using a Java/C++ like syntax. GAPEX allows creation of artificial power exchanges where what-if analysis can be performed. GAPEX also reproduces exactly the market clearing procedure (e.g. by calculating Locational Marginal Prices based on the Italian high-voltage transmission network with its zonal subdivision) and the generation plants modeled are in direct correspondence with the real ones. Moreover, the presence of affine total cost functions for the generation plants results in payoff either positive, negative and null. This has major implications as negative reward are not generally considered by reinforcement learning algorithms. In order to overcome such limitation, an enhanced version of the Roth-Erev algorithm (i.e., that takes into account also negative payoffs) is presented and discussed. Results point out effectiveness of the proposed enhanced learning algorithm. Moreover, computational experiments performed within GAPEX point out a close agreement with historical real market data during both peak- and off-peak load hours thus confirming the direct applicability of GAPEX to model and to simulate power exchanges.


  1. Bagnall, A. and Smith, G. (2005). A multi-agent model of the uk market in electricity generation. IEEE Transactions on Evolutionary Computation 9 (5), pages 522- 536.
  2. Ball, P. (2010). The earth simulator. New Scientist, 2784:48-51.
  3. Bower, J. and Bunn, D. W. (2001). Experimental analysis of the efficiency of uniform-price versus discriminatory auctions in the england and wales electricity market.
  4. Journal of Economic Dynamics & Control, 25:561- 592.
  5. Bunn, D. W. and Oliveira, F. (2001). Agent-based simulation: an application to the new electricity trading arrangements of england and wales. IEEE Transactions on Evolutionary Computation,, 5(5):493-503. Special issue: Agent Based Computational Economics.
  6. Camerer, C. and Ho, T. (1999). Experience-weighted attraction learning in normal-form games. Econometrica, 67:827-74.
  7. Cau, T. D. H. and Anderson, E. J. (2002). A co-evolutionary approach to modelling the behaviour of participants in competitive electricity markets. IEEE Power Engineering Society Summer Meeting, 3:1534-1540.
  8. Cincotti, S., Guerci, E., and Raberto, M. (2005). Agentbased simulation of power exchange with heterogeneous production companies. Computing in Economics and Finance 2005, Society for Computational Economics, 334.
  9. Gestore, dei, Mercati, and getici (2010a). Official web
  10. Gestore, del, Mercati, and Energetici (2010b). Uppo auction module user manual, appendix a - market splitting auction algorithm). Technical report, GME.
  11. Gode, D. D. K. and Sunder, S. (2004). Double auction dynamics: structural effects of non-binding price controls. Journal of Economic Dynamics and Control, 28(9):1707-1731.
  12. Gode, D. K. and Sunder, S. (1993). Allocative efficiency of markets with zero intelligence traders. market as a partial substitute for individual rationality. J Polit Econ, 101(1):119-137.
  13. Guerci, E., Ivaldi, S., Raberto, M., and Cincotti, S. (2007). Learning oligopolistic competition in electricity auctions. Computational Intelligence, 23(2):197-220.
  14. Guerci, E., Rastegar, M., and Cincotti, S. (2010). Agentbased modeling and simulation of competitive wholesale electricity markets. Handbook of Power Systems, 3(2):241-286.
  15. Jing, Z., Ngan, H., Wang, Y., Zhang, Y., and Wang, J. (2009). Study on the convergence property of rotherev learning model in electricity market simulation. In Advances in Power System Control, Operation and Management (APSCOM 2009), 8th International Conference on, pages 1 -5.
  16. Kirschen, D. S. and Strbac, G. (2004). Fundamentals of Power System Economics. Wiley.
  17. Migliavacca, G. (2007). Srems: a short-medium run electricity market simulator based on game theory and incorporating network constraints. In Power Tech, 2007 IEEE Lausanne, Switzerland, pages 813-818.
  18. Nicolaisen, J., Petrov, V., and Tesfatsion, L. (2001). Market power and efficiency in a computational electricity market with discriminatory double-auction pricing. IEEE Transactions on Evolutionary Computation, 5(5):504-523.
  19. Nicolaisen, J., Smith, M., Petrov, V., and Tesfatsion, L. (2000). Concentration and capacity effects on electricity market power. In Proceedings of the 2000 Congress on Evolutionary Computation, La Jolla, USA,, volume 2, pages 1041-1047.
  20. Rastegar, M., Guerci, E., and Cincotti, S. (2009). Agentbased model of the Italian wholesale electricity market. In Proceedings of the 6th International Conference on the European Energy Market EEM 09.
  21. Roth, A. E. and Erev, I. (1995). Learning in extensive form games: Experimental data and simple dynamic models in the intermediate term. Games Econ Behav, 8(1):164-212.
  22. Ruperez Micola, A., Banal Estaol, A., and Bunn, D. W. (2008). Incentives and coordination in vertically related energy markets. Journal of Economic Behavior and Organization, 67:381-393.
  23. Sun, J. and Tesfatsion, L. (2007). Dynamic testing of wholesale power market designs: An open-source agent-based framework. Comput Econ, 30:291-327.
  24. TERNA S.p.A. (2008). Individuazione della rete rilevante - italian version only. Technical report, TERNA S.p.A.
  25. Watkins, C. and Dayan, P. (1992). Q-learning. Machine Learning, 8(3-4):279-292.
  26. Weidlich, A. and Veit, D. J. (2006). Bidding in interrelated day-ahead electricity markets: Insights from an agentbased simulation model. In Proceedings of the 29th IAEE International Conference, Potsdam.
  27. Weidlich, A. and Veit, D. J. (2008a). Analyzing interrelated markets in the electricity sector - the case of wholesale power trading in Germany. IEEE Power Engineering Society General Meeting, pages 1-8.
  28. Weidlich, A. and Veit, D. J. (2008b). A critical survey of agent-based wholesale electricity market models. Energy Economics, 30:1728-1759.

Paper Citation

in Harvard Style

Cincotti S. and Gallo G. (2012). GAPEX: AN AGENT-BASED FRAMEWORK FOR POWER EXCHANGE MODELING AND SIMULATION . In Proceedings of the 4th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-8425-96-6, pages 33-43. DOI: 10.5220/0003740300330043

in Bibtex Style

author={Silvano Cincotti and Giulia Gallo},
booktitle={Proceedings of the 4th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},

in EndNote Style

JO - Proceedings of the 4th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
SN - 978-989-8425-96-6
AU - Cincotti S.
AU - Gallo G.
PY - 2012
SP - 33
EP - 43
DO - 10.5220/0003740300330043