Cooperative Area Extension of PSO - Transfer Learning vs. Uncertainty in a Simulated Swarm Robotics

Adham Atyabi, David M. W. Powers

Abstract

The study investigates the effectiveness of 2 variations of Particle Swarm Optimization (PSO) called Area Extended PSO (AEPSO) and Cooperative AEPSO (CAEPSO) in simulated robotic environments affected by a combinatorial noise. Knowledge Transfer, the use of the expertise and knowledge gained from previous experiments, can improve the robots decision making and reduce the number of wrong decisions in such uncertain environments. This study investigates the impact of transfer learning on robots’ performance in such hostile environment. The results highlight the feasibility of CAEPSO to be used as the controller and decision maker of a swarm of robots in the simulated uncertain environment when gained expertise from past training is transferred to the robots in the testing phase.

References

  1. Atyabi, A. (2009). Navigating agents in uncertain environments using particle swarm optimization. In MSc Thesis. Multimedia university of Malaysia.
  2. Atyabi, A., Amnuaisuk, S. P., and Ho, C. K. (2010). Navigating a robotic swarm in an uncharted 2d landscape. In Appl. Soft Comput, pages 149-169. Elsevier.
  3. Atyabi, A. and Samadzadegan, S. (2011). Particle swarm optimization: A survey. In In Louis P. Walters, ed. Applications of Swarm Intelligence. Hauppauge, USA: Nova Publishers, pages 167-178.
  4. Grosan, C., Abraham, A., and Chis, M. (2006). Swarm intelligence in data mining. In Springer, studies in computational intelligence (SCI), pages 34:1-20.
  5. Jakob, S. V. and Jacques, R. (2002). Particle swarms extensions for improved local, multi-modal, and dynamic search in numerical optimization. In MS.c Thesis, Dept. Computer Science, Univ Aarhus, Aarhus C, DenmarK.
  6. Jim, P. and Martinoli, A. (2007). Inspiring and modeling multi-robot search with particle swarm optimization. In Proceeding of the 2007 IEEE Swarm Intelligence Symposium (SIS2007).
  7. Kennedy, J. and Eberhart, R. (1995). Particle swarm optimization. In IEEE Press Proceedings of the 1995 IEEE International Conference on Neural Networks, pages 1942-1948.
  8. Majid, N. A., Masoud, A., and Eiji, N. (2001). Cooperative q-learning: the knowledge sharing issue. In Advanced Robotics, pages 15(8): 815 - 832.
  9. Mauris, C. (2002). The particle swarm - explosion, stability, and convergence in multidimensional complex space. In IEEE Transaction on Evolutionary.
  10. Park, K. H., Kim, Y. J., and Kim, J. H. (2001). Modular q-learning based multi-agent cooperation for robot soccer. In Robotics and Autonomous Systems, pages 34:109-122.
  11. Peter, J. A. (1998). Evolutionary optimization versus particle swarm optimization: Philosophy and performance differences. In Evolutionary Programming VII, Lecture Notes in Computer Science, Springer.
  12. Sousa, T., Neves, A., and Silva, A. (2004). Particle swarm based data mining algorithms for classification tasks. In IEEE Parallel and nature-inspired computational paradigms and applications, pages 30:767-783.
  13. Suranga, H. (2006). Distributed online evolution for swarm robotics. In Autonomous Agents and Multi Agent Systems.
  14. Tangamchit, P., Dolan, J. M., and Khosla, P. K. (2003). Crucial factors affecting cooperative multi-robot learning. In Proceeding of the 2003 IEEE/RSJ Intl conference on intelligent Robots and Systems, Las Vegas, Nevada, pages 2:2023-2028.
  15. Yang, E. and Gu, D. (2004). Multi-agent reinforcement learning for multi-robot systems: A survey. In Technical report, University of Essex Technical Report CSM404, Department of Computer Science.
Download


Paper Citation


in Harvard Style

Atyabi A. and M. W. Powers D. (2013). Cooperative Area Extension of PSO - Transfer Learning vs. Uncertainty in a Simulated Swarm Robotics . In Proceedings of the 10th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO, ISBN 978-989-8565-70-9, pages 177-184. DOI: 10.5220/0004456901770184


in Bibtex Style

@conference{icinco13,
author={Adham Atyabi and David M. W. Powers},
title={Cooperative Area Extension of PSO - Transfer Learning vs. Uncertainty in a Simulated Swarm Robotics},
booktitle={Proceedings of the 10th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,},
year={2013},
pages={177-184},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004456901770184},
isbn={978-989-8565-70-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,
TI - Cooperative Area Extension of PSO - Transfer Learning vs. Uncertainty in a Simulated Swarm Robotics
SN - 978-989-8565-70-9
AU - Atyabi A.
AU - M. W. Powers D.
PY - 2013
SP - 177
EP - 184
DO - 10.5220/0004456901770184