
more sophisticated multi-robot applications, paving
the way for broader adoption in both industrial and
research settings.
REFERENCES
Elfakharany, A. and Ismail, Z. H. (2021). End-to-end deep
reinforcement learning for decentralized task alloca-
tion and navigation for a multi-robot system. Applied
Sciences, 11(7).
Hong, L., Cui, W., and Chen, H. (2021). A novel multi-
robot task allocation model in marine plastics clean-
ing based on replicator dynamics. Journal of Marine
Science and Engineering, 9(8).
Hu, J., Lennox, B., and Arvin, F. (2021). Collaborative cov-
erage for a network of vacuum cleaner robots. In An-
nual Conference Towards Autonomous Robotic Sys-
tems, pages 112–115. Springer.
Jeon, S., Jang, M., Lee, D., Cho, Y.-J., and Lee, J. (2015).
Multiple robots task allocation for cleaning a large
public space. In 2015 SAI Intelligent Systems Con-
ference (IntelliSys), pages 315–319.
Le, C. P., Pham, A. Q., La, H. M., and Feil-Seifer, D.
(2020). A multi-robotic system for environmental dirt
cleaning. In 2020 IEEE/SICE International Sympo-
sium on System Integration (SII), pages 1294–1299.
Le, C. P., Pham, H. X., and La, H. M. (2018). A multi-
robotic system for environmental cleaning. ArXiv,
abs/1811.00690.
Macenski, S. (2019). On use of slam toolbox, a fresh(er)
look at mapping and localization for the dynamic
world. In Proceedings of ROSCon 2019.
Macenski, S. and Jambrecic, I. (2021). Slam toolbox: Slam
for the dynamic world. Journal of Open Source Soft-
ware, 6(61):2783.
Macenski, S., Mart
´
ın, F., White, R., and Gin
´
es Clavero, J.
(2020). The marathon 2: A navigation system. In
2020 IEEE/RSJ International Conference on Intelli-
gent Robots and Systems (IROS).
Ni, J., Gu, Y., Tang, G., Ke, C., and Gu, Y. (2024). Cooper-
ative coverage path planning for multi-mobile robots
based on improved k-means clustering and deep rein-
forcement learning. Electronics, 13(5).
Orr, J. and Dutta, A. (2023). Multi-agent deep reinforce-
ment learning for multi-robot applications: A survey.
Sensors, 23(7).
Park, B., Kang, C., and Choi, J. (2022). Cooperative multi-
robot task allocation with reinforcement learning. Ap-
plied Sciences, 12(1).
Wang, Y., Hernandez, A., Shen, L., and Zhang, H. (2024).
Path planning of water surface garbage cleaning robot
based on improved immune particle swarm algorithm.
AIP Advances, 14(2).
Wang, Y., Hong, X., Ma, Z., Ma, T., Qin, B., and Su, Z.
(2023). Towards practical multi-robot hybrid tasks
allocation for autonomous cleaning. arXiv preprint
arXiv:2303.06531.
APPENDIX A
Simulated Annealing
Simulated Annealing (SA) is an optimization algo-
rithm that navigates the solution space by allowing
both upward and downward adjustments, helping es-
cape local minima and move toward a global solution.
It gradually reduces a ”temperature” parameter to bal-
ance exploration and refinement, making it effective
for complex problems.
Cooling Rate: The cooling rate (α) is defined as
T
new
= α · T
old
, where it controls the rate of temper-
ature decrease. Its value varies between 0 and 1. A
higher α (closer to 1) promotes broader exploration,
reducing the risk of getting trapped in local minima,
while a lower α focuses on refining the current so-
lution but risks suboptimal outcomes. Proper tuning
ensures an optimal balance between exploration and
exploitation. The employed algorithm is given in Al-
gorithm 3.
Data: Initial temperature T
0
, Cooling rate r
Result: Best solution and Cost
Initialize T ← T
0
, random P matrix,
current cost ← cost of P matrix
best cost ← current cost,
best solution ← P matrix
while T > T
s
do
for i ← 1 to L
k
do
Apply a random operation: swap(),
invert(), or move(); Compute ∆ ←
cost change
if ∆ < 0 or random() < exp(−∆/T )
then
Update current solution,
current cost
if current cost < best cost then
Update best solution,
best cost
end
end
end
T ← T · r
end
return best solution,best cost
Algorithm 3: Simulated Annealing (SA).
APPENDIX B
Particle Swarm Optimization
Particle Swarm Optimization (PSO) is a collabora-
tive optimization algorithm where a swarm of parti-
Comparative Analysis of Simulated Annealing and Particle Swarm Optimization for Multi-Robot Task Allocation in ROS
487