A Distributed PID-like Consensus Control for Discrete-time
Multi-agent Systems
Nicol
`
o Gionfra
1
, Guillaume Sandou
1
, Houria Siguerdidjane
1
and Damien Faille
2
1
Laboratoire des Signaux et Syst
`
emes (L2S), CentraleSup
´
elec, Universit
´
e Paris-Saclay, 3 rue Joliot Curie,
91192 Gif-sur-Yvette, France
2
EDF R&D, Department STEP, 6 quai Watier, 78401 Chatou, France
Keywords:
Multi-agent Systems, Consensus Control, Discrete-time LTI Systems.
Abstract:
The problem of discrete-time multi-agent systems governed by general MIMO dynamics is addressed. By
employing a PID-like distributed protocol, we aim to solve two relevant consensus problems, namely the lead-
erless consensus under disturbances and leader-follower under time-varying reference state ones. Sufficient
conditions for stability as well as two LMI approaches to tune the controller gains are provided. The latter are
either based on a H
formulation of the problem or on fast response to a reference exogenous signal. Numer-
ical simulations give some insight of which tuning should be considered according to the problem addressed.
1 INTRODUCTION
In recent years much research effort has been de-
voted to the area of multi-agent cooperative control
because of its wide range of applications and potential
benefits. Cooperation of a coordinated multi-agent
network is sought via distributed algorithms as they
present some interesting advantages over their cen-
tralized counterpart, e.g. avoiding single point of fail-
ure, reducing communication and computational bur-
den, etc. The main problem in distributed coordi-
nation, known as consensus problem, is the one of
achieving an agreement on some variables of interest
of each agent via local interactions. These variables
evolve according to a prescribed dynamics describing
the physics of the problem, while interactions among
agents are defined by a given communication graph.
Finding a distributed protocol to solve the aforemen-
tioned problem has been extensively treated for single
and double integrator dynamic agents, e.g. (Ren and
Beard, 2008). However, in a more general framework,
general dynamics need to be considered in order to
describe the agents behavior.
The consensus problem for this latter case has
been discussed for both continuous and discrete-time
multi-agent systems. In addition, it can be further di-
vided in two main classes of problems, namely lead-
erless and leader-follower ones. As far as the former
is concerned, the most employed distributed protocol
is given by a static state feedback law, also called P-
like distributed control. One can cite, for instance,
(Xi et al., 2010), (Li et al., 2013), (Yang-Zhou et al.,
2014) for the continuous-time framework, and (Li
et al., 2013), (You and Xie, 2011), (Su and Huang,
2012), (Ge et al., 2013) for the discrete one, where the
consensus problem is led back to the one of simulta-
neously stabilizing multiple LTI systems. References
(Li et al., 2013), and (Su and Huang, 2012) also solve
a leader-follower problem where the leader has an au-
tonomous time-invariant dynamics. Another interest-
ing problem is the one of finding the optimal P-like
protocol gain in order to improve consensus under
system uncertainties, as in (Li et al., 2012), and dis-
turbances as in (Oh et al., 2014), (Li et al., 2011), for
continuous time systems, and (Wang and Gao, 2011)
for discrete-time ones. The proposed approaches usu-
ally make use of some H
2
or H
constraints to be re-
spected, and they are in general more involved than
the one of simultaneously stabilizing multiple sys-
tems. For instance, (Li et al., 2011) provide neces-
sary and sufficient conditions, for the continuous-time
case to solve the consensus problem while guarantee-
ing some properties on the aforementioned norms. On
the other hand, for discrete-time systems only suffi-
cient conditions are provided using results from ro-
bust control as in (Wang and Gao, 2011). Dynamic
distributed controllers are also proposed for consen-
sus achievement based on local output measurements,
e.g. (Li et al., 2013). In the continuous-time frame-
work, (Xi et al., 2012) provide a controller with lim-
ited energy, while a general full order one is presented
72
Gionfra, N., Sandou, G., Siguerdidjane, H. and Faille, D.
A Distributed PID-like Consensus Control for Discrete-time Multi-agent Systems.
DOI: 10.5220/0006420500720081
In Proceedings of the 14th International Conference on Informatics in Control, Automation and Robotics (ICINCO 2017) - Volume 1, pages 72-81
ISBN: 978-989-758-263-9
Copyright © 2017 by SCITEPRESS Science and Technology Publications, Lda. All rights reserved
in (Liu et al., 2009) to achieve some H
performance.
Other possible structures have been explored too. In-
deed, given the common P-like controller, one can
easily think of a more general PID-like structure. In
continuous-time, for instance, (Carli et al., 2008) pro-
pose a PI-like distributed algorithm for single integra-
tor dynamic agents, and (Ou et al., 2014) provide a
PID-like controller for general high-order SISO sys-
tems. Similar control design is applied to solve a
leader-follower consensus under time-varying refer-
ence state, as in (Ren, 2007), and in its sampled-data
counterpart (Cao et al., 2009), where a PD-like proto-
col is given. Even though the presented literature re-
view is nowhere near exhaustive, one can remark that
poorer attention has been devoted to discrete-time dy-
namic protocols for general LTI MIMO systems, and
this is where we wish to place our contribution.
In this paper we propose a PID-like distributed
controller for the aforementioned systems, where the
agents can communicate on a connected undirected
graph, and we provide two possible ways of tuning
the controller parameters, based on the solution of
LMIs. To the best of our knowledge this distributed
control structure has never been fully treated for the
mentioned class of dynamic systems. The approach
we propose is used to solve two different problems,
namely the leaderless consensus under the presence
of disturbances, and the leader-follower consensus
under a time-varying reference state. Our main re-
sults are based on the work of (Wu et al., 2011),
which we adapted for distributed coordination pur-
poses. The fundamental feature of the aforesaid work
is that MIMO PID parameter tuning can be performed
via LMIs, avoiding in this way, the need for solving
BMIs. Furthermore, in both the analyzed consensus
problems the measurement matrix is kept general, al-
lowing a more general problem formulation for the
case in which the agents cannot directly measure the
variables on which agreement is sought. Eventually,
concerning the leaderless consensus, agreement can
be focused on particular variables of interest via a
proper selection of the controlled output matrix. As
for classic control, the PID controller allows good
performance despite being rather simple. Concerning
the leaderless consensus problem, for instance, it en-
hances the disturbance rejection, and achieves results
that a simple P-like protocol would not permit if the
dynamics of the agents are general. Similar conclu-
sions hold for the leader-follower consensus problem
with a time-varying reference state, where a P-like
control would undoubtedly reach lower performance.
The reminder of this paper is organized as follows.
In Section 2 some preliminaries on graph theory are
provided and the two main problems are stated. In
Section 3 we provide sufficient conditions to solve a
leaderless and a leader-follower consensus problem,
and we give an LMI approach to tune the distributed
PID controller gains. We carry out simulations to test
the effectiveness of the proposed controller in Sec-
tion 4. The paper ends with conclusions and future
perspectives in Section 5.
2 PRELIMINARIES AND
PROBLEM STATEMENT
2.1 Graph Theory
An undirected graph G is a pair (V , E), where V =
{
1, . . . , N
}
is the set of nodes, and E V × V is the
set of unordered pairs of nodes, named edges. Two
nodes i, j are said to be adjacent if (i, j) E. Un-
der the assumption of undirected graph, the latter im-
plies that ( j, i) E too. An undirected graph is con-
nected if there exists a path between every pair of dis-
tinct nodes, otherwise is disconnected. The adjacency
matrix A = [a
i j
] R
N×N
associated with the undi-
rected graph G, considered in this paper, is defined by
a
ii
= 0, i.e. self-loops are not allowed, and a
i j
= 1 if
(i, j) E. The Laplacian matrix L R
N×N
is defined
as L
ii
=
j6=i
a
i j
and L
i j
= a
i j
, i 6= j. Considering
an undirected graph we make use of the following
Lemma 1. (Ren et al., 2005) The Laplacian matrix
has the following properties: (i) L is symmetric and
all its eigenvalues are either strictly positive or equal
to 0, and 1 is the corresponding eigenvector to 0; (ii)
0 is a simple eigenvalue of L if and only if the graph
is connected.
We will also make use of another Laplacian matrix,
according to the following
Lemma 2. (Lin et al., 2008) Let
¯
L =
¯
l
i j
R
N×N
be
a Laplacian matrix such that
¯
l
i j
=
N 1
N
if i = j, and
¯
l
i j
=
1
N
otherwise, then the following hold: (i) the
eigenvalues of
¯
L are 1 with multiplicity N 1, and
0 with multiplicity 1. 1
>
and 1 are respectively the
left and right eigenvector associated to eigenvalue 0;
(ii) there exists an orthogonal matrix U R
N×N
, i.e.
U : U
>
U = UU
>
= I, such that for any Laplacian
matrix L associated to any undirected graph we have
U
>
¯
LU =
I
N1
0
(N1)×1
0
1×(N1)
0
,
¯
Λ,
U
>
LU =
L
1
0
(N1)×1
0
1×(N1)
0
A Distributed PID-like Consensus Control for Discrete-time Multi-agent Systems
73
where L
1
R
(N1)×(N1)
is symmetric and positive
definite if the graph is connected.
In addition we employ the Kronecker product , for
which we have
Lemma 3. (Graham, 1981) Suppose that U R
p×p
,
V R
q×q
, X R
p×p
, and Y R
q×q
. The following
hold: (i) (U V ) (X Y ) = UX VY ; (ii) suppose
U, and V invertible, then (U V )
1
= U
1
V
1
.
2.2 Problems Formulation
Problem 1. We consider N identical agents governed
by general discrete-time linear dynamics, according
to
x
+
i
= Ax
i
+ B
2
u
i
+ B
1
ω
i
, i = 1, ·· · , N
z
i
= C
1
x
i
y
i
= C
2
x
i
(1)
where A R
n×n
, B
2
R
n×l
, B
1
R
n×h
, C
1
R
r×n
,
C
2
R
m×n
, x
i
, x
i
(k) R
n
and x
+
i
, x
i
(k + 1) R
n
are respectively the agent state at the current step k,
and at the next step k +1, u
i
, u
i
(k) R
l
is the agent
control, ω
i
, ω
i
(k) R
h
its disturbance, z
i
, z
i
(k)
R
r
the variable on which agreement among the agents
is sought, and y
i
, y
i
(k) R
m
is the measured out-
put. For the sake of leaderless consensus, a priori
we do not require A to be Schur stable. Indeed, as
shown by (Ge et al., 2013), A has a role in determin-
ing the consensus function to which the agents con-
verge under proper control. Here it can be thought
to be assigned by a previous control design step. The
agents can communicate on an undirected connected
graph whose Laplacian matrix L has positive mini-
mum nonzero and maximum eigenvalues respectively
equal to λ
L
, and
¯
λ
L
. At this point, we can state the
problem in a general way as the one of finding a dis-
tributed control law for u
i
such that kz
i
z
j
k is min-
imized for i, j = 1, ··· , N with respect to the distur-
bance ω , [ω
>
1
, ··· , ω
>
N
]
>
. In this work though, as
previously stated, we focus on local controllers of the
form
(
x
+
c
i
= A
c
x
c
i
+ B
c
s
i
, i = 1, ·· · , N
u
i
= C
c
x
c
i
+ D
c
s
i
(2)
where x
c
i
, x
c
i
(k) R
2l
is the agent controller state,
and
A
c
=
I
l
I
l
0
l×l
0
l×l
2l×2l
B
c
=
(K
i
K
d
)
K
d
2l×m
C
c
=
I
l
0
l×l
l×2l
D
c
= [(K
p
+ K
i
+ K
d
)]
l×m
(3)
where K
p
, K
i
, K
d
R
l×m
are gain matrices to be
tuned, and where s
i
, s
i
(k) R
m
:
s
i
,
N
j=1
a
i j
(y
i
y
j
) (4)
Thus the closed-loop system for agent i has dimen-
sion ¯n , n + 2l. As shown by (Wu et al., 2011), sys-
tem (2) is a state representation of the discrete-time
PID MIMO controller, whose z-transform is
u
i
(z)
s
i
(z)
= K
p
+ K
i
z
z 1
+ K
d
z 1
z
The problem can now be restated as the one of finding
matrices B
c
, and D
c
such that the effect of disturbance
ω on the consensus is minimized.
The second problem studied in this paper is the
following
Problem 2. Consider N + 1 discrete-time linear
agents, whose dynamics are described by
x
+
0
= Ax
0
+ B
1
u
0
z
0
= C
1
x
0
y
0
= C
2
x
0
x
+
i
= Ax
i
+ B
2
u
i
, i = 1, ·· · , N
z
i
= C
1
x
i
y
i
= C
2
x
i
(5)
where A R
n×n
, B
1
R
n×h
, B
2
R
n×l
, C
1
R
r×n
C
2
R
m×n
, x
0
, x
0
(k) R
n
is the state of the N + 1
agent, called leader, y
0
, y
0
(k) R
m
is its mea-
sured output, u
0
, u
0
(k) R
h
is a time-varying un-
known control acting on the leader dynamics, and
z
0
, z
0
(k) R
r
is the variable on which we want
the follower controlled outputs z
i
to converge. Con-
cerning the remaining N follower agents, system de-
scription similar to (1) holds. The followers are as-
sumed to communicate on an undirected connected
graph whose Laplacian matrix is L. The leader can
pass information to a subset of followers. If agent
i receives information from the leader, then we set
a
i0
to 1, and 0 otherwise. Thus we define M ,
L diag(a
10
, ··· , a
N0
), which is symmetric and pos-
itive definite, and we name λ
M
, and
¯
λ
M
respectively
its minimum and maximum eigenvalue. Without loss
of generality we consider A to be Schur stable. The
aim of the present problem is indeed not the one of sta-
bilizing each single agent, but rather to steer the fol-
lower agents state to the leader one despite the pres-
ence of u
0
, which makes the leader dynamics time-
varying. In order to accomplish such objective we aim
to employ the controller of form (2), (3), where we
consider a modified variable s
i
to take into account
ICINCO 2017 - 14th International Conference on Informatics in Control, Automation and Robotics
74
the communication with the leader agent, according
to
s
i
=
N
j=1
a
i j
(y
i
y
j
) + a
i0
(y
i
y
0
) (6)
Intuitively such a controller is not capable of
solving the leader-follower tracking problem, i.e.
lim
k
kz
i
z
0
k 6= 0 for i = 1, · · · , N, and for any vec-
tor signal u
0
, because the latter acts as an unknown
exogenous signal for the overall system including the
N + 1 agents. This is why we will focus on tuning the
controller matrices B
c
, and D
c
such that kz
i
z
0
k is
minimized for i = 1, · · · , N.
3 MAIN RESULT
3.1 H
Output Consensus
In order to state our main result we introduce the fol-
lowing definition, similar to the one given in (Wang
and Shao, 2015).
Definition 1. System (1) is said to achieve an H
output consensus with a performance index γ R
+
if, for any initial condition, lim
k
kz
i
z
j
k = 0 for
i, j = 1, ··· , N when ω = 0, and the H
norms of the
transfer function matrices, for i = 1, ··· , N, between
ω and z
i
1
N
N
j=1
z
j
are inferior to γ.
The following result is based on Theorem 3 in (Wu
et al., 2011), reported in Theorem 4 in the Appendix.
Theorem 1. Given N agents described by (1) on an
undirected connected graph; consider the distributed
protocol of equations (2),(3),(4); then the agents
achieve H
output consensus with performance index
γ if there exist two symmetric positive definite matri-
ces P
,
¯
P R
¯n× ¯n
such that the LMI conditions of The-
orem 4 are simultaneously satisfied for two LTI sys-
tems whose matrices are respectively (A, B
2
, λ
L
C
2
),
and (A, B
2
,
¯
λ
L
C
2
), and they both have controlled out-
put matrix C
1
, and disturbance input matrix B
1
.
Proof. The closed-loop dynamics for the generic
agent i, by using (1),(2), and by defining the aug-
mented state ξ
i
,
x
>
i
, x
>
c
i
>
R
¯n
, and matrices
¯
C
2
,
[C
2
0
m×2l
],
¯
C
1
, [C
1
0
r×2l
],
˜
B ,
B
>
1
0
h×(2l)
>
is given by
(
ξ
+
i
=
ˆ
Aξ
i
+
ˆ
B
N
j=1
a
i j
(ξ
i
ξ
j
) +
˜
Bω
i
z
i
=
¯
C
1
ξ
i
where
ˆ
A =
A B
2
C
c
0 A
c
,
ˆ
B =
B
2
D
c
¯
C
2
B
c
¯
C
2
(7)
Similar to (Liu et al., 2009), and (Wang and Gao,
2011), we define ζ
i
, z
i
1
N
N
j=1
z
j
, and δ
i
, ξ
i
1
N
N
j=1
ξ
j
, thus ζ
i
=
¯
C
1
δ
i
. Note that if ζ
i
= 0 for
i = 1, · · · , N then z
i
= z
j
, i.e. output consensus
is achieved. If now we name ξ ,
ξ
>
1
, ··· , ξ
>
N
>
,
δ ,
δ
>
1
, ··· , δ
>
N
>
, and ζ ,
ζ
>
1
, ··· , ζ
>
N
>
, we have
that ζ =
I
N
¯
C
1
δ, and δ = ξ 1
1
N
N
j=1
ξ
j
=
¯
L I
¯n
ξ, where
¯
L satisfies the conditions of
Lemma 2. Gathering together the equations of the
closed-loop agents dynamics, we obtain
(
ξ
+
=
I
N
ˆ
A + L
ˆ
B
ξ +
I
N
˜
B
ω
ζ =
I
N
¯
C
1
¯
L I
¯n
ξ =
¯
L
¯
C
1
ξ
We now consider the following change of coordinates
δ =
¯
L I
¯n
ξ, which yields
δ
+
=
¯
L I
¯n
I
N
ˆ
A + L
ˆ
B
ξ+
¯
L I
¯n
I
N
˜
B
ω =
=
¯
L
ˆ
A +
¯
LL
ˆ
B
δ + 1
1
N
N
j=1
ξ
j
!
+
¯
L
˜
B
ω
=
¯
L
ˆ
A +
¯
LL
ˆ
B
δ +
¯
L
˜
B
ω
where we used points (i) of Lemma 2, and 3. Ac-
cording to the (ii) point of the former, we employ
the orthogonal matrix U R
N×N
to define the change
of coordinates:
ˆ
δ ,
U
>
I
¯n
δ,
ˆ
ω ,
U
>
I
h
ω,
ˆ
ζ ,
U
>
I
m
ζ, so that the system equations in the
new coordinates are given by
ˆ
δ
+
=
U
>
I
¯n
¯
L
ˆ
A +
¯
LL
ˆ
B
(U I
¯n
)
ˆ
δ
+
U
>
I
¯n
¯
L
˜
B
ω
=
¯
Λ
ˆ
A +
¯
ΛU
>
LU
ˆ
B
ˆ
δ +
¯
Λ
˜
B
ˆ
ω
ˆ
ζ =
U
>
I
m
I
N
¯
C
1
(U I
¯n
)
ˆ
δ =
I
N
¯
C
1
ˆ
δ
(8)
As shown in Lemma 2, being the last rows of
¯
Λ,
and U
>
LU zeros, we can split the dynamics (8) in
two parts by dividing the system variables as
ˆ
δ =
[
ˆ
δ
>
1
,
ˆ
δ
>
2
]
>
,
ˆ
ω = [
ˆ
ω
>
1
,
ˆ
ω
>
2
]
>
, and
ˆ
ζ = [
ˆ
ζ
>
1
,
ˆ
ζ
>
2
]
>
. The
dynamic equation of the second variable is then
ˆ
δ
+
2
=
0, and it does not influences
ˆ
δ
1
. It follows that we can
study the reduced order system
(
ˆ
δ
+
1
=
I
N1
ˆ
A + L
1
ˆ
B
ˆ
δ
1
+
I
N1
˜
B
ˆ
ω
1
ˆ
ζ
1
=
I
N1
¯
C
1
ˆ
δ
1
From Lemma 2, it exists an orthogonal matrix V
R
(N1)×(N1)
: V
>
L
1
V , Λ = diag(λ
1
, ··· , λ
N1
),
A Distributed PID-like Consensus Control for Discrete-time Multi-agent Systems
75
where 0 < λ
L
λ
i
¯
λ
L
for i = 1, · · · , N 1. Thus
we can define a further change of coordinates, such
that
¯
δ
1
,
V
>
I
¯n
ˆ
δ
1
,
¯
ω
1
,
V
>
I
h
ˆ
ω
1
, and
¯
ζ
1
,
V
>
I
m
ˆ
ζ
1
. The latter yields
¯
δ
+
1
=
I
N1
ˆ
A + Λ
ˆ
B
¯
δ
1
+
I
N1
˜
B
¯
ω
1
¯
ζ
1
=
I
N1
¯
C
1
¯
δ
1
(9)
It is easy to see that the transfer function matrix of (9)
satisfies
kT
¯
ζ
1
¯
ω
1
(z)k
= kT
ˆ
ζ
1
ˆ
ω
1
(z)k
=
kT
ˆ
ζ
ˆ
ω
(z)k
= kT
ζω
(z)k
(10)
It follows that we can impose an H
constraint on
transfer function matrix T
ζω
(z) by acting on T
¯
ζ
1
¯
ω
1
(z).
We can now separate equation (9) in N 1 subsys-
tems, each of them being governed by
¯
δ
+
1
i
=
(A + B
2
D
c
(λ
i
C
2
)) B
2
C
c
B
c
(λ
i
C
2
) A
c
¯
δ
1
i
+
B
1
0
¯
ω
i
¯
ζ
1
i
= C
1
¯x
1
i
(11)
where
¯
δ
1
i
, [ ¯x
>
1
i
¯x
>
1,c
i
]
>
. System (11) can be equiva-
lently seen as the closed-loop form of the two follow-
ing systems
¯x
+
1
i
= A ¯x
1
i
+ B
2
¯u
i
+ B
1
¯
ω
i
¯y
1
i
, (λ
i
C
2
) ¯x
1
i
¯
ζ
1
i
= C
1
¯x
1
i
(
¯x
+
1,c
i
= A
c
¯x
1,c
i
+ B
c
¯y
1
i
¯u
i
, C
c
¯x
1,c
i
+ D
c
¯y
1
i
(12)
Thus, we can reformulate the problem as the one find-
ing matrices B
c
, and D
c
such that for i = 1, · · · , N 1
the closed-loop system of (12) is Schur stable when
ω
i
= 0, and to guarantee that kT
¯z
i
¯
ω
i
(z)k
< γ. A suffi-
cient condition to prove the existence of such a so-
lution and a relatively simple way to calculate the
controller matrices are obtained by employing The-
orem 4. In the latter it is proved that if it exists a sym-
metric positive definite matrix P
i
R
¯n× ¯n
such that if
the given LMI conditions are satisfied, then closed-
loop system (11) using controller (2),(3),(4) is such
that
¯
δ
>
1
i
(k + 1)P
i
¯
δ
1
i
(k + 1)
¯
δ
>
1
i
(k)P
i
¯
δ
1
i
(k)
< γ
2
¯
ω
>
i
(k)
¯
ω
i
(k) ¯z
>
i
(k)¯z
i
(k)
It is important to stress that such LMI conditions are
affine in the system matrices, variables and matrix P
i
.
We make use of this fact to provide sufficient condi-
tions for which it exists a controller of the considered
form such that the mentioned LMI is simultaneously
verified for i = 1, · · · , N 1. Since the generic eigen-
value of L
1
: λ
i
is such that λ
L
λ
i
¯
λ
L
, then it
always exists α
i
R : 0 α
i
1 so that λ
i
= α
i
λ
L
+
(1 α
i
)
¯
λ
L
. Notice that the systems to be stabilized,
appearing in the first set of equation in (12), can be
seen as one single system with an uncertain measure-
ment matrix, whose parameter is λ
i
. In other words,
C
2
i
, λ
i
C
2
, and α
i
: C
2
i
= α
i
C
2
min
+ (1 α
i
)C
2
max
,
where C
2
min
, λ
L
C
2
, and C
2
mix
,
¯
λ
L
C
2
, i.e. it can
be written as a convex combination of the extreme
matrices C
2
min
, and C
2
max
. Thus, as in (Wang and
Gao, 2011), the proof makes use of classic results of
robust linear control, and in particular by introduc-
ing an affine parameter dependent Lyapunov matrix
P(α
i
) , α
i
P + (1 α
i
)
¯
P, where P,
¯
P are Lyapunov
matrices solution of simultaneous LMI of Theorem 4
written for respectively C
2
min
, and C
2
max
. Eventually,
it is easy to show that if P,
¯
P exist, then the controller
solves the problem λ R : λ
L
λ
¯
λ
L
, and in par-
ticular for λ = λ
i
, for i = 1, · · · , N 1. Such a con-
troller is easily found from the solution of the afore-
mentioned LMI condition. Indeed among the LMI
variables there are matrices B
c
, and D
c
, from which
it is easy to calculate the PID gains K
p
, K
i
, and K
d
by
employing relations in (3).
Remark 1. Note that the mentioned LMI conditions,
if satisfied, guarantee that the consensus error is min-
imized with respect to the disturbance. However the
latter still have a role in determining the consensus
function to which the agents converge.
3.2 Leader-follower Consensus under
Time-varying Reference
The result of Subsection 3.1 can be easily adapted for
the sake of leader-follower consensus via an H
for-
mulation of the problem. Thus, we give the following
Definition 2. System (5) is said to achieve an H
out-
put leader-follower consensus with a performance in-
dex γ R
+
if, for any initial condition, lim
k
kz
i
z
0
k = 0 for i = 1, · · · , N when u
0
(k) = 0 k N,
and the H
norms of the transfer function matrices,
for i = 1, ··· , N, between u
0
and z
i
z
0
are inferior to
γ.
Theorem 2. Given the system described by (5), where
N follower agents can communicate on an undirected
connected graph, and one leader can communicate
with a non-empty subset of followers; consider the
distributed protocol of equations (2),(3),(6); then the
systems achieve H
output leader-follower consen-
sus with performance index γ if there exist two sym-
metric positive definite matrices P,
¯
P R
¯n× ¯n
such
ICINCO 2017 - 14th International Conference on Informatics in Control, Automation and Robotics
76
that the LMI conditions of Theorem 4 are simultane-
ously satisfied for two LTI systems whose matrices are
respectively (A, B
2
, λ
M
C
2
), and (A, B
2
,
¯
λ
M
C
2
), and
they both have controlled output matrix C
1
, and dis-
turbance input matrix B
1
.
Proof. The proof is similar to proof of Subsection 3.1.
By defining error e
i
, x
i
x
0
, ξ , [e
>
i
, x
>
c
i
]
>
, and ζ
i
,
C
1
e
i
the closed-loop system for the generic follower
agent i is given by
(
ξ
+
i
=
ˆ
Aξ
i
+
ˆ
B
N
j=1
a
i j
(ξ
i
ξ
j
) + a
i0
ξ
i
+
˜
Bu
0
ζ
i
=
¯
C
1
ξ
i
where
ˆ
A,
ˆ
B,
¯
C
1
are defined in (7), and
˜
B ,
[B
>
1
0
h×2l
]
>
. Defining u
0
, 1 u
0
, we then
gather the N agent equations together
(
ξ
+
=
I
N
ˆ
A + M
ˆ
B
ξ +
I
N
˜
B
u
0
ζ =
I
N
¯
C
1
ξ
(13)
From the definition of M in Section 2, there
exists a orthogonal matrix U : U
>
M U , Λ =
diag(λ
1
, ··· , λ
N
), where λ
i
R : λ
i
> 0 for i =
1, ··· , N, so that we can define the change of coordi-
nates ξ , (U I
¯n
)
ˆ
ξ, u
0
, (U I
l
)ˆu
0
, ζ , (U I
r
)
ˆ
ζ.
By applying similar calculation as in the previous sub-
section, the global system in the new coordinates
(
ˆ
ξ
+
=
I
N
ˆ
A + Λ
ˆ
B
ˆ
ξ +
I
N
˜
B
ˆu
0
ˆ
ζ =
I
N
¯
C
1
ˆ
ξ
(14)
As in (10), it results that kT
ˆ
ξˆu
0
(z)k
= kT
ξu
0
(z)k
,
i.e. we can minimize the effect of u
0
on the con-
sensus error by acting on system (14). Similar to the
passage from equations (9) to (11), splitting (14) in N
subsystems yields the following equation for subsys-
tem i
ˆ
ξ
+
i
=
(A + B
2
D
c
(λ
i
C
2
)) B
2
C
c
B
c
(λ
i
C
2
) A
c
ˆ
ξ
i
+
B
1
0
ˆu
0
ˆ
ζ
i
= C
1
ˆe
i
(15)
where
ˆ
ξ
i
, [ˆe
>
i
ˆx
>
c
i
]
>
. Equivalently, it can be de-
scribed as the connection of the two following sys-
tems
ˆe
+
i
= A ˆe
i
+ B
2
ˆu
i
B
1
ˆu
0
ˆy
i
, (λ
i
C
2
) ˆe
i
ˆ
ζ
i
= C
1
ˆe
i
(
ˆx
+
c
i
= A
c
ˆx
c
i
+ B
c
ˆy
i
ˆu
i
, C
c
ˆx
c
i
+ D
c
ˆy
i
(16)
The rest of the proof is equivalent to the last part
of Subsection 3.1, and it is concluded by invoking
Theorem 4, whose LMI conditions have to be simul-
taneously satisfied for the two systems at the ver-
tices of the polytope having matrices respectively
(A, B
2
, λ
M
C
2
), and (A, B
2
,
¯
λ
M
C
2
), and same con-
trolled output, and disturbance input matrices C
1
,
B
1
. From the solution of the aforementioned LMIs
the controllers gains are easily found as in the proof of
Theorem 1. If such a solution exists, then the system
is stable.
Having employed a PID structure for the distributed
controller suggests that consensus should be reached
for any u
0
(k) = ¯u
0
, where ¯u
0
is any constant vector.
However this is not automatically guaranteed in the
MIMO case by the mentioned LMI conditions, and in
this framework it is verified a posteriori. Nonetheless,
if such LMI has a solution then, according to the well-
known Francis equation, a necessary condition for the
proposed controller to reject constant exogenous sig-
nals is that l r.
In the leader-follower consensus framework a dif-
ferent tuning of the PID controller gains with respect
to Theorem 2 could lead to better performance, as
shown in Section 4. Thus, by proposing the follow-
ing definition we aim to focus on system fast response
rather than imposing some H
constraint. For this last
development, we further consider r = m, thus we sim-
ply name C , C
1
= C
2
.
Definition 3. System (5) is said to achieve fast leader-
follower consensus with performance index τ R
+
if
for u
0
(k) = 0, and any initial condition, lim
k
ky
i
y
0
k = 0 for i = 1, ··· , N, and (1e
1
)% of consensus
is achieved in a maximum number of steps equal to
d
τ
e
.
Note that the same kind of definition can be consid-
ered for sampled-data systems, by saying that sys-
tem (5) achieves fast leader-follower consensus with
a time constant inferior to τT
s
, where T
s
is the system
sampling time. The result we present in the following
is based on Theorem 2 in (Wu et al., 2011), reported
in Theorem 5 in the Appendix.
Theorem 3. Given the system described by (5), where
N follower agents can communicate on an undi-
rected connected graph, and one leader can com-
municate with a non-empty subset of followers; con-
sider the distributed protocol of equations (2),(3),(6);
then the systems achieve fast leader-follower con-
sensus with performance index τ =
1
log(R)
, where
R R : 0 R < 1, if there exist two symmetric pos-
itive definite matrices P,
¯
P R
¯n× ¯n
such that the LMI
conditions of Theorem 5 are simultaneously satisfied
A Distributed PID-like Consensus Control for Discrete-time Multi-agent Systems
77
for two LTI systems whose matrices are respectively
(A, B
2
, λ
M
C), and (A, B
2
,
¯
λ
M
C), and where the real
constants (a, b) to be set in Theorem 5 are chosen to
be (a, b) = (0, R).
Proof. The proof employs the same change of co-
ordinates as in the previous one, so that we can re-
state the problem as the one of stabilizing the top
system of equation (16), for i = 1, · · · , N, with the
bottom system in (16), i.e. a PID controller whose
matrices are defined in (3). Unlike Theorem 2, as
previously mentioned, we invoke Theorem 5, where
it is stated that given two real constants (a, b), if
there exists a symmetric positive definite matrix P
i
such that the given LMI conditions are satisfied, then
system (15) is stable with all its eigenvalues λ ly-
ing in the complex plane region defined by F
D
,
([λ], [λ]) : ([λ] + a)
2
+ [λ]
2
< b
2
. As for the
two previous proofs, we employ classic results of lin-
ear robust control to impose that this condition is
simultaneously satisfied for two systems at the ver-
tices of the polytope whose matrices are respectively
(A, B
2
, λ
M
C), and (A, B
2
,
¯
λ
M
C). If such a solution
exists then the eigenvalues of system (13) are guaran-
teed to lie in F
D
. In this framework we are interested
in speeding up the system response to u
0
. For this
reason we set a = 0, and b = R, where R : 0 R < 1.
Thus, all system eigenvalues are guaranteed to have a
module inferior to R. As a result, the system has the
slowest time-constant inferior to
T
s
log(R)
. In terms
of number of iterations it is easy to see that such per-
formance is equal to a maximum value
1
log(R)
of
iterations. Eventually, from the LMI solution, the PID
gains are found as in the two previous proofs.
Remark 2. In this latter problem too, having imposed
a PID structure does not directly guarantee achieve-
ment of consensus for any constant u
0
(k) in the gen-
eral MIMO case. According to Francis equations, if
the mentioned LMI has a solution, a necessary condi-
tion though is given by l m.
4 SIMULATION EXAMPLES
First of all we carry out a numerical simulation to test
the H
output consensus control. We consider a net-
work of 5 agents as show in Figure 1.a. Each of them
is governed by (1), where
A =
"
0.8182 0.0452 0.0034
0 0.9888 0.1492
0 0.1492 0.9888
#
,C
1
=
"
0
1
0
#
>
B
2
=
"
1 0.4
0 1
0.5 0.5
#
, B
1
=
"
0.1
0.05
0
#
,
C
2
=
"
1.2 0.8 1.4
1.4 1.2 0.8
0.5 0.7 1.2
#
(17)
Note that (17) is not Schur stable because two of
its eigenvalues lay on the unit circle. Each agent
is perturbed by a disturbance of the form ω
i
(k) =
0.8ν
i
(k) + c
i
, where ν
i
is an aleatory variable with
uniform distribution of probability in [0, 1], and c
i
is
some constant value. The PID gains found via LMIs
allow an H
performance index of γ = 0.18. Figure 2
shows the 5 agents trajectories (colored dashed lines)
as well as their average (blue continuous line). Then
we compare the two proposed PID gain tuning for a
leader-follower consensus problem. For this example
we consider the graph of Figure 1.b, where agent 0
is the leader. The system dynamics is governed by
equation (5), where
A =
0.7711 0.4744 0.2475
0.1646 0.4487 0.1036
0.8959 0.8534 0.2198
,
B
2
=
0.5 0.3 0.4
0.7 0 1
0.4 0.9 0.3
, B
1
=
0.2
0.5
0.3
C
1
=
1 0 0
and C
2
as in (17). The controller tuned following The-
orem 2 allows an H
performance index of γ = 2,
while the one tuned according to Theorem 3 guaran-
tees a performance index of τ = 6.1531. In Figure 3
we simulate the system step response for a value of
u
0
= 3. For ease of comparison, we plot here the
only output associated to matrix C
1
. As mentioned in
section 3, fast consensus (green dashed lines) outper-
forms the H
one (red dashed-dotted lines). Indeed,
even if the latter respects Theorem 2, its consensus
error goes slowly to zero with respect to the former
one. Eventually, in Figure 4 it is shown the system
behavior for fast consensus tuning of PID gains when
u
0
is a time-varying vector signal, and where we set
C = C
1
= C
2
=
1 0 0
0 1 0
. The blue and the dark
green continuous signals are respectively leader states
x
1
, and x
2
, while the followers states are represented
respectively by the dashed green and red signals for
x
1
, and x
2
.
ICINCO 2017 - 14th International Conference on Informatics in Control, Automation and Robotics
78
Figure 1: (a): leaderless communication graph (left);
(b): leader-follower communication graph (right).
Figure 2: H
output consensus.
Figure 3: Step response comparison for H
output and fast
leader-follower consensus.
Figure 4: Leader-follower consensus under time-varying
reference.
5 CONCLUSION
We presented a PID-like distributed protocol for gen-
eral LTI MIMO discrete-time agents communicating
on an undirected connected graph. By employing
LMIs we showed how the controller gains can be
tuned to solve two different, yet similar, problems,
namely a leaderless under system disturbances and
a leader-follower under time-varying reference state
consensus problem. Treating the system disturbances
in the H
framework revealed good performance,
whereas a gain tuning based on fast response seems
to be preferable when dealing with a leader-follower
problem.
Our results are based on robust control to deal with
the problem of simultaneous stabilization of a given
number of systems. The given conditions are suffi-
cient and therefore conservative. In near future work
we are interested in studying less restrictive condi-
tions when treating the discrete-time consensus prob-
lem in the H
framework. Moreover, inspired by the
work of (Schiffer et al., 2016), we are currently study-
ing possible applications of the presented methods in
the engineering field of power systems.
ACKNOWLEDGEMENTS
This study has been carried out in the RISEGrid In-
stitute (www.supelec.fr/342p38091/risegrid-en.html),
joint program between CentraleSup
´
elec and EDF
(’Electricit
´
e de France’) on smarter electric grids.
REFERENCES
Cao, Y., Ren, W., and Li, Y. (2009). Distributed discrete-
time coordinated tracking with a time-varying refer-
ence state and limited communication. Automatica,
45(5):1299–1305.
Carli, R., Chiuso, A., Schenato, L., and Zampieri, S.
(2008). A pi consensus controller for networked
clocks synchronization. IFAC Proceedings Volumes,
41(2):10289–10294.
Ge, Y., Chen, Y., Zhang, Y., and He, Z. (2013). State
consensus analysis and design for high-order discrete-
time linear multiagent systems. Mathematical Prob-
lems in Engineering, 2013.
Graham, A. (1981). Kronecker products and matrix calcu-
lus with applications. Holsted Press, New York.
Li, Z., Duan, Z., and Chen, G. (2011). On h
and h
2
per-
formance regions of multi-agent systems. Automatica,
47(4):797–803.
Li, Z., Duan, Z., Xie, L., and Liu, X. (2012). Distributed
robust control of linear multi-agent systems with pa-
rameter uncertainties. International Journal of Con-
trol, 85(8):1039–1050.
Li, Z., Ren, W., Liu, X., and Fu, M. (2013). Distributed con-
tainment control of multi-agent systems with general
linear dynamics in the presence of multiple leaders.
International Journal of Robust and Nonlinear Con-
trol, 23(5):534–547.
Lin, P., Jia, Y., Du, J., and Yu, F. (2008). Distributed leadless
coordination for networks of second-order agents with
time-delay on switching topology. In 2008 American
Control Conference, pages 1564–1569. IEEE.
Liu, Y., Jia, Y., Du, J., and Yuan, S. (2009). Dynamic
output feedback control for consensus of multi-agent
systems: an h
approach. In 2009 American Control
Conference, pages 4470–4475. IEEE.
Oh, K.-K., Moore, K. L., and Ahn, H.-S. (2014). Distur-
bance attenuation in a consensus network of identical
linear systems: An approach. IEEE Transactions on
Automatic Control, 59(8):2164–2169.
A Distributed PID-like Consensus Control for Discrete-time Multi-agent Systems
79
Ou, L.-L., Chen, J.-J., Zhang, D.-M., Zhang, L., and Zhang,
W.-D. (2014). Distributed h
pid feedback for im-
proving consensus performance of arbitrary-delayed
multi-agent system. International Journal of Automa-
tion and Computing, 11(2):189–196.
Ren, W. (2007). Multi-vehicle consensus with a time-
varying reference state. Systems & Control Letters,
56(7):474–483.
Ren, W. and Beard, R. W. (2008). Distributed consensus in
multi-vehicle cooperative control. Springer.
Ren, W., Beard, R. W., et al. (2005). Consensus seeking
in multiagent systems under dynamically changing in-
teraction topologies. IEEE Transactions on automatic
control, 50(5):655–661.
Schiffer, J., Seel, T., Raisch, J., and Sezi, T. (2016). Voltage
stability and reactive power sharing in inverter-based
microgrids with consensus-based distributed voltage
control. IEEE Transactions on Control Systems Tech-
nology, 24(1):96–109.
Su, Y. and Huang, J. (2012). Two consensus problems for
discrete-time multi-agent systems with switching net-
work topology. Automatica, 48(9):1988–1997.
Wang, L. and Gao, L. (2011). H
consensus control
for discrete-time multi-agent systems with switching
topology. Procedia Engineering, 15:601 – 607.
Wang, X. and Shao, J. (2015). Consensus for discrete-time
multiagent systems. Discrete Dynamics in Nature and
Society.
Wu, Z., Iqbal, A., and Amara, F. B. (2011). Lmi-based
multivariable pid controller design and its application
to the control of the surface shape of magnetic fluid
deformable mirrors. IEEE Transactions on Control
Systems Technology, 19(4):717–729.
Xi, J., Cai, N., and Zhong, Y. (2010). Consensus prob-
lems for high-order linear time-invariant swarm sys-
tems. Physica A: Statistical Mechanics and its Appli-
cations, 389(24):5619–5627.
Xi, J., Shi, Z., and Zhong, Y. (2012). Output consen-
sus analysis and design for high-order linear swarm
systems: partial stability method. Automatica,
48(9):2335–2343.
Yang-Zhou, C., Yan-Rong, G., and ZHANG, Y.-X. (2014).
Partial stability approach to consensus problem of lin-
ear multi-agent systems. Acta Automatica Sinica,
40(11):2573–2584.
You, K. and Xie, L. (2011). Network topology and commu-
nication data rate for consensusability of discrete-time
multi-agent systems. IEEE Transactions on Automatic
Control, 56(10):2262–2275.
APPENDIX
In the following we report the two cited theorems of
(Wu et al., 2011). Consider the system of equations
(
x
+
= Ax + B
1
ω + B
2
u
z = C
1
x, y = C
2
x
(18)
where A R
n×n
, B
2
R
n×l
, B
1
R
n×h
, C
1
R
r×n
,
C
2
R
m×n
, x , x(k) R
n
and x
+
, x(k + 1) R
n
are respectively the system state at the current step
k, and at the next step k + 1, u , u(k) R
l
is the
control input, ω , ω(k) R
h
is an exogenous in-
put signal, z , z(k) R
r
the controlled output, and
y , y(k) R
m
is the measured one. Define the ma-
trices C
cl
,
C
1
0
r×(2l)
,
˜
B ,
B
>
1
0
h×(2l)
>
, K ,
D
>
c
B
>
c
>
, and
˜
A ,
A B
2
C
c
0
2l×n
A
c
where A
c
, B
c
, C
c
, and D
c
are defined in (3). Assum-
ing B
2
to be of full column rank without loss of gen-
erality, there exists an invertible T
b
R
n×n
: T
b
B
2
=
0
l×(nl)
I
l×l
>
. Finally define
T ,
T
b
0
n×2l
0
2l×n
I
2l×2l
Thus, we have the following theorems
Theorem 4. Consider system (18). If there exists a
positive definite matrix P R
¯n× ¯n
, where ¯n , n + 2l,
matrices
F =
F
11
0
( ¯nq)×3l
F
21
F
22
F
22
R
q×3l
, 1 q 3l, G
1
, [G
11
0] R
¯n× ¯n
, G
11
R
¯n×( ¯n3l)
, G
2
, [G
21
0] R
h× ¯n
, G
21
R
h×( ¯n3l)
,
G
3
, [G
31
0] R
r× ¯n
, G
31
R
r×( ¯n3l)
, H
1
R
¯n×r
,
H
2
R
¯n×r
, H
3
R
h×r
, H
4
R
r×r
, Y R
q×m
, and
N
1
=
0
( ¯nq)×n
0
( ¯nq)×2l
YC
2
0
q×2l
and we further name Ψ
11
, P FT (FT )
>
,
Ψ
21
, N
>
1
+ (FT
˜
A)
>
G
1
T + (H
1
C
cl
)
>
, Ψ
22
,
P + G
1
T
˜
A + (G
1
T
˜
A)
>
+ H
2
C
cl
+ (H
2
C
cl
)
>
, Ψ
31
,
(FT
˜
B)
>
G
2
T , Ψ
32
, G
2
T
˜
A + H
3
C
cl
+ (G
1
T
˜
B)
>
,
Ψ
33
, γ
2
I +G
2
T
˜
B+(G
2
T
˜
B)
>
, Ψ
41
, G
3
T H
>
1
,
Ψ
42
, G
3
T
˜
A + H
4
C
cl
H
>
2
, Ψ
43
, G
3
T
˜
B H
>
3
, and
Ψ
44
, I H
4
H
>
4
, such that the following LMI has
a solution
Ψ
11
Ψ
21
Ψ
22
Ψ
31
Ψ
32
Ψ
33
Ψ
41
Ψ
42
Ψ
43
Ψ
44
< 0
and if exists K such that F
22
K = Y , then the H
norm
of the closed-loop system given by (18) and
(
x
+
c
= A
c
x
c
+ B
c
y
u = C
c
x
c
+ D
c
y
satisfies kT
zω
k
< γ.
ICINCO 2017 - 14th International Conference on Informatics in Control, Automation and Robotics
80
Theorem 5. Consider system (18). If there exists a
positive definite matrix P R
¯n× ¯n
, and a matrix
J =
J
11
0
( ¯nq)×3l
J
21
J
22
J
22
R
3l×3l
, and X R
3l×m
, and we further name
,
0
( ¯n3l)×n
0
( ¯n3l)×2l
XC
2
0
3l×2l
such that the following LMI has a solution
bP
+ JT
˜
A + aJT b(JT + (JT )
>
P)
> 0
and if J is nonsingular, then by choosing K = J
1
22
X,
the eigenvalues of the following matrix
A
cl
,
(A + B
2
D
c
C
2
) B
2
C
c
B
c
C
2
A
c
lie in the region F
D
,
([λ], [λ]) : ([λ] + a)
2
+[λ]
2
< b
2
.
A Distributed PID-like Consensus Control for Discrete-time Multi-agent Systems
81