interference, maximizing the system capacity,
achieving fairness in femtocell networks and
maximizing network utilization (Ertürk et al., 2010).
Several works in literature has already proposed
how to achieve high capacities with fair scheduling
techniques for conventional cellular architectures.
For example, (Zhang and Letaief, 2004) aims to
maximize the sum-rate of all the users within a
cellular network; however, fairness issues have not
been considered. A maximum fairness technique has
been discussed in (Rhee and Cioffi, 2000), which
essentially tries to maximize the capacity of the user
that has the lowest data rate and achieve similar data
rates for all users.
In terms of capacity overflow, some proposed
architectures and schedulers have been proposed. In
(Chung and Lee, 2005) and (Hu and Rappaport,
1995.), models based on Markov-modulated Poisson
Process (MMPP) were employed for representing
multiservice overflow traffic. However, extensive
computations are required by a MMPP method to
solve multi-dimensional Markov chains for large
scale systems.
Relative to Green communication it can be
highlighted (Liao and Yen, 2009), where it is
proposed the power-saving scheduling of base
stations (BS) considering QoS requirements (delay
and jitter) of the real-time communications in
WiMAX network. Also in (Han et al., 2010) several
radio management scheduling algorithms are
evaluated for the long term evolution (LTE) BSs,
and effectively exploits multi-user diversity in the
time, frequency and space domains for LTE
networks. The works in the area were found to
focused mainly on the energy efficiency of macro
cells and core network, with no much attention
devoted to maximizing the use of battery of client
nodes, considering aspects of QoS and signal level.
2 FEMTOCELL
2.1 Definition and Characteristics
Femtocells are devices used to improve mobile
network coverage in small areas, connected locally
to mobile phones and similar devices through their
2G (GSM), 3G (UMTS) or 4G (WIMAX or LTE)
connections, and then route the connections over a
broadband internet connection back to the carrier,
bypassing the normal cell towers (ERBs or nodeBs).
This technology creates a bridge between mobile
and personal wired networks, using a high speed
internet connection (either personal or enterprise) to
link to the operators macro-network. Doing this, it is
easier to extend access to mobile network, providing
better coverage for the population (especially in
areas where there was no signal or weak signal
arrived), and providing high bandwidth to users.
2.2 Problem Description
Femtocells are typically installed by non-expert
users, which do not consider the network’s
performance; simply connecting a Femtocell Acess
Point to DSL (Digital Subscriber Line) and turning it
on. Femtocell Acess point self-organizes its radio
and system operational parameters (Holger et al.,
2008)(John and Holger, 2009). The node client
automatically tries to associate the Femtocell Acess
Point with strongest signal, however this choice
becomes unfair in two aspects:
1. Considering the capacity of the Femtocell
Access Point, which can become overcrowded and
can not serve new users, maintaining the quality of
service. This can lead to an unbalanced load,
overloading a femtocell against each other;
2. Given the choice of allocation by the
customer, the network setting only by the signal
power level may not meet the quality requirements
of the user, which could obtain a better service
through another network near, even at a higher cost
battery. This fact is aggravated when considering the
diversity of existing applications, which have
different requirements for quality of service.
3 MARKOVIAN MODEL
3.1 Markov Decision Process
The problem is formulated as a Continuous Time
MDP (CTMDP), since it considers that the times
(between requests arrival and that a request stay in
the system) follow an exponential probability
distribution. Also, the problem is formulated as an
Infinite Horizon problem, since it can perform for a
long, undefined period of time.
Briefly, to model a problem as a CTMDP, it is
necessary to define (Puterman, 1994):
The state space S: the set of all possible
conditions of the system;
The sets of actions {A(s) | s
∈
S}: for each
state s
∈
S, there is a set of possible actions
A(s), in which the operator must choose a
single action at every decision time;
SMARTGREENS2012-1stInternationalConferenceonSmartGridsandGreenITSystems
210