In the above hallucination approach, a Gaussian
image pyramid is formed for every image in the train-
ing set as well as for the LR observation. A set of
features are computed for every image in the image
pyramid. A gradient prior is learned using gradients
and second gradients of the images as features. Hallu-
cinated face is estimated using maximum a posteriori
(MAP) framework, which uses leaned prior in its cost
function.
In the eigen transformation based hallucination
algorithm proposed by Wang and Tang (2005), first
an HR database and corresponding LR face image
database is prepared. LR observation image is then
represented as the linear combination of LR database
images. The coefficients are determined from the
PCA coefficients. The super resolution is achieved by
finding the linear combination of the HR images with
the same coefficients. To avoid abnormalities in the
image, a regularization is done with respect to eigen
values.
Jiji et al.(2004) proposed a wavelet based single
frame super resolution method, for general images,
making use of an HR image database. Observed im-
age as well as the data base images are decomposed
using wavelet transform. Wavelet coefficients of the
super resolved image is learned from the coefficients
of images in the database. The problem is solved
under a regularization frame work using the learned
wavelet prior. An edge preserving smoothness con-
straint is used to maintain the continuity of edges in
super resoved image. Capel and Zisserman (2001) di-
vided the face image in to six regions or subspaces
and then PCA based super resolution is applied on
the respective portions independantly. The subspaces
are combined and a global regularization is done to
minimize artifacts at the boundaries of the regions.
In this paper, we propose two methods for face
hallucination in wavelet domain. In both the meth-
ods, face hallucination based on eigen transformation
is applied on the wavelet coefficients. In the first
method, face image is treated as a single image and
in the second method, it is split into several regions
and then the super resolution techniques are applied.
Eigen transformation uses PCA coefficients for im-
plementing the super resolution. Therefore the hallu-
cination algorithms proposed in this paper are refered
as face hallucination using PCA in wavelet domain
and face hallucination using subspace PCA in wavelet
domain.
The remaining part of this paper is organized as
below. The background for Wavelets and PCA rela-
vant to the problem of face hallucination are discussed
in subsections 2.1 and 2.2 respectively. The signif-
icance of super resolution using PCA and subspace
models in spatial domain as well as in the wavelet do-
main are given in subsections from 2.3 to 2.6. Section
3 consists of the details of simulation work and results
and the paper concludes in section 4.
2 HALLUCINATION WITH PCA
IN WAVELET DOMAIN
In this paper two methods are proposed for face hal-
lucination, using PCA in wavelet domain. Both the
methods use, a training set of face images consisting
of HR and corresponding LR images. In the first al-
gorithm, wavelet coefficients of images in the training
set are determined. Wavelet coefficients of LR obser-
vation is also determined. Eigen transformation based
hallucination is applied individually on all the four
wavelet coefficients, to get the super resolved wavelet
coefficients. The hallucinated face is obatained by
computing the inverse wavelet transform of super re-
solved wavelet coefficients. In the second method,
face image is split in to four regions out of which three
regions are textured and are more significant. The
fourth region is relatively flat. Textured regions are
super resolved seperately using the method described
above. Flat regions are interpolated using standard in-
terpolation techniques. In the following subsections
we discuss briefly on wavelets and PCA followed by
the usage of eigen vectors for super resolution.
2.1 Discrete Wavelet Transform
The Discrete Wavelet Transforms (DWT) splits the
image into four spectral bands (Daubechies, 1992).
Each of the subbands is one quarter in size of the orig-
inal image and these coefficients (subbands) preserve
the locality of spatial and spectral details in the im-
age. This property of spectral and spatial localization
is useful in problemslike image analysis, especially in
super resolution. Wavelet coefficients of an image are
determined using filters arranged as shown in figure 1.
g(n) and h(n) are the half band high pass and low pass
filters respectively. Resulting wavelet coefficients are
LL (low-low), LH (low-high), HL (high-low) and HH
(high-high). Perfect reconstruction of the image is
possible from four wavelet coefficients, using inverse
DWT (IDWT). There are many types of wavelets de-
pending on the type of filters used for g(n) and h(n).
Wayo et al (2006) shows that Symlets givesbetter per-
formance in PCA based face recognition techniques,
over other types of wavelet. In this paper, proposed
algorithms are tested with Daubechies, Symlet and
Coiflet wavelets. Figure 2 shows the typical single
level wavelet decomposition of a face image.
FACE HALLUCINATION USING PCA IN WAVELET DOMAIN
181