devices, the recovery of spectral sensitivities was en-
abled in the presence of a relatively high amount of
sensor noise.
As an additional issue, Barnard and Funt (2002)
pointed out that a nonlinear characteristic of sensor
response declined the accuracy of spectral sensitivity
recovery, and performed a linearization at the same
time of recovering the spectral sensitivity. The lin-
earization of sensor response is necessary in all ap-
plications mentioned above. Though the linearization
function can be identified from images of same scene
captured with different exposures(Grossberg and Na-
yar, 2006), Barnard and Funt’s approach is reasonable
because of its possibility of improving accuracy in
spectral sensitivity recovery as well of its efficiency.
Beside the linearization, they proposed to add a reg-
ularization term to the cost function of the regres-
sion problem instead of using Fourier basis functions.
Regularization is a well-known technique for improv-
ing ill-conditioned regression. A regularization term
is generally represented by a norm of a variant to
be recovered, and they adopted the second derivative
norm to smooth the recovered sensitivity.
However, there remains a practical issue of se-
lecting tuning parameters. For example, the smooth-
ness of a recovered spectral sensitivity depends on the
threshold value in Sharma and Trussell’s method, the
total number of Fourier basis functions in Finlayson
et al.’s method, and the regularization coefficient in
Barnard and Funt’s method. These are typical tun-
ing parameters, which need to be selected through
trial-and-error process. Besides in Barnard and Funt’s
method, the linearization function was given paramet-
rically based on the empirical knowledge of their ob-
jective camera, and some of the parameters were ad-
justed with trial and error. Though Carvalho et al.
(2004) proposed a scheme to determine all tuning pa-
rameters in Finlayson et al.’s method objectively by
adopting an extended criterion of cross validation,
they didn’t deal with the linearization of sensor re-
sponses.
This study aims to develop a method for identi-
fying spectral sensitivity functions and linearization
functions without manual parameter tuning and with
simple implementation. We formalized the problem
of spectral sensitivity recovery in the Bayesian sta-
tistical framework. A smooth regularization and a
nonnegative constraint were adopted, and they were
introduced to our Bayesian model as a prior distribu-
tion. A polyline function was used for linearization,
which achieves a high degree of freedom in calibra-
tion regardless of camera choices. The noise vari-
ance as well as the spectral sensitivity and the lin-
earization function of a color channel can be identi-
fied from a color chart image owing to the modeling
in the Bayesian framework. In this study we show the
Bayesian formalization, and the implementation of its
solution. We also show experiments using synthetic
data.
2 PROPOSED METHOD FOR
IDENTIFYING CAMERA
CHARACTERISTICS
2.1 Outline of Bayesian Estimation
Let θ
k
(λ) be the spectral sensitivity of a camera, and
y
(i)
k
its sensor response for the i-th color patch of
a color chart (i = 1, ...,N), where k and λ denote
color channel (k =R,G,B) and wavelength respec-
tively. The parameter to be obtained is the sensitiv-
ity θ
k
(λ) and is estimated by a conditional probabil-
ity p(θ
k
(λ)|y
k
) called the posterior, where we denote
a set of sensor responses of k-channel by the vector
y
k
= [y
(1)
k
·· · y
(N)
k
]
T
.
The posterior is derived from the likelihood
p(y
k
|θ
k
(λ)) and the prior p(θ
k
(λ)) by applying the
Bayesian theorem on conditional probability:
p(θ
k
(λ)|y
k
) =
p(y
k
|θ
k
(λ))p(θ
k
(λ))
R
p(y
k
|θ
k
(λ))p(θ
k
(λ))dθ
k
(λ)
. (1)
The likelihood represents an input-output model of
the camera, and the prior represents the prior knowl-
edge about spectral sensitivity curves which can be
utilized to exclude the possibility of inappropriate so-
lutions, and to make the sensitivity recovery stable.
The spectral sensitivity of the color channel is ob-
tained as the maximum a posteriori (MAP) estimator,
which is the maximum point of the posterior and a
common estimator.
In the Bayesian framework, parameters included
in the likelihood or the prior can be determined in a
data-driven manner. Such parameters are called hy-
perparameters, and we introduce the camera charac-
teristics except spectral sensitivity as hyperparame-
ters of the Bayesian model. An effective criterion
for hyperparameter estimation is the log-marginalized
likelihood h defined by
h = ln
Z
p(y
k
|θ
k
(λ))p(θ
k
(λ))dθ
k
(λ), (2)
where the marginalization by unknown sensitivity
θ
k
(λ) helps avoid over-fit estimation (Bishop, 2006).
The maximization of h can be solved by repeated cal-
culation of the expectation-maximization (EM) algo-
rithm (Bishop, 2006). In E-step, the posterior is cal-
VISAPP2013-InternationalConferenceonComputerVisionTheoryandApplications
16