uration can be helpful. The pose estimator demands
certain requirements concerning known critical con-
figurations, not contributing to the information for the
pose or causing ambiguous results. Regarding dis-
tances and angles between planes and lines, these cor-
respondences can be marked for rejection.
For straight lines ill collinear configurations oc-
cur if three or more lines are parallel or if three or
more lines intersect in one point. Hence, other fea-
tures should be prioritized for the pose estimation
process. Parallelism among the correspondences is
checked by calculating the dot product of the nor-
malized direction vectors. If all products are close
to 1, the correspondences are rejected. To check for a
common point of three lines, the intersection point of
each correspondence pair is calculated respectively.
If there are two intersection points with an euclidean
distance below a predefined threshold, the line corre-
spondences are rejected.
2.12 History
For evaluating the quality of a feature it is also rea-
sonable regarding the evolution of the feature quality.
A feature is particularly suitable for tracking when it
could be tracked stable over time, i.e. its history val-
ues are high and show little variance. We use the re-
sults of the last 10 frames to describe the history of the
feature by storing its quality value in an array which
is updated every frame. All quality values stored in
the history over the last frames are combined to one
average history value, that contributes to the compu-
tation of the current quality descriptor for the edge.
Hence, the feature management is able to learn about
features which proved unstable in the past (e.g. due to
occlusion) and thus will not be proposed for tracking
in the following frames. When starting the tracking,
initially the history value is empty and thus ignored as
quality criterion.
2.13 Quality Calculation
After all information is collected, an overall quality
value is calculated for each feature in two steps. Be-
fore projection, the weighted average from the entries
of the quality descriptor vector is taken to retrieve a
quality value in the range of [0,1]. This is realized by
the dot product of the descriptor vector Q with qual-
ity criteria q
1..n
and a weight vector W with weight
entries w
1..n
. The result is normalized by the sum of
all weights:
~
Q =
q
1
q
2
...
q
n
,
~
W =
w
1
w
2
...
w
n
q
overall
=
(
~
Q) · (
~
W )
n
∑
i=1
w
i
.
An adequate weighting of the criteria according to
their influence on the tracking result has to be found
during the tests in the next section. A subset of only
those features holding a minimum quality will be pro-
jected and tested for visibility. This first filtering leads
to a considerable reduction in computation time. Af-
ter the subsequent matching process, the quality value
calculated before is now refined with the weighted
matching feedback in an additional step. Each fea-
ture in the geometry list is now assigned to its quality
value and the list can be sorted into priority classes,
using predefined boundary values. From this prior-
itized geometry list, the pose estimator is then able
to select a minimal qualitative subset of correspon-
dences.
3 RESULTS
The feature management concept is tested on syn-
thetic rendered and real camera images of simple and
complex objects on indoor and outdoor scenes with
varying lighting conditions. The image resolution of
the input streams is 640 x 480 and 1280 x 720 pix-
els. The initial camera pose is known at the start of
the sequence and the intrinsic parameters of the video
camera are given. The rotation error is measured in
degrees and the translation error is measured in object
units (dimension of the object is 2). For the compu-
tation of the camera pose from line correspondences
we use a non-linear Levenberg-Marquardt optimiza-
tion. The test is accomplished both using a full feature
set without evaluation and using a reduced set with
our feature management. Nearly 2200 test passes are
performed on two video sequences in order to deter-
mine the influence of the individual quality criteria
on the tracking result. In the test passes all possible
combinations of the quality criteria are used for the
calculation of the quality values while varying the ac-
cording weights. For each pass the average translation
and rotation error is compared to retrieve the optimal
weighting vector leading to a robust and fast camera
pose estimation. The resulting weights are listed in
table 1.
We found the history criterion as well as length,
distance and silhouette have a major impact on the
selection of good features, independently from the
scene content. Thus, in most cases the edges pro-
posed by the feature management are part of the ob-
ject silhouette as can be seen in figure 8. If additional
knowledge about the light source position is available,
FeatureEvaluationandManagementforCameraPoseTrackingon3DModels
567