is popular due to its simplicity and hands-on, intuitive
design of the control strategy and was successfully ap-
plied by preceding authors, e. g. in (Bischoff, 1999),
to build active safety systems for robots. In this paper,
a three dimensional obstacle avoidance strategy will
be introduced that is founded on the idea of repelling
and attracting forces (P. Zavlangas et al., 2000). The
design of a fuzzy logic controller will be highlighted
in section 3.
Although specialised solutions exist for each com-
ponent of the proposed ASSYS, the goal in this paper
was to build such a system using only basic compo-
nents communicating over an Ethernet network. No
multiple robot interaction was assumed and due to the
early stage of the investigation, the vision system was
only designed to make the robot avoid collision with
a single, however dynamically moving, obstacle. At-
tention was also given to the time performance of the
vision system.
To make the industrial FANUC robot move along
an alternative path in an on-line manner, a robot ap-
plication needed to be programmed in the proper pro-
gramming language KAREL of FANUC Robotics. A
multitask oriented design in the KAREL language
assures that alternative positions can be read in by
the robot’s system and subsequently moved to by the
robot arm. The architecture of the robot application,
as well as details on the real-time communication sys-
tem established over Ethernet, will be commented in
section 4. In section 5 results and drawbacks of the
designed ASSYS are commented.
2 ARTIFICIAL VISION
2.1 3D Object Reconstruction
Stereoscopic vision applications intent to reconstruct
the 3D location of characteristic object points. From
(Torre Ferrero, 2002) an analytical method was taken
that allows for a unique 3D reconstruction of an object
point P, knowing the pixel sets (u
1
, v
1
) and (u
2
, v
2
) of
P’s projection into two different image planes I
1
and
I
2
. The camera’s projection matrices, that are com-
posed of the camera’s extrinsic and intrinsic parame-
ters (Gonzal
´
ez Jim
´
enez, 1999), are also needed for re-
construction. These parameters were obtained for ev-
ery camera by applying a camera calibration method
based on (J. Heikkil
¨
a et al., 1997). For more details on
camera projection principles and reconstruction meth-
ods, please consult (Gonzal
´
ez Jim
´
enez, 1999) and
(Torre Ferrero, 2002).
2.2 Camera Setup of the Vision System
A triplet of network cameras was installed to watch
the robot’s workspace. Camera images can be ob-
tained by sending an image request signal to their IP
address over a Local Area Network (LAN). For ev-
ery camera, a video stream of images using ActiveX
components is activated. Images are taken out of the
video stream and saved as image matrices of dimen-
sion 480x640x3 in the Red Green Blue (RGB) image
space. A pc is used to perform image processing op-
erations. The cameras were collocated in a triangular
pattern and mounted on the ceiling above the robot’s
workspace.
2.3 Object Detection and
Reconstruction Methods
In industrial settings, image processing times need to
be small. Preliminary knowledge about the object’s
color and shape is therefore often used to detect obsta-
cles in the robot’s workspace as quickly as possible.
For the experimental setup of our vision system, we
worked with a foam obstacle of parallelepiped struc-
ture. The motion of the obstacle is achieved by simply
dragging the foam into the robot’s workspace with a
rope. Because it is not within the scope of this paper,
no attention was given to the detection of the robot’s
arm, nor to the detection of humans or objects of other
form than a parallelepiped. In the next sections, we
will introduce the vision techniques that were used
for the detection of a moving obstacle and for the re-
construction of its 3D position. The reconstruction
method is based on the technique of epipolar lines,
which form a useful geometric restriction in vision
applications.
2.3.1 Obstacle Observation
The obstacle of parallelepiped form is detected in an
image by converting this image to binary form and
subsequently check for the presence of contours of
squared form, using a simple criterion that relates a
square’s perimeter to its area. The presence of the ob-
stacle is checked by drawing the image of one camera
out of the activated video stream every 50 millisec-
onds and by applying the square detection criterion.
When a moving obstacle is detected for the first
time in the workspace, the ASSYS halts all robot mo-
tion. Only if the obstacle stops moving within a cer-
tain number of time frames after it had first been de-
tected, the robot will resume its motion, now moving
around the obstacle. By taking subsequent images out
of the video stream of the same camera and resting
ICINCO 2008 - International Conference on Informatics in Control, Automation and Robotics
18