For the simulated values the so called ”wizard of oz
method” (Kelley, 1984) was used whereas a facili-
tator had access to the patient interface. Hence he
was able to generate specific data like upcoming error
messages or warnings as well as live vital data which
can be shown during the training.
As a consequence of the missing live data acquira-
tion the test team decided not to involve real patients
as participants for the test. It might have been too dan-
gerous not being able to see their live data in the train-
ing. Further on a complicated petition in the clinic
would have been needed to allow for real patients as
test persons. However, as the main reason for this
study was to reach the motivation barrier and to eval-
uate minor usability issues, it seemed to be acceptable
to take non-patients into account.
Six employees of the Sch
¨
uchtermann Klinik in the
age of 51 to 64 years have been chosen. None of them
has had any contact or involvement with the OSAMI-
D project before. Four participants were male and
two female. Therefore they represented the potential
user group quite well. Most of them are employed
as medical staff except one who was in the facility
management. Their affinity for computer is widely
distributed, but at least everyone uses a computer at
work.
As mentioned in the method section, we asked the
participants to think out loud while using the patient
interface. This helps to understand their behaviour
and to get an idea of what they are thinking. In addi-
tion to the audio signal we recorded the patient itself
using a webcam and captured the screen of the pa-
tient interface in parallel. A specific software helped
recording simultaneously i.e. the audio and video
streams. In this setting one person moderated the ses-
sion while two others handled the recordings and took
notes.
The evaluation was structured into four parts. In
the first part, the participants were being introduced.
After that a pre-interview was done in which demo-
graphic and personal data was collected. The partic-
ipants were also asked about their expectations and
knowledge of the ergometer training procedure. The
third part was the main part of the evaluation - the
usability test itself. As the subjects finished the us-
ability test, they were interviewed a last time. In this
post-interview they were asked about their impression
of the patient interface and also how they think about
this training procedure for real patients.
Each evaluation took about 30 to 45 minutes per
participant (6 to 10 minutes introduction and pre-
interview, 18 to 25 minutes for the usability test, and
6 to 10 minutes post-interview and farewell).
3.3 Results
As an overall result it turned out that most of the mi-
nor usability weaknesses have been solved properly
and that the new concept seems to be usable at all.
The implementation of news feeds was very high ac-
cepted by the participants. However, because of the
short duration of the major test it could not be clearly
examined if this entertainment feature really could be
an improvement of the monotonous training in the
long term. There are strong indices based on the user
feedback but further evaluation is needed.
Even if we did not found any serious usability
problems, there has to be done some rework in the
detail. Four major issues need to be improved:
• Trainingstart
• Switch between views in the training
• Vocabulary and icons
• Some interactions and metaphors with the touch
screen
The first issue is the trainingstart. Currently, the
training is started immediately after pressing the OK
button after the sensors have been connected success-
fully. The problem is, that not a single user realized
that the training needed to be actually started. It took
up to two minutes for some users to realize being al-
ready in the training session, which already started
(most participants needed about 30 seconds). It would
be better if a countdown - similar to computer games
- would run and the training starts not until the count-
down ran off. This is an issue that is important for
all automatic applications in the medical field that re-
quires the patient to start at a certain time.
The second issue is the switch between the views
in the training (the standard view shows the vital data
curves while the second alternative is the entertain-
ment system currently showing a news feed) . At the
moment it is realized with a button-like metaphor but
there is now visual connection between the buttons
and the view area. In this case a tab like metaphor
would make a lot more sense, even if users could fa-
miliarize with the button metaphor after a training pe-
riod.
The third issue is about the vocabulary and the
icons. In the patient interface some medical terms
were used, that are even unknown to the users, who
are employed as medical staff. An example for this
is the term ”SpO
2
” (meaning oxygen saturation). Ac-
cording to the statement of the chief of the medical
technical department, especially SpO
2
is a measure-
ment parameter that could be hard to interpret for reg-
ular patients. So it could be better to give the patient
USER CENTERED DESIGN PROCESS OF OSAMI-D - Developing User Interfaces for a Remote Ergometer Training
Application
271