2005). The design of the remote internetworking
laboratory (RIL) is aimed at delivering an effective
remote laboratory experience moderated by the
laboratory facilitators.
4 RIL INSTRUCTIONAL
SCENARIO
In the RIL environment, students typically work in
groups of 2-3 per group in the introductory and
intermediate laboratory experiments. In advanced
laboratory experiments, they still have to configure
the networking equipment individually and then
have to interact as a group with the equipment. It is
essential that the remote site laboratory design
makes use of active learning strategies in a
collaborative environment (Palloff and Pratt, 2003)
(Hiltz et al., 2000) (Jonassen et al., 1999) (Wenger,
1998). The activities in the remote laboratory are
modeled to implement the nine instructional
objectives as outlined by Gagne et al. (Gagne et al.,
1992): 1) gain student attention, 2) inform students
of the objective, 3) recall prior learning, 4) present
stimuli, 5) provide learning guidance, 6) elicit
performance, 7) provide feedback, 8) assess
performance and 9) enhance retention. A typical
remote online INWK laboratory exercise requires
students to configure, analyze and troubleshoot the
performance of the routing information protocol
(RIP). Each group is assigned Internetworking
devices in the StudentNet (see Figure 1) for
configuration. The RIP experiment first requires
each student learn to configure RIP on a router.
Students capture and analyze the data packets using
sniffers or protocol analyzers. The convergence of
the RIP protocol is observed and analyzed by
capturing routing protocol updates after intentionally
generating a link failure event in the network. The
typical work scenario in this environment is
discussed in (Sivakumar and Robertson, 2004). All
necessary wiring needed for this exercise is made in
advance at the Halifax equipment facility. The
wiring diagrams for laboratory equipment is
available from the program website. In the following
sections we measure the usability and student
instructional experience in the RIL.
5 RIL USABILITY
The usability of an e-laboratory system is a function
of system design and is determined by factors
including ease of use, interactivity with the system,
system accessibility, system reliability, availability
of online help including lab handouts and wiring
diagram information, support for multiple
simultaneous interactions, system responsiveness,
appropriateness of system response to student input,
authenticity and state of art-ness of the networking
laboratory environment, feedback from the lab
instructor, and hands-on feeling. A survey
questionnaire that has been developed based on
these 12 issues is summarized in the Table 1.
Students were asked to respond on a five point
scale of 1-5, from very poor, poor, satisfactory, good
to very good, the usability of the online remote
equipment laboratory. The survey was conducted as
an anonymous post-course evaluation of the RIL
environment design, organization and performance.
Of a sample size of 83 students over 3 years (2004,
2005 and 2006), a total of 65 students took part
voluntarily in the survey once. In determining the
sample size the factors that played a major role are
the student enrolment in these years. On average, the
program intake consists of 28-30 students each year.
Table 2 gives the cumulative percentages of students
in these 3 years who rated the 12 different aspects of
the online lab as very good, good or satisfactory.
Table 3 gives the mean rating, the standard deviation
and confidence measure for the 12 aspects of the
remote laboratory. From Tables 2 and 3 it is seen
that the students are highly satisfied with the
technical design of the RIL environment as reflected
by the cumulative (2004, 2005 and 2006) results for
ease-of-use, response time, accessibility, reliability,
system response characteristics, authenticity, and the
“state-of-art”-ness of the equipment. Over 90% of
the students rated these technical characteristics of
the INWK networking equipment to be satisfactory,
good or very good. 87% of students rated the state-
of-art-ness of the networking environment to be
satisfactory or good or very good. Also, the students
are highly satisfied with the format of the online
wiring information and laboratory handouts as over
90% of students rated these to be satisfactory or
good or very good. The level of interactivity is
generally considered a key indicator of quality [20].
Tables 2 and 3 indicate that, although 83% of
students rated the interactivity with laboratory
components to be satisfactory or good or very good,
only 80% of students rated the level of “hands on”
feeling experienced in lab sessions to be satisfactory
or good or very good. Hence, the program needs to
improve student interactivity with laboratory
equipment and the “hands-on” feeling experienced
by the student to improve the quality of interaction
USABILITY AND INSTRUCTIONAL EXPERIENCE IN A WEB-BASED REMOTE INTERNETWORKING
LABORATORY ENVIRONMENT
175