undertaken using Rasch analysis. This suggested that
seven of the nine questions in the feedback
questionnaire formed a valid unidimensional scale.
On this small dataset the five response categories for
each item had to be collapsed to four as one of the
options failed to discriminate across the construct.
The two questions that were omitted from analysis
were qualitatively different in that their response
options looked at frequency and time as opposed to
level of agreement.
The system has proved to be very robust and
highly reliable, no inputs provided by students
caused any problems for the software. The system
was left running continuously for several months
with only one system reboot required as a result of a
campus power failure.
8 CONCLUSIONS
A system to allow remote access to experimental
equipment in an education environment has been
specified, developed and tested. The system, named
ReLOAD, uses simple web-forms to allow user
interaction and delivers experimental results also via
standard web pages, hence no specialised client
software or hardware is needed, apart from a java
enabled web browser. Java is used to display video
footage of the experiment, which helps to reinforce
the ‘real’ experimental nature of the results. A
vibrating beam experiment has been used to
demonstrate its efficacy as part of an undergraduate
engineering degree course. 214 students from the
University British Columbia (Canada) completed an
experimental investigation using equipment located
at the University of Leeds (UK). Each student’s
experiment was personalised, ensuring no two
students obtained the same data. Initial results from
a sample of those students who completed the
session are very encouraging. Students report the
system is easy to use and quick to return results,
even from thousands of miles away. Preliminary
analysis of the data suggest students worked to a
high level of precision. The system has proved to be
highly reliable and simple to maintain. It has
allowed more widespread use of high quality
experimental equipment and differences in time
zones between the host and client universities has
resulted in a more even spread of load on the host
universities computer network. Further experiments
have subsequently been developed and more are in
the process of construction. Psychometric analysis of
the student feedback system showed that seven of
the nine items formed a valid scale which could
provide a summary statistic. In addition future
developments may include questions targeted at
specific aspects which would give the students the
opportunity to be more critical of the process. Rasch
analysis could also be utilised to develop online
student assessments that meet the modern
educational standards. This approach would allow
individualised nature of the assessment process to be
accommodated through item banking. The item bank
would be a set of questions where the question
difficulty has been numerically calibrated with
respect to each question. An important aspect of
evaluation, planned for the coming year, is whether
learning outcomes of those students undertaking the
experiments remotely are different form those
undertaking face to face experiments.
ACKNOWLEDGEMENTS
The authors would like to thank National
Instruments and the Higher Education Academy
Engineering Subject Centre for their support.
REFERENCES
Hites, M., 2002. Creating and running undergraduate
experiments controlled through the internet. American
society for engineering education. IL/IN sectional
conference.
Sanchez, J., Morilla, F., Dormido, S., Aranda, J.,
Ruiperez, P., 2000. Virtual and remote control Labs
using Java: A qualitative approach. IEEE Control
systems magazine. pp 8 - 20, April 2000.
Levesley, M.C., Culmer, P., and Cripton, P. 2006. An
Application of Remotely Controlled Experiments to
Perform Feedback-Damping Control of a Vibrating
Beam. Proceedings of the 2
nd
IASTED International
Conference on Education and Technology, Calgary,
Canada. pp233-238.
Chumbley, LS., Hargrave, CP., Constant, K., Hand, B.,
Andre, T., Thompson, EA., 2002. ‘Project ExCEL:
Web-based scanning electron microscope for K-12
education’ Journal of Engineering Education, pp 203-
210.
Esche, SK., Hromin, DJ., 2001. ‘Expanding the
undergraduate laboratory experience using web
technology’ 2001 ASEE annual conference and
exposition.
Harwood, VJ., Alamo, JA, Choudhary, VS., 2004. ‘iLab:
A scalable architecture for sharing online experiments’
international conference on engineering eduation.
Rasch G. Probabilistic models for some intelligence and
attainment tests. Chicago: University of Chicago
Press, 1960 (Reprinted 1980).
DEVELOPMENT AND EVALUATION OF PERSONALISED REMOTE EXPERIMENTS IN AN ENGINEERING
DEGREE
337