With respect to the non-controlled experience, the
students may freely access the Virtual Campus with-
out any restriction of time (but the last delivery time
at the end of the course) or material (slides, tool, bib-
liography) and answer the questions of several tests.
For each of the following data structures
we have provided a suitable test (which can
be obtained from http://www.fdi.ucm.es/profesor/ rdel-
vado/CSEDU2010/) that evaluates the knowledge of
students about the structure: stacks, queues, binary
search trees, balanced trees (AVL and red-black), and
priority queues. Tables have been not included in the
experience as they have been added to the tool very re-
cently. The students may use these tests to verify their
advances in the understanding of the different con-
cepts. The questions are structured in three blocks:
behavior of the structure, implementation of the struc-
ture, and use of the data type by an algorithm.
The resolution of the tests by the students is con-
trolled by the Virtual Campus and our tutoring sys-
tem. The students are recommended to use the tool
and the animations to complement the study of the
data structures and then to answer the test to check
their knowledge. However, if needed, they can con-
sult the educational material: course slides, bibliog-
raphy (Cormen et al., 2001; Weiss, 2005), the tool.
Each test consists approximately of 24 questions dis-
tributed between the three blocks, except the test
about AVL and red-black trees which only pays atten-
tion to implementation, as they are taught as efficient
implementations of binary search trees. Some of the
questions have two possible answers: true or false,
while other has several alternatives. After each ques-
tion, the student tells us whether she/he has needed to
consult some material to answer the question and in
that case which one. When the delivery time is over
the students may know their marks and to the correct
answers also through the Virtual Campus and the tu-
toring system.
Additionally, we have elaborated tests about the
usefulness of the tool for each of the data structures,
where the students manifest the time dedicated to
study the structure, the time dedicated to answer the
test, and also which material is more interesting for
them. The aim of these other tests is to obtain the sub-
jective opinion of the students about the help given by
the tool to learn about the data structures and to know
their study preferences.
In the controlled experience we try to evaluate
more objectively the usefulness of the animations.
In particular we have chosen the animations of the
Kruskal and Prim algorithms for obtaining a mini-
mum spanning tree of a graph. We choose two groups
of students: approximately half of the students are
only given the slides of the course and the data struc-
ture books at class; and the other half are given only
the animations at a computer laboratory. Then, all
the students answered the same questions in one hour
about these algorithms.
5.2 Obtained Results
5.2.1 Non-controlled Experience
We outline here the main conclusions from the re-
sults of the non-controlled experience. With respect
to the material the students used to study, as long as
the structure is more complicated the use of the tool
(simulation, case execution, and tool help) increases
considerably. The better results are obtained in the
AVLs and the red-black trees. The tool helps to visu-
alize the rotations in these balanced trees. In the rest
of the structures they used class material or bibliogra-
phy (Cormen et al., 2001; Weiss, 2005).
When answering the tests questions, the students
were also asked whether they needed additional help
to answer them. In the case of binary search trees and
AVLs they use the tool as much as the class material,
which means that visualization of the operations, such
as eliminations and rotations, are useful for them. In
the case of red-black trees, they used ”other” material
a bit more than the tutorial animation, which presum-
ably consists of a colleague advice.
We can say that although only a small percentage
of students have followed the experience, those who
have done it, both consider the tool as an interesting
material and have used it to complement the rest of the
available material, including the class explanations.
The tool is specially useful for visualizing the most
“complex” operations.
5.2.2 Controlled Experience
This experience was carried out with 59 students. We
gave 32 of them the slides of the course and the data
structure books (Cormen et al., 2001; Weiss, 2005).
The rest were taken to a laboratory, where they could
execute the animations. We gave the same test to both
groups, consisting of 18 questions, 12 of them about
execution aspects of the algorithms, and the rest about
their cost.
In Figure 5 (left) we provide the media and the
standard deviation of the number of correct answers,
the errors, and the number of don’t knows. First, we
observe that students using the animations, answer in
media less questions than the other ones. Besides,
they make more errors than the others. This is due
CSEDU 2010 - 2nd International Conference on Computer Supported Education
18