
Table 1: Questionnaire survey results of the usage and operation. 
Items  1 2 
1. Picture of manga after pin awareness sharing operation was easy to view 
**
 
31 1 
2. I carefully considered problems in the children’s experiment while viewing the sharing system 
**
 
29 3 
3. Operations for viewing the manga were easy 
**
 
26 6 
4. It was easy to find the desired manga pages and frames 
**
 
27 5 
5. It was easy to color-code problem importance levels by pin color 
*
 
19 13 
6. The pin entry operation was easy
 n.s.
 
14 18 
7. The operation for discarding entered pins was easy 
*
 
18 14 
8. The operation for changing the color (importance level) of the entered pins was easy 
*
 
19 13 
9. Pin awareness sharing operations were easy 
**
 
28 4 
10. Picture of manga after pin awareness sharing operation were easy to view 
**
 26 6 
11. When using pin awareness sharing operation, important scene search operations were easy
**
 
28 4 
12. It was easy to distinguish other people’s pins from my own
**
 
21 11 
13. It was easy to count the number of entered pins 
**
 
28 4 
N=32  
**
p<.01, 
*
p<.05,  
n.s.
not significant    1: Positive answer, 2: Neutral and Negative answer 
participants responding with a 5 or 4 were classified 
as positive respondents; participants responding with 
a 3, 2, or 1 were classified as negative respondents; 
and the number of each type of respondents was 
tallied. We determined the statistical significance of 
the deviation between the number of positive 
respondents and that of the neutral/negative 
respondents by using a 1 × 2 exact test. 
The results showed no statistically significant 
difference between the number of positive 
respondents and the number of neutral/negative 
respondents for one item (Item 6: Pin awareness 
sharing operations were easy). The number of 
positive responses trended higher for three items 
(Item 5: It was easy to color-code problem 
importance levels by pin color, Item 7: The 
operation for discarding entered pins was easy, and 
Item 8: The operation for changing the color 
(importance level) of entered pins was easy), with 
the difference between the number of positive 
respondents and the number of neutral/negative 
respondents being statistically significant at the 5% 
significance level. For each of the other 11 items, the 
number of positive responses trended higher, with 
the difference between the number of positive 
respondents and the number of neutral/negative 
respondents being statistically significant at the 1% 
significance level. 
Table 2 presents a tally of the responses received 
for the items about sharing of awareness about 
manga frames and a compilation of the results. We 
analysed the results using the same procedure used 
for the usage and operation items, determining the 
statistical significance of the deviation between the 
number of positive respondents and that of 
neutral/negative by using a 1 × 2 exact test. 
As a result, for each of the 9 items (such as Item 
14: Sharing awareness enabled us to discover 
differences in awareness about manga frames and 
Item 20: Sharing awareness enabled a lively 
discussion in the group), the number of positive 
responses trended higher, with the difference 
between the number of positive respondents and the 
number of neutral/negative respondents being 
statistically significant at the 1% significance level. 
4 CONCLUSIONS 
The experimental evaluation results demonstrated 
the following two points: (1)  The system’s interface 
has effective operation. (2) The system effectively 
promotes discussion based on shared awareness 
about manga frames. 
However, there is a need to improve the 
convenience of the interface for the pin entry, 
movement, and erasing functions. Specific changes 
could include improving the response and mounting 
a continuous operation method enabling flick-based 
pin color selection and changes. 
ACKNOWLEDGEMENTS 
This research was supported in part by the Grants-
in-Aid for Scientific Research (A) (No. 24240100)  
and JSPS the Grants-in-Aid for Scientific Research 
(B) (No. 24330251). 
CSEDU2014-6thInternationalConferenceonComputerSupportedEducation
450