Adaptive Vocabulary Learning Environment for Late Talkers

Mariia Gavriushenko, Oleksiy Khriyenko, Iida Porokuokka

2016

Abstract

The main aim of this research is to provide children who have an early language delay with an adaptive way to train their vocabulary taking into account individuality of the learner. The suggested system is a mobile game-based learning environment which provides simple tasks where the learner chooses a picture that corresponds to a played back sound from multiple pictures presented on the screen. Our basic assumption is that the more similar the concepts (in our case, words) are, the harder the recognition task is. The system chooses the pictures to be presented on the screen by calculating the distances between the concepts in different dimensions. The distances are considered to consist of semantic, visual and auditory similarities. Each similarity factor can be measured with different methods. According to the user’s feedback, the weights of the factors and similarity distance are adjusted to modify the level of difficulty in further iterations. The system is designed to attempt to retrieve knowledge about the learners by recognition of aspects that are difficult for them. Proposed solution could be considered as a self-adaptive system, which is trying to recognize individual model of the learner and apply it for further facilitation of his/her learning process. The use of the system will be demonstrated in future work.

References

  1. Al-Mubaid, H., Nguyen, H. A., 2006. A cluster-based approach for semantic similarity in the biomedical domain. In 28th Annual International Conference of the IEEE Engineering in Medicine and Biology New York, USA: IEEE Computer Society.
  2. Alvarez, M. A., Lim, S., 2007. A Graph Modelling of Semantic Similarity between Words, In Proc. 2007 International Conference on Semantic Computing, pp. 355- 362.
  3. Astarabadi, S., 1998. Automated retrieval of voicemail using speech recognition. U.S. Patent No. 5,822,405. 13 Oct. 1998.
  4. Beckage, N., Smith, L., Hills, T., 2010. Semantic network connectivity is related to vocabulary growth rate in children. In Proceedings of the 32nd Annual Conference of the Cognitive Science Society, Portland, OR, USA (pp. 2769-2774).
  5. Beckage N., Smith L., Hills T., 2011. Small Worlds and Semantic Network Growth in Typical and Late Talkers. PLoS ONE 6(5): e19348. doi:10.1371/journal.pone.0019348.
  6. Bin, Shi, et al. "Ontology-based measure of semantic similarity between concepts." Software Engineering, 2009. WCSE'09. WRI World Congress on. Vol. 2. IEEE, 2009.
  7. Bouquet, P., Kuper, G., Scoz, M, Zanobini, S., 2004. Asking and answering semantic queries. In Proc. of Meaning Coordination and Negotiation Workshop (MCNW-04) in conjunction with International Semantic Web Conference (ISWC-04), 2004.
  8. Brusilovsky, P., 1999. Adaptive and intelligent technologies for web-based eduction. KI 13.4: 19-25.
  9. Brusilovsky, P., Peylo, C., 2003. Adaptive and intelligent web-based educational systems. International Journal of Artificial Intelligence in Education 13.2: 159-172.
  10. Csikszentmihalyi, M., 1990. Flow: The Psychology of Optimal Experience. Harper Perennial, New York.
  11. Deng, Y., Manjunath, B.S., Kenney, C., Moore, M.S., Shin, H., 2001. An efficient color representation for image retrieval, in Image Processing, IEEE Transactions on , vol.10, no.1, pp.140-147, Jan, doi: 10.1109/83.892450.
  12. Desmarais, C., Sylvestre, A., Meyer, F., Bairati, I., Rouleau, N., 2008. Systematic review of the literature on characteristics of late-talking toddlers. Int'l J. of Lang. and Communication Disorders, 43(4), 361-389.
  13. Docsoft inc., 2009. What is Automatic Speech Recognition? retrieved from: http://www.docsoft.com/ resources/Studies/Whitepapers/whitepaper-ASR.pdf.
  14. Euzenat, J., Shvaiko, P., 2013. Ontology matching. Springer-Verlag, Berlin Heidelberg (DE), 2013, isbn 978-3-642-38720-3.
  15. Gifford T., 2013. Take It Personally: Adaptive Learning. retrieved from http://eltjam.com/adaptive-learning/ Haase, P., Siebes, R., van Harmelen, F., 2004. Peer Selection in Peer-to- Peer Networks with Semantic Topologies. In Proc. of International Conference on Semantics of a Networked World: Semantics for Grid Databases.
  16. Hills, TT, Maouene, J, Riordan, B, Smith, LB, 2010. The Associative Structure of Language: Contextual Diversity in Early Word Learning. Journal of memory and language 63: 259-273.
  17. Hills, TT, Maouene, M, Maouene, J, Sheya, A, Smith, LB, 2009. Longitudinal analysis of early semantic networks: preferential attachment or preferential acquisition? Psychological Science 20: 729-739.
  18. Hirst, G., & St-Onge, D. (1998). Lexical chains as representations of context for the detection and correction of malapropisms. In C. Fellbaum (Ed.), WordNet: An Electronic Lexical Database (pp. 305- 332). MIT Press.
  19. Istenic Starcic, A. and Bagon, S., 2014. ICT supported learning for inclusion of people with special needs: Review of seven educational technology journals, 1970-2011. British Journal of Educational Technology, 45(2), pp.202-230.
  20. Jiang, J., Conrath, W., 1997. Semantic Similarity Based On Corpus Statistics and Lexical Taxonomy. In Proceedings of International Conference Research on Computational Linguistics.
  21. Jones, S., Smith, L., 2005. Object name learning and object perception: a deficit in late talkers. Journal of Child Language, 32, pp 223-240. doi:10.1017/ S0305000904006646.
  22. Kessler, B., 2005. Phonetic comparison algorithms, Transactions of the Philological Society Volume 103:2 243-260.
  23. Kiili, K., 2005. Digital game-based learning: Towards an experiential gaming model. The Internet and higher education 8.1: 13-24.
  24. Kondrak, G., 2005. N-gram similarity and distance. In String processing and information retrieval Springer Berlin Heidelberg: 115-126.
  25. Latecki, L.J., Lakamper, R., 2000. Shape similarity measure based on correspondence of visual parts. In Pattern Analysis and Machine Intelligence, IEEE Transactions on , vol.22, no.10, pp.1185-1190, Oct.
  26. Leacock, C., Chodorow, M., 1998. Combining local context and WordNet similarity for word sense identification, In Fellbaum MIT Press, pp. 265-283, 1998.
  27. Li, Y., Bandar, Z., McLean, D., 2003. An approach for measuring semantic similarity between words using multiple information sources. Knowledge and Data Engineering, IEEE Transactions on, 15(4), 871-882.
  28. Lyytinen, P, Poikkeus, A-M, Laakso, M-L, Eklund, K, Lyytinen, H., 2001. Language development and symbolic play in children with and without familial risk for dyslexia. J Speech Lang Hear Res 2001; 44: 873-85.
  29. Lyytinen, Paula, Kenneth Eklund, and Heikki Lyytinen. "Language development and literacy skills in latetalking toddlers with and without familial risk for dyslexia." Annals of dyslexia 55.2 (2005): 166-192.
  30. Mokotoff, G., 1997. Soundexing and genealogy retrieved from http://www.avotaynu.com/soundex.htm.
  31. Murray, Meg Coffin, and Jorge Pérez. 2015. Informing and Performing: A Study Comparing Adaptive Learning to Traditional Learning. Informing Science: The International Journal of an Emerging Transdiscipline.
  32. Nematzadeh, A., Afsaneh, F., Stevenson, S., 2011. A computational study of late talking in word-meaning acquisition. Proceedings of the 33rd Annual Conference of the Cognitive Science Society.
  33. Newell, A.F., Booth, L. and Beattie, W., 1991. Predictive text entry with PAL and children with learning difficulties. British Journal of Educational Technology, 22(1), pp.23-40.
  34. Oxman, S., Wong, W., D. V. X. Innovations, 2014. White Paper: Adaptive Learning Systems. Snapwiz. Integrated Education Solutions, 1.
  35. Paul, R., Murray, C., Clancy, K., Andrews, D., 1997. Reading and metaphonological outcomes in late talkers. J Speech Lang Hear Res 1997; 40: 1037-47.
  36. Petajan, E., 1990. Electronic facial tracking and detection system and method and apparatus for automated speech recognition. U.S. Patent No. 4,975,960. 4 Dec. 1990.
  37. Potamianos, A., Shrikanth, N., Sungbok, L., 1997. Automatic speech recognition for children. Eurospeech. Vol. 97. 1997.
  38. Preston, J., Frost, S., Mencl, W., Fulbright, R., Landi, N., Grigorenko, E., Jacobsen, L., Pugh, R., 2010. Early and late talkers: school-age language, literacy and neurolinguistic differences. Brain 133 (8): 2185-2195. ISSN: 0006-8950. doi:10.1093/brain/awq163.
  39. Rello, L., Bayarri, C., Gorriz, A., 2012. What is wrong with this word? Dyseggxia: a game for children with dyslexia. In Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility (pp. 219-220). ACM.
  40. Rescorla, L., 2002. Language and reading outcomes to age 9 in late-talking toddlers. J Speech Lang Hear Res 2002; 45: 360-71.
  41. Rescorla, L., 2005. Age 13 language and reading outcomes in late-talking toddlers. J Speech Lang Hear Res 2005; 48: 459-72.
  42. Rescorla, L., 2009. Age 17 language and reading outcomes in late-talking toddlers: Support for a dimensional perspective on language delay. J Speech Lang Hear Res 2009; 52: 16-30.
  43. Richardson, U., Lyytinen, H., 2014. The GraphoGame method: the theoretical and methodological background of the technology-enhanced learning environment for learning to read. An Interdisciplinary Journal on Humans in ICT Environments 10 (1): 39- 60. ISSN: 1795-6889. doi:http://dx.doi.org/10.1701 1/ht/urn.201405281859.
  44. Russell, R., M. Odell.,1918. Soundex. US Patent 1 (1918).
  45. Saleh, R., Alias, N.A., 2012. Learner Needs Analysis for Mobile Learning Comic Application among Dyslexic Children, International Journal Of Education And Information Technologies, vol. 6, no. 2, 2012.
  46. Sánchez, D., Batet, M., Isern, D., Valls, A., 2012. Ontology-based semantic similarity: A new featurebased approach, Expert Systems with Applications, Volume 39, Issue 9, July 2012, Pages 7718-7728, ISSN 0957-4174, http://dx.doi.org/10.1016/j.eswa. 2012.01.082.
  47. Scarborough, HS, Dobrich W., 1990. Development of children with early language delay. J Speech Hear Res 1990; 33: 70-83.
  48. Simard, P., LeCun, Y., Denker, J. S., 1993. Efficient pattern recognition using a new transformation distance. In Advances in neural information processing systems (pp. 50-58).
  49. Singleton, C. and Simmons, F., 2001. An evaluation of Wordshark in the classroom. British journal of educational technology, 32(3), pp.317-330.
  50. Skiada, R., Soroniati, E., Gardeli, A., Zissis, D., 2014. EasyLexia: A mobile application for children with learning difficulties. Procedia Computer Science, 27, 218-228.
  51. Snow, C. E., Burns, M. S., & Griffin, P. (Eds.) (1998). Preventing Reading Difficulties in Young Children. Washington, DC: National Academy Press.
  52. Sonwalkar, N., 2005. Adaptive learning technologies: From one-size-fits-all to individualization. EDUCAUSE Center for Applied Research, Research Bulletin (2005).
  53. Stothard, SE, Snowling, MJ, Bishop, DVM, Chipchase, BB, Kaplan, CA., 1998. Language-impaired preschoolers: a follow-up into adolescence. J Speech Lang Hear Res 1998; 41: 407-18.
  54. Thal, D. J., Bates, E., Goodman, J., Jahn-Samilo, J., 1997. Continuity of language abilities: An exploratory study of late- and early-talking toddlers. Developmental Neuropsychology, 13(3), 239-273.
  55. Venable, M., 2011. Adaptive Learning Technology: An Introduction. Web-site:http://www.onlinecollege.org/20 11/08/30/adaptive-learning-technology-an- introduction/ Wang, L., Zhang, Y., Feng, J., 2005. On the Euclidean distance of images. In Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol.27, no.8, pp.1334-1339, Aug. 2005.
  56. Winkler, W.E., 1999. The state of record linkage and current research problems. In Statistical Research Division, US Census Bureau.
  57. Wu, Z., & Palmer, M. (1994). Verb semantics and lexical selection. In 32nd annual Meeting of the Association for Computational Linguistics (pp. 133-138). Las Cruces, New Mexico: Association for Computational Linguistics.
Download


Paper Citation


in Harvard Style

Gavriushenko M., Khriyenko O. and Porokuokka I. (2016). Adaptive Vocabulary Learning Environment for Late Talkers . In Proceedings of the 8th International Conference on Computer Supported Education - Volume 2: CSEDU, ISBN 978-989-758-179-3, pages 321-330. DOI: 10.5220/0005792603210330


in Bibtex Style

@conference{csedu16,
author={Mariia Gavriushenko and Oleksiy Khriyenko and Iida Porokuokka},
title={Adaptive Vocabulary Learning Environment for Late Talkers},
booktitle={Proceedings of the 8th International Conference on Computer Supported Education - Volume 2: CSEDU,},
year={2016},
pages={321-330},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005792603210330},
isbn={978-989-758-179-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 8th International Conference on Computer Supported Education - Volume 2: CSEDU,
TI - Adaptive Vocabulary Learning Environment for Late Talkers
SN - 978-989-758-179-3
AU - Gavriushenko M.
AU - Khriyenko O.
AU - Porokuokka I.
PY - 2016
SP - 321
EP - 330
DO - 10.5220/0005792603210330