Mastery Profiling Through Entity Linking - To Support Project Team Formation in Higher Education

Alexander M. Olieman, Frank Nack

Abstract

Computer-supported group formation enables educators to assign students to project teams. The focus in this paper is placed on gathering data about student attributes that are relevant in the context of specific course projects. We developed a method that automatically produces learner models from existing documents, by linking students to topics and estimating the levels of skill, knowledge, and interest that students have in these topics. The method is evaluated in an experiment with student participants, wherein its performance is measured on two levels. Our results demonstrate that it is possible to link students to topics with high precision, but suggest that estimating mastery levels is a more challenging task.

References

  1. Bull, S. & Kay, J., 2007. Student Models that Invite the Learner In: The SMILI:-) Open Learner Modelling Framework. International Journal of Artificial Intelligence in Education, 17(2), pp.89-120.
  2. Craig, M., Horton, D. & Pitt, F., 2010. Forming reasonably optimal groups: (FROG). In Proceedings of the 16th ACM international conference on Supporting group work. pp. 141-150.
  3. Dai, H. et al., 2012. From Entity Recognition to Entity Linking: A Survey of Advanced Entity Linking Techniques. In The 26th Annual Conference of the Japanese Society for Artificial Intelligence. pp. 1-10.
  4. Daiber, J. et al., 2013. Improving Efficiency and Accuracy in Multilingual Entity Extraction. In Proceedings of the 9th International Conference on Semantic Systems. Austria, Graz.
  5. Dunning, D. et al., 2003. Why people fail to recognize their own incompetence. Current Directions in Psychological Science, 12(3), pp.83-87.
  6. Etzioni, O. et al., 2011. Open information extraction: The second generation. In Proceedings of the 22nd international joint conference on Artificial Intelligence. pp. 3-10.
  7. Han, X., Sun, L. & Zhao, J., 2011. Collective entity linking in web text: a graph-based method. In Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval. pp. 765-774.
  8. Hoogendoorn, S.M., 2013. Diversity and team performance: A series of field experiments. PhD Thesis. University of Amsterdam. Available at: http://dare.uva.nl/record/440433.
  9. Jackson, S., May, K. & Whitney, K., 1995. Understanding the dynamics of diversity in decision-making teams. In R. A. Guzzo, E. Salas, & Associates, eds. Team Effectiveness and Decision Making in Organizations. San Francisco, pp. 204-261.
  10. Kyprianidou, M. et al., 2011. Group formation based on learning styles: can it improve students' teamwork? Educational Technology Research and Development, 60(1), pp.83-110.
  11. Lingard, R. & Berry, E., 2002. Teaching teamwork skills in software engineering based on an understanding of factors affecting group performance. In Frontiers in Education Conference. Boston, MA: IEEE.
  12. Livingstone, D. & Lynch, K., 2000. Group Project Work and Student-centred Active Learning: Two different experiences. Studies in Higher Education, 25(3), pp.325-345.
  13. Magnisalis, I., Demetriadis, S. & Karakostas, A., 2011. Adaptive and Intelligent Systems for Collaborative Learning Support: A Review of the Field. IEEE Transactions on Learning Technologies, 4(1), pp.5- 20.
  14. Mendes, P., Jakob, M., et al., 2011. DBpedia Spotlight: Shedding Light on the Web of Documents. In Proceedings of the 7th International Conference on Semantic Systems (I-Semantics). Austria, Graz.
  15. Mendes, P., Daiber, J., et al., 2011. Evaluating DBpedia Spotlight for the TAC-KBP Entity Linking Task. In Proceedings of the TAC-KBP 2011 Workshop. Gaithersburg, USA.
  16. Ounnas, A., 2010. Enhancing the Automation of Forming Groups for Education with Semantics. PhD Thesis. University of Southampton. Available at: http://eprints.soton.ac.uk/171641/.
  17. Ounnas, A., Davis, H. & Millard, D., 2009. A framework for semantic group formation in education. Educational Technology & Society, 12(4), pp.43-55.
  18. Rao, D., McNamee, P. & Dredze, M., 2013. Entity linking: Finding extracted entities in a knowledge base. In T. Poibo et al., eds. Multi-Source, Multilingual Information Extraction and Summarization. Berlin, Heidelberg: Springer Berlin Heidelberg, pp. 93-115.
  19. Rodriguez, M. A. & Neubauer, P., 2011. The Graph Traversal Pattern. In S. Sakr & E. Pardede, eds. Graph Data Management: Techniques and Applications. IGI Global.
  20. Wells, C. E., 2002. Teaching Teamwork in Information Systems. In E. Cohen, ed. Challenges of Information Technology Education in the 21 st Century. pp. 1-24.
  21. Werbel, J.D. & Johnson, D. J., 2001. The Use of Person - Group Fit for Employment Selection?: A Missing Link in Person - Environment Fit. Human Resource Management, 40(3), pp.227-240.
  22. Wetz, P. et al., 2012. Matching Linked Open Data Entities to Local Thesaurus Concepts. In Proceedings of the ISEMANTICS 2012 Posters & Demonstrations Track. pp. 6-11.
  23. Wilkinson, I. A. G. & Fung, I. Y. Y., 2002. Small-group composition and peer effects. International Journal of Educational Research, 37(5), pp.425-447.
  24. Winter, M., 2004. Developing a Group Model for Student Software Engineering Teams. MSc Thesis. University of Saskatchewan. Available at: http://hdl.handle.net/ 10388/etd-07052004-140018.
Download


Paper Citation


in Harvard Style

M. Olieman A. and Nack F. (2014). Mastery Profiling Through Entity Linking - To Support Project Team Formation in Higher Education . In Proceedings of the 6th International Conference on Computer Supported Education - Volume 1: CSEDU, ISBN 978-989-758-020-8, pages 182-190. DOI: 10.5220/0004764001820190


in Bibtex Style

@conference{csedu14,
author={Alexander M. Olieman and Frank Nack},
title={Mastery Profiling Through Entity Linking - To Support Project Team Formation in Higher Education},
booktitle={Proceedings of the 6th International Conference on Computer Supported Education - Volume 1: CSEDU,},
year={2014},
pages={182-190},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004764001820190},
isbn={978-989-758-020-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 6th International Conference on Computer Supported Education - Volume 1: CSEDU,
TI - Mastery Profiling Through Entity Linking - To Support Project Team Formation in Higher Education
SN - 978-989-758-020-8
AU - M. Olieman A.
AU - Nack F.
PY - 2014
SP - 182
EP - 190
DO - 10.5220/0004764001820190