Analysing Online Education-based Asynchronous Communication Tools to Detect Students’ Roles

Mohammad Jaber, Panagiotis Papapetrou, Ana González-Marcos, Peter T. Wood

2015

Abstract

This paper studies the application of Educational Data Mining to examine the online communication behaviour of students working together on the same project in order to identify the different roles played by the students. Analysis was carried out using real data from students’ participation in project communication tools. Several sets of features including individual attributes and information about the interactions between the project members were used to train different classification algorithms. The results show that considering the individual attributes of students provided regular classification performance. The inclusion of information about the reply relationships among the project members generally improved mapping students to their roles. However, “time-based” features were necessary to achieve the best classification results, which showed both precision and recall of over 95% for a number of algorithms. Most of these “time-based” features coincided with the first weeks of the experience, which indicates the importance of initial interactions between project members.

References

  1. Alba-Elías, F., González-Marcos, A., and Ordieres-Meré, J. (2013). An ict based project management learning framework. In EUROCON, 2013 IEEE, pages 300- 306.
  2. Alba-Elías, F., González-Marcos, A., and Ordieres-Meré, J. (2014). An active project management framework for professional skills development. International Journal of Engineering Education, 30(5):1242-1253.
  3. Bouckaert, R. (2007). Bayesian Network Classifiers in Weka for Version 3-5-6. The University of Waikato.
  4. Breiman, L. (2001). Random forests. Machine Learning, 45(1):5-32.
  5. Chen, I.-X. and Yang, C.-Z. (2010). Handbook of Social Network Technologies and Applications, chapter Visualization of Social Networks, pages 585-610. Springer, Florida, USA.
  6. Choa, H., Gayb, G., Davidsonc, B., and Ingraffe, A. (2007). Social networks, communication styles, and learning performance in a cscl community. Computers & Education, 49(2):309-329.
  7. Cohen, W. W. (1995). Fast effective rule induction. In Twelfth International Conference on Machine Learning, pages 115-123. Morgan Kaufmann.
  8. Duda, R. O., Hart, P. E., and Stork, D. G. (2000). Pattern Classification. Wiley Interscience, 2 edition.
  9. Friedman, J., Hastie, T., and Tibshirani, R. (2000). Additive logistic regression : A statistical view of boosting. Annals of statistics, 28(2):337-407.
  10. Gaines, B. and Compton, P. (1995). Induction of rippledown rules applied to modeling large databases. Journal of Intelligent Information Systems, 5(3):211-228.
  11. George, S. and Leroux, P. (2002). An approach to automatic analysis of learners' social behavior during computermediated synchronous conversations. In Cerri, S., Gouardères, G., and Paraguau, F., editors, Intelligent Tutoring Systems, volume 2363 of Lecture Notes in Computer Science, pages 630-640. Springer Berlin Heidelberg.
  12. Girasoli, A. J. and Hannafin, R. D. (2008). Using asynchronous av communication tools to increase academic self-efficacy. Computers & Education, 51(4):1676-1682.
  13. Hall, M. and Frank, E. (2008). Combining naive bayes and decision tables. In Proceedings of the 21st Florida Artificial Intelligence Society Conference (FLAIRS), pages 318-319. AAAI press.
  14. Holmes, G., Pfahringer, B., Kirkby, R., Frank, E., and Hall, M. (2001). Multiclass alternating decision trees. In ECML, pages 161-172. Springer.
  15. Hrastinski, S. (2008). The potential of synchronous communication to enhance participation in online discussions: A case study of two e-learning courses. Information & Management, 45(7):499-506.
  16. Kleinberg, J. M. (1999). Authoritative sources in a hyperlinked environment. Journal of the ACM, 46(5):604- 632.
  17. le Cessie, S. and van Houwelingen, J. (1992). Ridge estimators in logistic regression. Applied Statistics, 41(1):191-201.
  18. Lopez, M. I., Romero, C., Ventura, S., and Luna, J. M. (2012). Classification via clustering for predicting final marks starting from the student participation in forums. In EDM'12, pages 148-151.
  19. Martin, B. (1995). Instance-based learning : Nearest neighbor with generalization. Technical report, University of Waikato.
  20. OGC (2009). Managing Successful Projects with PRINCE2TM. Office Of Government Commerce.
  21. Page, L., Brin, S., Motwani, R., and Winograd, T. (1999). The pagerank citation ranking: Bringing order to the web. Technical Report 1999-66, Stanford InfoLab.
  22. Park, J. and Sandberg, I. W. (1991). Universal approximation using radial-basis-function networks. Neural Comput., 3(2):246-257.
  23. Pinheiro, C. A. R. (2011). Social Network Analysis in Telecommunications. John Wiley & Sons, Hoboken, New Jersey.
  24. Platt, J. C. (1998). Fast training of support vector machines using sequential minimal optimization. In Advances in Kernel Methods - Support Vector Learning. MIT Press.
  25. PMI (2008). A Guide to the Project Management Body of Knowledge (PMBOK Guide). Project Management Institute, Newtown Square, PA, USA, 4th edition.
  26. Quinlan, R. (1993). C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers, San Mateo, CA.
  27. Ruck, D. W., Rogers, S. K., Kabrisky, M., Oxley, M. E., and Suter, B. W. (1990). The multilayer perceptron as an approximation to a Bayes optimal discriminant function. IEEE Transactions on Neural Networks, 1(4):296-298.
  28. Witten, I. H., Frank, E., and Hall, M. A. (2011). Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 3rd edition.
  29. Yoo, J. and Kim, J. (2012). Predicting learners project performance with dialogue features in online q&a discussions. In Intelligent Tutoring Systems, volume 7315 of Lecture Notes in Computer Science, pages 570-575. Springer Berlin Heidelberg.
Download


Paper Citation


in Harvard Style

Jaber M., Papapetrou P., González-Marcos A. and Wood P. (2015). Analysing Online Education-based Asynchronous Communication Tools to Detect Students’ Roles . In Proceedings of the 7th International Conference on Computer Supported Education - Volume 2: CSEDU, ISBN 978-989-758-108-3, pages 416-424. DOI: 10.5220/0005445604160424


in Bibtex Style

@conference{csedu15,
author={Mohammad Jaber and Panagiotis Papapetrou and Ana González-Marcos and Peter T. Wood},
title={Analysing Online Education-based Asynchronous Communication Tools to Detect Students’ Roles},
booktitle={Proceedings of the 7th International Conference on Computer Supported Education - Volume 2: CSEDU,},
year={2015},
pages={416-424},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005445604160424},
isbn={978-989-758-108-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 7th International Conference on Computer Supported Education - Volume 2: CSEDU,
TI - Analysing Online Education-based Asynchronous Communication Tools to Detect Students’ Roles
SN - 978-989-758-108-3
AU - Jaber M.
AU - Papapetrou P.
AU - González-Marcos A.
AU - Wood P.
PY - 2015
SP - 416
EP - 424
DO - 10.5220/0005445604160424