ASSESSING WRITING FLUENCY OF NON-ENGLISH-SPEAKING STUDENT FOR AUTOMATED ESSAY SCORING - How to Automatically Evaluate the Fluency in English Essay

Min-Chul Yang, Min-Jeong Kim, Hyoung-Gyu Lee, Hae-Chang Rim

2012

Abstract

Automated essay scoring (AES) systems have provided a computer-based writing assessment comparable to expert raters. However, the existing systems are inadequate to assess the writing fluency of non-English-speaking students, while they detect grammatical errors relatively well. The writing fluency is one of the important criteria in essay scoring, because most of non-English-speaking students have much difficulty in expressing their thoughts in English. In this paper, we propose an automated essay scoring system focusing on assessing the writing fluency by considering the quantitative factors such as vocabulary, perplexity in a sentence, diversity of sentence structures and grammatical relations. Experimental results show that the proposed method improves the performance in automated essay scoring.

References

  1. Attali, Y. and Burstein, J. (2006). Automated essay scoring with e-rater v.2. The Journal of Technology, Learning and Assessment (JTLA), 4(3).
  2. Attali, Y. and Burstein, J. (2006). Automated essay scoring with e-rater v.2. The Journal of Technology, Learning and Assessment (JTLA), 4(3).
  3. Burstein, J., Wolska, M., and Saarlandes, U. D. (2003). Toward evaluation of writing style: Finding overly repetitive word use in student essays. In In proceedings of EACL-03.
  4. Burstein, J., Wolska, M., and Saarlandes, U. D. (2003). Toward evaluation of writing style: Finding overly repetitive word use in student essays. In In proceedings of EACL-03.
  5. Deshmukh, O., Kandhway, K., Verma, A., and Audhkhasi, K. (2009). Automatic evaluation of spoken english fluency. In ICASSP'09, pages 4829-4832.
  6. Deshmukh, O., Kandhway, K., Verma, A., and Audhkhasi, K. (2009). Automatic evaluation of spoken english fluency. In ICASSP'09, pages 4829-4832.
  7. Foltz, P. W., Laham, D., and Landauer, T. K. (1999). The intelligent essay assessor: Applications to educational technology. Interactive Multimedia Education Journal of Computer enhanced learning On-line journal, 1(2).
  8. Foltz, P. W., Laham, D., and Landauer, T. K. (1999). The intelligent essay assessor: Applications to educational technology. Interactive Multimedia Education Journal of Computer enhanced learning On-line journal, 1(2).
  9. Larkey, L. (1998). Automatic essay grading using text categorization techniques. In In Proceedings of SIGIR-98, pages 90-95.
  10. Larkey, L. (1998). Automatic essay grading using text categorization techniques. In In Proceedings of SIGIR-98, pages 90-95.
  11. Marneffe, M. D., Maccartney, B., and Manning, C. D. (2006). Generating typed dependency parses from phrase structure parses. In In LREC 2006.
  12. Marneffe, M. D., Maccartney, B., and Manning, C. D. (2006). Generating typed dependency parses from phrase structure parses. In In LREC 2006.
  13. Miller, G. A. (1995). Wordnet: A lexical database for english. Communications of the ACM, 38:39-41.
  14. Miller, G. A. (1995). Wordnet: A lexical database for english. Communications of the ACM, 38:39-41.
  15. Quinlan, T., Higgins, D., and Wolff, S. (2009). Evaluating the construct-converage of the e-rater scoring engine.
  16. Quinlan, T., Higgins, D., and Wolff, S. (2009). Evaluating the construct-converage of the e-rater scoring engine.
  17. Stolcke, A. (2002). Srilm - an extensible language modeling toolkit. In ICSLP, pages 901-904.
  18. Stolcke, A. (2002). Srilm - an extensible language modeling toolkit. In ICSLP, pages 901-904.
  19. Sun, G., Liu, X., Cong, G., Zhou, M., Xiong, Z., Lee, J., and yew Lin, C. (2007). Detecting erroneous sentences using automatically mined sequential patterns. In In Proceedings of ACL-07.
  20. Sun, G., Liu, X., Cong, G., Zhou, M., Xiong, Z., Lee, J., and yew Lin, C. (2007). Detecting erroneous sentences using automatically mined sequential patterns. In In Proceedings of ACL-07.
  21. Wang, J. and Brown, M. S. (2007). Automated essay scoring versus human scoring: A comparative study. The Journal of Technology, Learning and Assessment (JTLA), 6(2).
  22. Wang, J. and Brown, M. S. (2007). Automated essay scoring versus human scoring: A comparative study. The Journal of Technology, Learning and Assessment (JTLA), 6(2).
  23. Warschauer, M. Ware, P. (2006). Automated writing evaluation: defining the classroom research agenda. LANGUAGE TEACHING RESEARCH, 10(2).
  24. Warschauer, M. Ware, P. (2006). Automated writing evaluation: defining the classroom research agenda. LANGUAGE TEACHING RESEARCH, 10(2).
Download


Paper Citation


in Harvard Style

Yang M., Kim M., Lee H. and Rim H. (2012). ASSESSING WRITING FLUENCY OF NON-ENGLISH-SPEAKING STUDENT FOR AUTOMATED ESSAY SCORING - How to Automatically Evaluate the Fluency in English Essay . In Proceedings of the 4th International Conference on Computer Supported Education - Volume 2: CSEDU, ISBN 978-989-8565-07-5, pages 83-87. DOI: 10.5220/0003898200830087


in Harvard Style

Yang M., Kim M., Lee H. and Rim H. (2012). ASSESSING WRITING FLUENCY OF NON-ENGLISH-SPEAKING STUDENT FOR AUTOMATED ESSAY SCORING - How to Automatically Evaluate the Fluency in English Essay . In Proceedings of the 4th International Conference on Computer Supported Education - Volume 2: CSEDU, ISBN 978-989-8565-07-5, pages 83-87. DOI: 10.5220/0003898200830087


in Bibtex Style

@conference{csedu12,
author={Min-Chul Yang and Min-Jeong Kim and Hyoung-Gyu Lee and Hae-Chang Rim},
title={ASSESSING WRITING FLUENCY OF NON-ENGLISH-SPEAKING STUDENT FOR AUTOMATED ESSAY SCORING - How to Automatically Evaluate the Fluency in English Essay},
booktitle={Proceedings of the 4th International Conference on Computer Supported Education - Volume 2: CSEDU,},
year={2012},
pages={83-87},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003898200830087},
isbn={978-989-8565-07-5},
}


in Bibtex Style

@conference{csedu12,
author={Min-Chul Yang and Min-Jeong Kim and Hyoung-Gyu Lee and Hae-Chang Rim},
title={ASSESSING WRITING FLUENCY OF NON-ENGLISH-SPEAKING STUDENT FOR AUTOMATED ESSAY SCORING - How to Automatically Evaluate the Fluency in English Essay},
booktitle={Proceedings of the 4th International Conference on Computer Supported Education - Volume 2: CSEDU,},
year={2012},
pages={83-87},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003898200830087},
isbn={978-989-8565-07-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 4th International Conference on Computer Supported Education - Volume 2: CSEDU,
TI - ASSESSING WRITING FLUENCY OF NON-ENGLISH-SPEAKING STUDENT FOR AUTOMATED ESSAY SCORING - How to Automatically Evaluate the Fluency in English Essay
SN - 978-989-8565-07-5
AU - Yang M.
AU - Kim M.
AU - Lee H.
AU - Rim H.
PY - 2012
SP - 83
EP - 87
DO - 10.5220/0003898200830087


in EndNote Style

TY - CONF
JO - Proceedings of the 4th International Conference on Computer Supported Education - Volume 2: CSEDU,
TI - ASSESSING WRITING FLUENCY OF NON-ENGLISH-SPEAKING STUDENT FOR AUTOMATED ESSAY SCORING - How to Automatically Evaluate the Fluency in English Essay
SN - 978-989-8565-07-5
AU - Yang M.
AU - Kim M.
AU - Lee H.
AU - Rim H.
PY - 2012
SP - 83
EP - 87
DO - 10.5220/0003898200830087