Human Ratings and Automated Essay Evaluation

Authored by: Brent Bridgeman

Handbook of Automated Essay Evaluation

Print publication date:  April  2013
Online publication date:  July  2013

Print ISBN: 9781848729957
eBook ISBN: 9780203122761
Adobe ISBN: 9781136334801

10.4324/9780203122761.ch13

 Download Chapter

 

Abstract

Because Automated Essay Evaluation (AEE) systems are typically built to predict human ratings (e.g., Attali & Burstein, 2006; Dikli, 2006; Shermis & Burstein, 2003; and Chapters 2 and 4 in this book), the quality of the human ratings can affect the quality of the scores generated by the automated system. If the human raters are inconsistent and unreliable and/or if they overuse one or two points on the score scale, the machine cannot be effectively trained.

 Cite
Search for more...
Back to top

Use of cookies on this website

We are using cookies to provide statistics that help us give you the best experience of our site. You can find out more in our Privacy Policy. By continuing to use the site you are agreeing to our use of cookies.