Reliability of Essay Ratings: A Study on Generalizability Theory


Creative Commons License

Atılgan H.

EURASIAN JOURNAL OF EDUCATIONAL RESEARCH, ss.133-150, 2019 (ESCI İndekslerine Giren Dergi) identifier identifier

  • Basım Tarihi: 2019
  • Doi Numarası: 10.14689/ejer.2019.80.7
  • Dergi Adı: EURASIAN JOURNAL OF EDUCATIONAL RESEARCH
  • Sayfa Sayıları: ss.133-150

Özet

Purpose: This study intended to examine the generalizability and reliability of essay ratings within the scope of the generalizability (G) theory. Specifically, the effect of raters on the generalizability and reliability of students' essay ratings was examined. Furthermore, variations of the generalizability and reliability coefficients with respect to the number of raters and optimal number of raters for obtaining optimal reliability of the rating of the writing ability of a student, which is considered to be an implicit trait as a whole and in its sub-dimensions of wording/writing, paragraph construction, and title selection, were determined.