A STUDY ON INTRA-RATER RELIABILITY OF STUDENTS’ SELF-ASSESSMENT OF THEIR ENGLISH WRITING

Ida Isnawati

Abstract


The study is an attempt to estimate the intra-rater reliability of students’ self-assessment of their writing performances and to find out whether rater training improves the reliability. The rater training used is adapted from the model developed by Herman, Aschbacher and Winters(1992). This quantitative study which employed equivalent time-samples design has two variables; they were the reliability coefficient of students’ self-assessment and the rater training. The data were collected by asking 25 students conducting self-assessment on their four writing tasks and analyzed using Spearman coefficient correlation. It was found that the rs were 0.798, 0.772, 0.699 and 0.637; it showed that the consistency within students in assessing their own writing was moderately high. However, the rs of the intra-rater reliability of the self-assessment after the treatments is not higher than that of other experience being available in the absence of the treatment. It is concluded that rater training has not been able to improve the intra-rater reliability.

Keywords


self-assessment; intra-rater reliability; rater training; writing

References


Ary, D., Jacobs, L.C., & Razavieh, A. 2010. Introduction to Research in Education. Wadsworth: Cengage Learning

Brown, H. D. 2001. Teaching by Principles: An Interactive Approach to Language Pedagogy. White Plains, NY: Addison Wesley Longman.

Brown, H.D. 2004. Language Assessment: Principles and Classroom Practices. White Plain, New York: Pearson Education

Cohen, A.D. 1994. Assesing Language Ability in the Classroom (2nd Edition). Wadsworth: Heinle & Heinle Publishers

Djiwandono, M. S. 2008. Tes Bahasa. Jakarta: Indeks

Hughes, A. 1989. Testing for Language Teachers. Cambridge: Cambridge University Press

Macias, Ana H. 2002. Alternative Assessment: Responses to Commonly Asked Questions. In Richards, Jack C. & Renandya, Willy A. 2002.

Methodology in Language Teaching: An Anthology of Current Practice. Cambridge: Cambridge University Press, page 339

Munoz, A & Alfarez, M. 2007. Students’ Objectivity and Perception of Self Assessment in an EFL Classroom. The Journal of ASIA TEFL Vol. 4 No. 2, pp. 1-25. Summer 2007

O’Malley, J. M. & Pierce, V. P.1996. Authentic Assessment for English Language Learners. Addison-Wesley Publishing Company

Richards, J. C. 2002. 30 Years of TEFL/TESL: A personal Reflection. The 50th TEFLIN International Conference, Surabaya. 29,30, 31 October 2002. page 32

Rini, N. 2011. Improving the Intrarater Reliability of Self-Assessment of English Speaking Performance. English Education Journal. Vol. 1 No.1.

Tuckman, B.W. 1999. Conducting Educational Research (5th Edition) Orlando: Harcourt Brace & Company.

Weigle, S. C. 2002. Assessing Writing. Cambridge: Cambridge University Press


Refbacks

  • There are currently no refbacks.




___________________________

Jurnal Bahasa Lingua Scientia

Pusat Pengembangan Bahasa - IAIN Tulungagung
Jalan Mayor Sujadi Timur No. 46 Tulungagung 66221 [Google Maps]

Telp. (0355) 321513