The Application of Analytical Scales in the Rating of MA theses in Teaching English as a Foreign Language (TEFL)

Abstract

The paper examines the performance of thesis scales as part of the evaluation of TEFL MA theses at the School of English and American Studies, Eötvös Loránd University, between 2011 and 2019. The instruments include classical analyses of raw ratings
for consistency, correlations and significant mean differences between assessors and supervisors and Many-facet Rasch Measurement. The results show a very high level of consistency in responses, with score conversion preserving the consistency
of scoring in the marks awarded, but the agreement between the assessors was low, suggesting a difference between the approach of assessors and supervisors.