When using analytic rating scales to assess EFL essay writing, each component of the scale is usually understood to reflect a single distinct rhetorical features (RF), such as Content or Organization. However, it is possible for a component to have traits in common with other components in the scale, making scoring of some of these components redundant and therefore inefficient. The present study examines the construct validity of analytic rating scales by investigating the interrelationships among the components associated with the rhetorical features: Content, Organization, Cohesion, and Voice. 70 essays, written by Keio High School students, were scored and analyzed in this study. Multiple regression analyses were performed to investigate the extent to which scores of Content can be predicted from the scores of the other RF. The findings indicate that Voice is the most significant feature contributing to the prediction of Content scores. The study also illustrates a high correlation between Organization and Cohesion. It is suggested that basing an analytic rating scale on two components alone — Content and Organization — is sufficient to provide an accurate and more efficient assessment of RF in EFL essay writing.

研究論文