The Changes in Text Cohesion of Senior High School Students Measured by Coh‐Metrix as a Function of Grade Level
DOI:
https://doi.org/10.53469/jtpss.2023.03(10).04Keywords:
Text cohesion, Coh‐Metrix, English writing, Senior high school, Grade levelAbstract
National English Curriculum Standards for General High School sets requirements for text cohesion and text cohesion is an essential component of English writing and English writing evaluation. However, previous studies explored text cohesion mainly from perspectives of college students, horizontal comparison and traditional tools. In this study, a corpus of 300 essays by grade level (senior one and senior three) are analyzed computationally by Coh‐Metrix to examine whether text cohesion improves as grade level rises. During the specific process, this paper aims to identify characteristics and discriminate differences between the text cohesion created by the two grades. The main instrument is Coh‐Metrix—a type of computational tool that offers over 200 measurements to quantify texts. This study mainly employs the measures under the category of referential cohesion, LSA and connectives of it to assess text cohesion. The results demonstrate that as the grade level increases, text cohesion gets better. Specifically, these students produce more noun overlap of adjacent sentences, argument overlap of adjacent sentences, noun overlap of all sentences, argument overlap of all sentences, stem overlap of all sentences, LSA overlap of adjacent sentences, LSA overlap of adjacent paragraphs, LSA overlap of given/new sentences all connectives and additive connectives.
References
Andrew Elfenbein. (2011). Comments on Grasser, McNamara, and Kulikowich: Research in Text and the Uses of Coh-Metrix. Educational Researcher, 40(5), 246-248.
Beck, I. L., McKeown, M. G., Omanson, R. C., & Pople, M. T. (1984). Improving the comprehensibility of stories: The effects of revisions that improve coherence. Reading Research Quarterly, 19, 263- 177.
Cain, K., & Nash, H. M. (2011). The influence of connectives on young readers’ processing and comprehension of text. Journal of Educational Psychology, 103(2), 429-441.
Chen An-ni & Guo Ai-ping. (2019). Research on the Coefficient of Difficulty for College English Textbooks Based on Coh-Metrix — A Case Study of New Horizon College English (Third Edition). Theory and Practice of Education, 39(6): 46-48.
Crossley, S. A., & McNamara, D. S. (2012). Predicting second language writing proficiency: The roles of cohesion and linguistic sophistication. Journal of Research in Reading.
DU Huiying & CAI Jinting. (2013). A Coh-Metrix-based model of linguistic features predicting argumentative writing quality of EFL learners. Modern Foreign Languages (Quarterly), 36(3): 293- 299.
Freedman, A., & Pringle, I. (1980). Writing in the college years: Some indices of growth. College Composition and Communication, 31, 311-324.
Graesser, A. C., McNamara, D. S., Louwerse, M. M., & Cai, Z. (2004). Coh-Metrix: Analysis of text on cohesion and language. Behavior Research Methods, Instruments, and Computers, 36, 193-202.
Graesser, A. C., McNamara, D. S., & Kulikowich, J. M. (2011). Coh-Metrix: Providing Multilevel Analyses of Text Characteristics. Educational Researcher, 40(5), 223-234.
GUO Chunjie. (2003). Cognitive Foundations of Textual Coherence. Modern Foreign Languages, (01): 13-21.
JIA Wenfeng & ZHANG Peixin. (2020). Exploring the relationship between textual features and writing quality in TEM8 writing test. Foreign Language Testing and Teaching, (1): 1-8.
JIANG Jinlin. (2016). The Application of Coh-Metrix in Foreign Language Teaching and Research. Foreign Languages in China, 13(5): 59-60.
JIANG Jinlin & HAN Baocheng. (2018). A Study of Reading Text Difficulty of CET6, TOEFL AND IELTS Based on Coh-Metrix. Foreign Languages in China, 15(3): 86-93.
Kellogg, R. T. (2008). Training writing skills: A cognitive developmental perspective. Journal of Writing Research, 1, 1-26.
Landauer, T., McNamara, D. S., Dennis, S., & Kintsch, W. (2007). Handbook of latent semantic analysis.
Latifi, S., & Gierl, M. (2021). Automated scoring of junior and senior high essays using Coh-Metrix features: Implications for large-scale language testing. Language Testing, 38(1), 62-85.
LIANG Maocheng. (2006). A study of coherence in EFL learners’ written production. Modern Foreign Languages, 29(3): 9..
McNamara, D. S. (2001). Reading both high-coherence and low-coherence texts: Effects of text sequence and prior knowledge. Canadian Journal of Experimental Psychology, 55, 51-62.
McNamara D. S., A. C. Graesser, & P. M. Mccarthy. (2014). Automated evaluation of text and discourse with Coh-Metrix. New York: Cambridge University Press.
MIAO Xingwei. (1998). The relationship between cohesion and coherence. Journal of Foreign Languages, (4): 44.
Ministry of Education of the People's Republic of China. (2020). National English Curriculum Standards for General High School (2017 edition, 2020 revision). Beijing: Beijing Normal University Publishing Group.
Scott A. Crossley, Jennifer L. Weston, Susan T. McLain Sullivan & Danielle S. (2011). The Development of Writing Proficiency as a Function of Grade Level :A Linguistic Analysis. Written Communication, 28(3): 282-311.
SHANG Yanzhi. (2015). Cultivating Students' English Written Expression Ability from Text Cohesion. Teaching &Administration, (27): 87-90.
