The Issue of Readability in the Chilean EFL Textbook
Article Sidebar
Main Article Content
Abstract
At the end of high school in Chile, it is expected that students achieve a B1 English language proficiency level. In the present article, we measure the level of readability of the texts used in the new EFL Chilean textbook and compare it with the readability level of the texts used in the Cambridge B1 preliminary exam to check its appropriacy. The results reveal that, even though the classic readability indices show a similar level of difficulty in the texts, the index RDL2, which is specific for second language learning, shows that there is a statistically significant difference. This finding indicates that the texts in the Chilean EFL textbook are more difficult to read than the ones students are supposed to read. Implications at a local and international level are then shared.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The authors of the manuscripts accepted for publication in HOW journal are required to sign a nonexclusive license agreement allowing ASOCOPI to reproduce the full text on the Internet or in any other available source. Authors retain copyright of their manuscripts with the following restrictions: first publication is granted to ASOCOPI; nonexclusive agreements with third parties can be established as long as the original publication in the HOW journal is properly acknowledged.
References
Bailin, A., & Grafstein, A. (2016). Readability: Text and context. Palgrave Macmillan.
Bernstein, B. (1990). The structuring of pedagogic discourse: Class, codes & control (Vol. IV). Routledge.
Bormuth, J. R. (1971). Development of standards of readability: Toward a rational criterionof passage performance. U. S. Department of Health, Education and Welfare (ERICDoc. No. ED O54 233).
British Council. (2015). English in Chile. An examination of policy, perceptions and influencing factors. British Council, Santiago. http://www.teachingenglish.org.uk/sites/teacheng/files/English%20in%20Chile.pdf
Brown, J. D. (1998). An EFL readability index. JALT Journal, 20, 7–36.
Brown, J. D., Janssen, G., Trace, J., & Kozhevnikova, L. (2012). A preliminary study of cloze procedure as a tool for estimating English readability for Russian students. Second Language Studies, 31(1), 1–22.
Cambridge University Press. (2019). B1 Preliminary 1 with answers. Cambridge University Press.
Cambridge University Press. (2020). B1 Preliminary 2 with answers. Cambridge University Press.
Campos, D., Contreras, P., Riffo, B., Véliz, M., & Reyes, A. (2014). Complejidad textual, lecturabilidad y rendimiento lector en una prueba de comprensión en escolares y adolescentes. Universitas Psychologica, 13(3), 15-36.
Carcamo, B. (2018). Types of listening comprehension promoted in the Chilean EFL textbook Global English. Colombian Applied Linguistics Journal, 20(1), 49-61.
Carcamo, B. (2020). Readability and types of questions in Chilean EFL high school textbooks. TESOL Journal, 11(2), e498. https://doi.org/10.1002/tesj.498
Carrasco‐Bahamonde, J., & Carrasco‐Bahamonde, D. (2018). Mapping of the educational reform in Chile: Market, competence and school improvement. Revista Braseleira de Educação, 23, 1–19. https://doi.org/10.1590/s1413-24782018230080
Cheng, Y-S., & Chang, S-C. (2022). Do senior high school English textbooks sufficiently prepare students for the high-stakes college entrance examinations? A corpus-based analysis of text difficulty. Journal of Textbook Research, 15(1), 43-80.
Crossley, S. A., Greenfield, J., & McNamara, D. S. (2008). Assessing text readability using cognitively based indices. TESOL Quarterly, 42, 475–493.
Crossley, S., Allen, D., & McNamara, D. (2011). Text readability and intuitive simplification: A comparison of readability formulas. Reading in a Foreign Language, 23(1), 84-101.
Crossley, S., Skalicky, S., Dascalu, M., McNamara, D., & Kyle, K. (2017). Predicting text comprehension, processing, and familiarity in adult readers: new approaches to readability formulas. Discourse Processes, (5/6), 340-359.
Dale, E., & Chall, J. (1948). A formula for predicting readability: Instructions. Educational Research Bulletin, 27(2), 37-54.
Díaz Larenas, C., Alarcón Hernández, P., & Ortiz Navarrete, M. (2015). A case study on EFL teachers’ beliefs about the teaching and learning of English in public education. Porta Linguarum, 23, 171-186.
Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41, 1149-1160.
Flesch, R. (1943). Marks of readable style: A study in adult education. Teachers College Press.
Flesch, R. (1948). A new readability yardstick. Journal of Applied Psychology, 32, 221–233. https://doi.org/10.1037/h0057532
Glas, K. (2008). El inglés abre puertas… ¿a qué? Análisis del discurso sobre la enseñanza del inglés en Chile, 2003-2006. Revista Educación y Pedagogía, 20(51), 111-122.
Gobierno de Chile. (2014). Estrategia nacional de inglés/National English strategy 2014-2030. https://www.economia.gob.cl/wp-content/uploads/2014/03/140307-Documento-Estrategia-Nacional-de-Ingl%C3%A9s-2014-2030.pdf
Greenfield, G. (1999). Classic readability formulas in an EFL context: Are they valid for Japanese speakers? [Unpublished doctoral dissertation]. Temple University, Philadelphia, PA, United States. (University Microfilms No. 99–38670).
Greenfield, J. (2004). Readability formulas for EFL. JALT Journal, 26, 5–24.
Gupta, R. (2013). The readability of English language texts in the primary grades. Language in India, 13, 534–544.
Hakim, A., Setyaningsih, E., & Cahyaningrum, D. (2021). Examining the readability level of reading texts in English textbook for Indonesian Senior high school. Journal of English Studies, 6(1), 18-35.
Hamsik, M. J. (1984). Reading, readability, and the ESL reader [Unpublished doctoral dissertation]. University of South Florida.
Handayani, R., Furaidah, F., Ivone, F. (2020). The readability level of reading texts in Erlangga Straight Point series: English for eleventh grade students. Journal Pendidikan, 5(11), 1579-1587.
Hedgcock, J., & Ferris, D. (2009). Teaching readers of English: Students, texts, and contexts. Routledge.
Hutchinson, T., & Torres, E. (1994). The textbook as agent of change. ELT Journal, 48(4), 315–328.
Ibáñez, R., Moncada, F., & Carcamo, B. (2019). Coherence relations in primary school textbooks: Variation across school subjects. Discourse Processes, 56(8), 764-785.
Kincaid, J., Fishburne, R. P., Rogers, R. L., & Chissom, B. S. (1975). Derivation of new readability formulas (Automated Readability Index, fog count and Flesch Reading Ease Formula) for Navy enlisted personnel. Institute for Simulation and Training, 56.
Leander, M. (2016). An analysis of readability of standard measurements in English textbooks by Swedish publishers from the 90s to 2016. http://www.divaportal.org/smash/get/diva2:1066146/FULLT EXT01.pdf
Lin, C. (2010). Evaluating readability of a university Freshman EFL reader. In Y.‐J. Chen, S.‐J. Huang, H.‐C. Liao, & S. Lin (Eds.), Studies in English for professional communications and applications (pp. 75–88). Crane.
Lizasoain, A., & Vargas Mutizabal, J. (2023). Percepciones de los docentes de inglés chilenos acerca de los libros de texto utilizados en establecimientos escolares públicos y privados en Chile. Calidad en la Educación, 58, 35-68.
Maarof, N. (2016). Assessing second language reading. Partridge Publishing.
Martin, J., & Rose, D. (2008). Genre relations: Mapping culture. Equinox.
McNamara, D., Graesser, A., McCarthy, P., & Cai, Z. (2014). Automated evaluation of text and discourse with Coh‐Metrix. Cambridge University Press.
Mieres-Brevis, M. (2020). La dinámica de la desigualdad en Chile: Una mirada regional. Revista de Análisis Económico, 35(2), 91-133.
Nicholls, J. (2003). Methods in school textbook research. International Journal of Historical Learning, Teaching and Research, 3(2), 11–26. https://doi.org/10.2304/rcie.2006.1.1.5
Odo, D. (2018). A comparison of readability and understandability in second language acquisition textbooks for pre-service EFL teachers. The Journal of Asia TEFL, 15(3), 750-765.
OECD. (2021). Chile: focus on reducing inequality to strengthen social and economic recovery from COVID-19. https://www.oecd.org/newsroom/chile-focus-on-reducing-inequality-to-strengthen-social-and-economic-recovery-from-covid-19.htm
Owu-Ewie, C. (2014). Readability of comprehension passages in Junior High School (JHS) English textbooks in Ghana. Ghana Journal of Linguistics, 3(2), 35–68. https://doi.org/10.4314/gjl.v3i2.21
Oxford, R. (2017). Teaching and researching language learning strategies: Self-regulation in context (2nd ed). Routledge.
Pitler, E., & Nenkova, A. (2008). Revisiting readability: A unified framework for predicting text quality. In Proceedings of the 2008 conference on empirical methods in natural language processing (pp. 186-195). Honolulu Hawaii.
Quality Education Agency. (2012). Resultados SIMCE III Medio 2012. https://datos.gob.cl/dataset/resultados_de_simce_2012-prueba_ingles_iii_medio
Quality Education Agency. (2015). Síntesis de resultados de aprendizaje. http://archivos.agenciaeducacion.cl/resultados-2014/Sintesis_Resultados_IIIM_2014.pdf
Quality Education Agency. (2018). Informe de Resultados Estudio Nacional de Inglés III medio 2017. https://archivos.agenciaeducacion.cl/Informe_Estudio_Nacional_Ingles_III.pdf
Rahimi, M., & Hassani, M. (2011). Attitude towards EFL textbooks as a predictor of attitude towards learning English as a foreign language. Procedia—Social and Behavioral Sciences, 31, 66–72. https://doi.org/10.1016/j.sbspro.2011.12.018
Rahmi, U., Riza, A., Yelliza, Y. (2022). Classifying the readability level of reading text on English textbook entitled "Pathway to English" for senior high school eleventh grade. Tell-us Journal, 8(1), 1-10.
Rose, D. (2014). Analysing pedagogic discourse: An approach from genre and register. Functional Linguistics, 1(11), 1-32.
Tabatabaei, E., & Bagheri, M. (2013). Readability of reading comprehension texts in Iranian senior high schools regarding students’ background knowledge and interest. Journal of Language Teaching and Research, 4, 1028–1035.
Toledo-Sandoval, F., & González Hermosilla, A. (2016). El aprendizaje del idioma inglés y desigualdad: formación inicial docente y propuestas curriculares para primero básico. Revista Némesis, 13, 6-22.
Uribe-Enciso, O. (2015). Improving EFL students’ performance in reading comprehension through explicit instruction in strategies. Rastros Rostros, 17(31), 37-52. http://dx.doi.org/10.16925/ra.v17i31.1271
Wolfe, C., Eylem, A., Dandignac, M., Lowe, S., Weber, M., Scudiere, L., & Reyna, V. (2022). Understanding the landscape of web-based medical misinformation about vaccination. Behavior Research Methods. http://dx.doi.org/10.3758/s13428-022-01840-5
Yilorm, Y. (2016). Proceso de enseñanza aprendizaje de la lengua inglesa en escuelas públicas chilenas. Estudios Pedagógicos, 42. http://dx.doi.org/10.4067/S0718-07052016000300009
Zamanian, M., & Heydari, M. (2012). Readability of texts: State of the art. Theory and Practice in Language Studies, 2(1), 43-53. http://dx.doi.org/10.4304/tpls.2.1.43-53
Zarfsaz, E., & Yeganehpour, P. (2021). Grammatical morphemes, conceptual structures and semantic representation. Journal of Language and Linguistic Studies, 17(Special Issue 2), 702-716.