AUTHENTICITY AND VALIDITY OF THE IELTS WRITING TEST AS PREDICTOR OF ACADEMIC PERFORMANCE
DOI:
https://doi.org/10.22460/project.v4i1.p105-115Abstract
The International English Language Testing System (IELTS) has become one of the most widely used measurements of English proficiency in the world for academic, professional and migration purposes. For universities in particular, it is expected that applicants’ IELTS scores closely reflect their actual ability in communicating and doing their assignments in English. This study examines the authenticity and predictive validity of the writing section in the IELTS Academic Module by reviewing relevant research on IELTS within the last two decades. In general, those studies have provided evidence that the IELTS writing test suffers from low authenticity and predictive validity, and is thus an inaccurate predictor of a candidate’s performance in writing real-life academic tasks.
References
Al Hajr, F. (2014). The predictive validity of language assessment in a pre-university programme in two colleges in Oman: A mixed-method analysis. International Multilingual Journal of Contemporary Research, 2(2), 121-147.
Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford University Press.
Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: Designing and developing useful language tests (Vol. 1). Oxford University Press.
Bailey, S. (2011). Academic writing: A handbook for international students (3rd ed.). Routledge.
British Council, IDP: IELTS Australia, & University of Cambridge ESOL Examinations. (2007). IELTS Handbook 2007. University of Cambridge Local Examinations Syndicate.
Brown, H. D., & Abeywickrama, P. (2010). Language assessment: Principles and classroom practices (2nd ed.). Pearson Education.
Brown, J. D. (1996). Testing in language programs. Prentice Hall Regents.
Brown, J. D. (2000). What is construct validity? Shiken: JALT Testing & Evaluation SIG Newsletter, 4(2), 8-12. http://hosted.jalt.org/test/bro_8.htm
Brualdi, A. (1999). Traditional and modern concepts of validity (ED435714). ERIC/AE Digest. https://files.eric.ed.gov/fulltext/ED435714.pdf
Buck, G. (2001). Assessing listening. Cambridge University Press.
Charge, N., & Taylor, L. B. (1997). Recent developments in IELTS. ELT Journal, 51(4), 374-380.
Clapham, C. (1996). The development of IELTS: A study of the effect of background on reading comprehension (Vol. 4). Cambridge University Press.
Clapham, C., & Alderson, J. C. (Eds.). (1997). Constructing and trialling the IELTS test. University of Cambridge Local Examinations Syndicate.
Clark, T., & Yu, G. (2020). Beyond the IELTS test: Chinese and Japanese postgraduate UK experiences. International Journal of Bilingual Education and Bilingualism, 1–19. https://doi.org/10.1080/13670050.2020.1829538
Coffin, C., & Hewings, A. (2004). IELTS as preparation for tertiary writing: Distinctive interpersonal and textual strategies. In L. Ravelli & R. A. Ellis (Eds.), Analysing academic writing: Contextualized frameworks (pp. 153-171). Continuum.
Coombe, C., Davidson, P., O'Sullivan, B., & Stoynoff, S. (2012). The Cambridge guide to second language assessment. Cambridge University Press.
Cooper, T. (2013). Can IELTS writing scores predict university performance? Comparing the use of lexical bundles in IELTS writing tests and first-year academic writing. Stellenbosch Papers in Linguistics Plus, 42, 63-79. https://doi.org/10.5842/42-0-155
Cotton, F., & Conrow, F. (1998). An investigation of the predictive validity of IELTS amongst a group of international students studying at the University of Tasmania. IELTS Research Reports, 1(4), 72-115.
Davies, A., Brown, A., Elder, C., Hill, K., Lumley, T., & McNamara, T. (1999). Dictionary of language testing (Vol. 7). Cambridge University Press.
Davies, A. (2008). Assessing academic English: Testing English proficiency, 1950-1989 - The IELTS solution. Cambridge University Press.
Dooey, P., & Oliver, R. (2002). An investigation into the predictive validity of the IELTS Test as an indicator of future academic success. Prospect, 17(1), 36-54. http://hdl.handle.net/20.500.11937/77607
Faigley, L. (2015). The little Penguin handbook (3rd ed.). Pearson Australia.
Feast, V. (2002). The impact of IELTS scores on performance at university. International Education Journal, 3(4), 70-85.
Ferguson, G., & White, E. (1993). A predictive validity study of IELTS: A report commissioned by UCLES. University of Edinburgh, Institute for Applied Language Studies.
Frey, B. (2018). The SAGE encyclopedia of educational research, measurement, and evaluation (Vols. 1-4). SAGE Publications. https://dx.doi.org/10.4135/9781506326139.n535
Green, A. (2007). IELTS washback in context: Preparation for academic writing in higher education. Cambridge University Press.
Horowitz, D. (1991). ESL writing assessments: Contradictions and resolutions. In D. Hamp-Lyons (Ed.), Assessing second language writing in academic contexts (pp. 71-85). Ablex.
IELTS Partners. (n.d.-a). Ensuring quality and fairness. IELTS. https://www.ielts.org/about-the-test/ensuring-quality-and-fairness
IELTS Partners. (n.d.-b). IELTS scoring in detail. IELTS. https://www.ielts.org/ielts-for-organisations/ielts-scoring-in-detail
IELTS Partners. (n.d.-c). Sample test questions. IELTS. https://www.ielts.org/about-the-test/sample-test-questions
IELTS Partners. (n.d.-d). Test format. IELTS. https://www.ielts.org/about-the-test/test-format
Ingram, D. E. (2003, July 10-12). Towards more authenticity in language testing [Paper presentation]. AFMLTA National Conference 2003: Languages Babble, Babel and Beyond, Brisbane, Australia.
Ingram, D., & Bayliss, A. (2007). IELTS as a predictor of academic language performance, Part 1. IELTS Research Reports, 7. https://www.ielts.org/-/media/research-reports/ielts_rr_volume07_report3.ashx
Kabir, S. M. (2018). IELTS Writing Test: Improving cardinal test criteria for the Bangladeshi context. Journal of NELTA, 23(1-2), 76-89. https://doi.org/10.3126/nelta.v23i1-2.23352
Kerstjens, M., & Nery, C. (2000). Predictive validity in the IELTS test: A study of the relationship between IELTS scores and students’ subsequent academic performance. IELTS Research Reports, 3, 85-108. https://www.ielts.org/-/media/research-reports/ielts_rr_volume03_report4.ashx
Liu, D. (2005). Plagiarism in ESOL students: Is cultural conditioning truly the major culprit? ELT Journal, 59(3), 234-241.
Lloyd-Jones, G., Neame, C., & Medaney, S. (2012). A multiple case study of the relationship between the indicators of students’ English language competence on entry and students’ academic progress at an international postgraduate university. IELTS Research Reports, 11, 129-184. https://www.ielts.org/-/media/research-reports/ielts_rr_volume11_report3.ashx
Messick, S. (1986). The once and future issues of validity: Assessing the meaning and consequences of measurement. ETS Research Report Series, 1986(2), i-24. https://doi.org/10.1002/j.2330-8516.1986.tb00185.x
Mickan, P., & Slater, S. (2003). Text analysis and the assessment of academic writing. IELTS Research Reports, 4, 59-88.
Mickan, P., Slater, S., & Gibson, C. (2000). Study of response validity of the IELTS writing subtest. IELTS Research Reports, 3, 29-48. https://www.ielts.org/-/media/research-reports/ielts_rr_volume03_report2.ashx
Moore, S., Mahony, P., & Stroupe, R. (2012). Perceptions of IELTS in Cambodia: A case study of test impact in a small developing country. IELTS Research Reports, 13. https://www.ielts.org/-/media/research-reports/ielts_rr_volume13_report6.ashx
Moore, T., & Morton, J. (2005). Dimensions of difference: A comparison of university writing and IELTS writing. Journal of English for Academic Purposes, 4(1), 43-66. https://doi.org/10.1016/j.jeap.2004.02.001
Müller, A. (2015). The differences in error rate and type between IELTS writing bands and their impact on academic workload. Higher Education Research & Development, 34(6), 1207-1219. https://doi.org/10.1080/07294360.2015.1024627
O’Loughlin, K., & Arkoudis, S. (2009). Investigating IELTS exit score gains in higher education. IELTS Research Reports, 10, 1-86. https://www.ielts.org/-/media/research-reports/ielts_rr_volume10_report3.ashx
Oshima, A., & Hogue, A. (2006). Writing academic English (4th ed.). Pearson Longman.
Paul, A. (2007). IELTS as a predictor of academic language performance, Part 2. IELTS Research Reports, 7. https://www.ielts.org/-/media/research-reports/ielts_rr_volume07_report4.ashx
Pennycook, A. (1996). Borrowing others' words: Text, ownership, memory, and plagiarism. Tesol Quarterly, 30(2), 201-230.
Saville, N., & Hawkey, R. (2004). The IELTS impact study: Investigating washback on teaching materials. In L. Cheng, Y. Watanabe, & A. Curtis (Eds.), Washback in language testing: Research contexts and methods (pp. 73-99). Lawrence Erlbaum Associates.
Shakibaei, G. (2017). On the authenticity of IELTS academic tests. Iranian Journal of Applied Language Studies, 9, 223-254. https://dx.doi.org/10.22111/ijals.2017.4231
Shomoossi, N., & Tavakoli, M. (2010). Authenticity and authentication in language testing: An operational perspective. MJAL, 2(1), 1-26.
Stoynoff, S., & Chapelle, C. A. (2005). ESOL tests and testing. TESOL.
University of Cambridge Local Examinations Syndicate. (2009). IELTS candidate performance in 2008. Research Notes, 36, 30-32.
Uysal, H. H. (2010). A critical review of the IELTS writing test. ELT Journal, 64(3), 314-320. https://doi.org/10.1093/elt/ccp026
Wallace, C. (1997). IELTS: Global implications of curriculum and materials design. ELT Journal, 51(4), 370-373. https://doi.org/10.1093/elt/51.4.370
Weir, C. J. (2005). Language testing and validation. Palgrave McMillan.
Wray, A., & Pegg, C. (2009). The effect of memorized learning on the writing scores of Chinese IELTS test-takers. IELTS Research Reports, 9, 191-216. https://www.ielts.org/-/media/research-reports/ielts_rr_volume09_report5.ashx
Yen, D., & Kuzma, J. (2009). Higher IELTS score, higher academic performance? The validity of IELTS in predicting the academic performance of Chinese students. Worcester Journal of Learning and Teaching, 3. https://eprints.worc.ac.uk/id/eprint/811
Zhang, Y., & Mi, Y. (2010). Another look at the language difficulties of international students. Journal of Studies in International Education, 14(4), 371-388. https://doi.org/10.1177/1028315309336031
Zheng, Y., & Iseni, A. (2017). Authenticity in language testing. Anglisticum, 6(8), 9-14. http://dx.doi.org/10.0001/(aj).v6i8.1500
