On the effectiveness and limitations of captioning in L2 listening
Abstract
Listening is often perceived to be the most challenging skill by second/foreign language (L2) learners. Due to its real-time nature, L2 listeners experience several comprehension problems related to the processing of aural input. To scaffold L2 listening, captioning is commonly used since the dual coding of aural and written stimuli is expected to make L2 input more comprehensible leading to more in-depth processing. However, a survey of the extant literature precludes us from drawing firm conclusions about the effectiveness of captioning since in some circumstances captions were found to have no significant effect on listening comprehension. So, the question of whether captions function as a comprehension aid in L2 listening remains inconclusive. Hence, adopting a narrative literature review methodology, the present study aims to contribute to this inconsistent research area by clarifying some of these issues answering the following questions: (1) Is captioning really effective in L2 listening?, (2) Does captioning always work for L2 listening?, and (3) Why is research on captioning in L2 listening still inconclusive? Based on the insights gained, it is concluded that the mere presence of captions does not necessarily lead to improved comprehension. Captioning effectiveness is influenced by learner, material, measurement, task, and L1/L2 characteristics. Implications arising are discussed.
Full Text:
PDFReferences
Aldera, A. S., & Mohsen, M. A. (2013). Annotations in captioned animation: Effects on vocabulary learning and listening skills. Computers & Education, 68, 60–75. https://doi:10.1016/j.compedu.2013.04.018
Bairstow, D., & Lavaur, J. (2012). Audiovisual information processing by monolinguals and bilinguals: Effects of intralingual and interlingual subtitles. Approaches to Translation Studies, 36, 273–293. https://doi.org/10.1163/9789401207812_016
Baumeister, R. F., & Leary, M. R. (1997). Writing narrative literature reviews. Review of General Psychology, 1(3), 311–320. https://doi.org/10.1037/1089-2680.1.3.311
Behroozizad, S., & Majidi, S. (2015). The effect of different modes of English captioning on EFL learners’ general listening comprehension: Full text vs. keyword captions. Advances in Language and Literary Studies, 6(4), 115–121. https://www.journals.aiac.org.au/index.php/alls/article/view/1626
Bianchi, F. & T. Ciabattoni (2008). Captions and subtitles in EFL learning: An investigative study in a comprehensive computer environment. In A. Baldry, M. Pavesi & C. Taylor Torsello (eds.), From didactas to ecolingua (pp. 69-80). Edizioni Universit`a di Trieste.
Bird, S. A. & Williams, J. N. (2002). The effect of bimodal input on implicit and explicit memory: An investigation into the benefits of within-language subtitling. Applied Psycholinguistics 23(4), 509–533. https://doi.org/10.1017/S0142716402004022
Brett, P. (1995). Multimedia for listening comprehension: The design of a multimedia-based resource for developing listening skills. System, 23(1), 77-85. https://doi.org/10.1016/0346-251X(94)00054-A
Caimi, A. (2006). Audiovisual translation and language learning: The promotion of intralingual subtitles. The Journal of Specialised Translation 6, 85–98. https://www.jostrans.org/issue06/art_caimi.php
Chai, J., Erlam, R., 2008. The effect and the influence of the use of video and captions on second language learning. New Zealand Studies in Applied Linguistics, 14(2), 25-44.
https://search.informit.org/doi/10.3316/INFORMIT.997746379301329
Danan, M. (2004). Captioning and subtitling: Undervalued language learning strategies. Meta 49(1), 67–77. http://www.erudit.org/revue/meta/2004/v49/n1/009021ar.html
De Jong, N. (2005) Can second language grammar be learned through listening? An experimental study. Studies of Second Language Acquisition, 27(2), 205–34 https://doi.org/10.1017/S0272263105050114
Diao, Y., Chandler, P., & Sweller, J. (2007). The effect of written text on comprehension of spoken English as a foreign language. American Journal of Psychology, 120(2), 237–261. https://www.jstor.org/stable/20445397
Gary, J., & Gary, N. (1981). Caution: Talking may be dangerous to your linguistic health. International Review of Applied Linguistics in Language Teaching, 19(1), 1–14. https://doi.org/10.1515/iral.1981.19.1-4.1
Garza, T. J. (1991) Evaluating the use of captioned video materials in advanced foreign language learning. Foreign Language Annals, 24(3), 239–258. https://doi.org/10.1111/j.1944-9720.1991.tb00469.x
Goh, C.C., 2000. A cognitive perspective on language learners’ listening comprehension problems. System 28(1), 55-75. https://doi.org/10.1016/S0346-251X(99)00060-3
Guillory, H. G. (1998). The effects of key word captions to authentic French video in foreign language instruction. CALICO Journal, 15(1-3), 89-108. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.494.3324&rep=rep1&type=pdf
Hwang, G. J., Hsu, T. C., & Hsieh, Y. H. (2018). Impacts of different smartphone caption/subtitle mechanisms on English listening performance and perceptions of students with different learning styles. International Journal of Human–Computer Interaction, 35(4–5), 1–12. https://doi.org/10.1080/10447318.2018.1543091
Hayati, A. and Mohmedi, F. (2011), The effect of films with and without subtitles on listening comprehension of EFL learners. British Journal of Educational Technology, 42(1), 181–192. https://doi.org/10.1111/j.1467-8535.2009.01004.x
Hsieh, Y. (2020). Effects of video captioning on EFL vocabulary learning and listening comprehension. Computer Assisted Language Learning, 33(5-6), 567–589. https://doi.org/10.1080/09588221.2019.1577898
Huang, H. C. & Eskey, D. E. (1999) The effects of closed-captioned television on the listening comprehension of intermediate English as a second language (ESL) students. Journal of Educational Technology Systems, 28(1), 75–96. https://doi.org/10. 2190/RG06-LYWB-216Y-R27G
Hui, W. (2007). The effects of captions on Chinese EFL students’ incidental vocabulary acquisition. Chinese English Language Education Association Journal, 30(4), 9–16. http://en.cnki.com.cn/Article_en/CJFDTotal-WYDH200502011.htm
Jones, R. H. 1997. Beyond ‘listen and repeat’: pronunciation teaching materials and theories of second language acquisition. System, 25(1), 103–12. https://doi.org/10.1016/S0346-251X(96)00064-4
Krashen, S. D. (1985). The input hypothesis: Issues and implications. Laredo Publishing Company.
Latifi, M., Mobalegh, A., & Mohammadi, E. (2011). Movies subtitles and the improvement of listening comprehension: Does it help? The Journal of Language Teaching and Learning, 1(2), 18-29. https://dergipark.org.tr/en/download/article-file/209072
Lee, P.-J., Liu, Y.-T. & Tseng, W.-T. (2019) One size fits all? In search of the desirable caption display for second language learners with different caption reliance in listening comprehension. Language Teaching Research, 25(3), 400-430.
https://doi.org/10.1177/1362168819856451
LeLoup, J. W. & Ponterio, R. (2006). Listening: You've got to be carefully taught. Language Learning & Technology, 1(11), 4–15. http://dx.doi.org/10125/44082
Leveridge, A. N. & Yang, J. C. (2013) Testing learner reliance on caption supports in second language listening comprehension multimedia environments. ReCALL, 25(2), 199–214. https://doi.org/10.1017/S0958344013000074
Leveridge, A. N. & Yang, J. C. (2014) Learner perceptions of reliance on captions in EFL multimedia listening comprehension. Computer Assisted Language Learning, 27(6), 545–559. https://doi.org/10.1080/09588221.2013.776968
Liversidge, G. B. (1999). The Role of closed captioning in second language acquisition. Bell & Howell Company.
Markham, P. (1999). Captioned videotapes and second language listening word recognition. Foreign Language Annals, 32(3), 321-328. https://doi.org/10.1111/j.1944-9720.1999.tb01344.x
Markham, P. L., Peter, L. A. & McCarthy, T. J. (2001) The effects of native language vs. target language captions on foreign language students’ DVD video comprehension. Foreign Language Annals, 34(5), 439–445. https://doi.org/10.1111/j.1944- 9720.2001.tb02083.x
Markham, P. & Peter, L. (2003) The influence of English language and Spanish language captions on foreign language listening/reading comprehension. Journal of Educational Technology Systems, 31(3), 331–341. https://doi.org/10.2190/ BHUH-420B-FE23-ALA0
Mayer, R. E. (2005). Principles for managing essential processing in multimedia learning: Segmenting, pretraining, and modality principles. In Mayer, R. E. (ed.), Cambridge handbook of multimedia learning (pp. 169-182). Cambridge University Press. https://doi.org/10.1017/CBO9780511816819.012
Mayer, R. E., Lee, H., & Peebles, A. (2014). Multimedia learning in a second language: A cognitive load perspective. Applied Cognitive Psychology, 28(5), 653–660. http://dx.doi.org/10.1002/acp.3050
Montero Perez, M., Noortgate, W. V. D. & Desmet, P. (2013) Captioned video for L2 listening and vocabulary learning: A meta-analysis. System, 41(3), 720–739. https://doi.org/10.1016/j.system.2013.07.013
Montero Perez, M., Peters, E., Clarebout, G., & Desmet, P. (2014a). Effects of captioning on video comprehension and incidental vocabulary. Language, Learning & Technology, 18(1), 118–141. https://doi.org/10.1080/09588221.2017.1375960
Montero Perez, M., Peters, E., & Desmet, P. (2014b). Is less more? Effectiveness and perceived usefulness of keyword and full captioned video for L2 listening comprehension. ReCALL, 26(1), 21–43. https://doi.org/10.1017/S0958344013000256
Nation, I. S. P., & Newton, J. (2009). Teaching ESL/EFL listening and speaking. Routledge.
Pujola, J.-T. (2002). CALLing for help: Researching language learning strategies using help facilities in a web-based multimedia program. ReCALL, 14(2), 235–262. https://doi.org/10.1017/S0958344002000423
Pujadas, G. & Munoz, C. (2019) Extensive viewing of captioned and subtitled TV series: A study of L2 vocabulary learning by ˜ adolescents. The Language Learning Journal, 47(4), 479–496. https://doi.org/10.1080/09571736.2019.1616806
Robin, R. (2007). Commentary: Learner-based listening and technological authenticity. Language Learning & Technology,1(11), 109–115. http://dx.doi.org/10125/44092
Paivio, A. (1986). Mental representation: A dual-coding approach. Oxford University Press.
Richards, J. (2005) Second thoughts on teaching listening. RELC Journal, 36(1), 85–92. https://doi.org/10.1177/0033688205053484
Richards, J. (2008). Teaching speaking and listening. Cambridge University Press.
Rodgers, M. R. H., & Webb, S. (2017). The effects of captions on EFL learners’ comprehension of English-language television programs. CALICO Journal, 34(1), 20–38. https://doi.org/10.1558/cj.29522
Rost, M. (2011). Teaching and researching listening (2nd ed.). Pearson Education Ltd.
Schmidt, R. (1990). The role of consciousness in second language learning. Applied Linguistics, 11(2), 129-158. https://doi.org/10.1093/applin/11.2.129
Seferoğlu, G. (2008). Using feature films in language classes. Educational Studies, 34(1), 1–9. https://doi.org/10.1080/03055690701785202
Staehr, L.S., (2009). Vocabulary knowledge and advanced listening comprehension in English as a foreign language. Studies in Second Language Acquisition 31(4), 577-607. https://doi.org/10.1017/S0272263109990039
Stewart, M. A., & Pertusa, I. (2004). Gains to language learners from viewing target language closed captioned films. Foreign Language Annals, 37(1), 438–447. https://doi.org/10.1111/j.1944-9720.2004.tb02701.x
Syodorenko, T. (2010). Modality of input and vocabulary acquisition. Language Learning & Technology, 2(14), 50–73. http://dx.doi.org/10125/44214
Taylor, G. (2005) Perceived processing strategies of students watching captioned video. Foreign Language Annals, 38(3), 422–427. https://doi.org/10.1111/j.1944-9720.2005.tb02228.x
Teng, F. (2017). Flipping the classroom and tertiary level EFL students’ academic performance and satisfaction. The Journal of Asia TEFL, 14(4), 605–620. http://dx.doi.org/10.18823/asiatefl.2017.14.4.2.605
Teng, F. (2019). Maximizing the potential of captions for primary school ESL students’ comprehension of English-language videos. Computer Assisted Language Learning, 32(7), 1–27. https://doi.org/10.1080/09588221.2018.1532912
Vandergrift, L. (2003). Orchestrating strategy use: Toward a model of the skilled second language listener. Language Learning, 53(3), 463–496. https://doi.org/10.1111/1467-9922.00232
Vandergrift, L. (2007) Recent developments in second and foreign language listening comprehension research. Language Teaching, 40(3), 191–210. https://doi.org/10.1017/S0261444807004338
Vanderplank, R. (1988). The value of teletext subtitles in language learning, ELT Journal 42(4), 272–281. https://doi.org/10.1093/elt/42.4.272
Vanderplank, R. (1990). Paying attention to the words: Practical and theoretical problems in watching television programmes with uni-lingual (CEEFAX) subtitles. System 18(2), 221–234. https://doi.org/10.1016/0346-251X(90)90056-B
Vanderplank, R. (2016). “Effects of” and “effects with” captions: How exactly does watching a TV programme with same-language subtitles make a difference to language learners? Language Teaching, 49(2), 235–250. https://doi.org/10.1017/S0261444813000207
Williams, H. & D. Thorne (2000). The value of teletext subtitling as a medium for language learning. System 28(2), 217–228. https://doi.org/10.1016/S0346-251X(00)00008-7
Winke, P., Gass, S., & Sydorenko, T. (2010). The effects of captioning videos used for foreign language listening activities. Language Learning & Technology, 14(1), 65–86. http://dx.doi.org/10125/44203
Winke, P., Gass, S., & Sydorenko, T. (2013). Factors influencing the use of captions by foreign language learners: An eye-tracking study. The Modern Language Journal, 97(1), 254–275. https://doi:10.1111/j.1540-4781.2013.01432.x
Wipf, J. (1984) Strategies for Teaching School Language Listening Comprehension. Foreign Language Annals, 17(4), 345–348. https://www.proquest.com/openview/a8137d6608a0f452daae72fd1a73afe2/1?cbl=1821600&pq-origsite=gscholar
Yang, J. C., & Chang, P. (2014). Captions and reduced forms instruction: The impact on EFL students’ listening comprehension. ReCALL, 26(1), 44–61. https://doi.org/10.1017/S0958344013000219
Zanon, N. T. (2006). Using subtitles to enhance foreign language learning. Porta Linguarum, 6, 41-52. https://www.researchgate.net/publication/28178514_Using_Subtitles_To_Enhance_Foreign_Language_Learning
DOI: https://doi.org/10.51383/ijonmes.2021.153
Refbacks
- There are currently no refbacks.
Copyright (c) 2021 International Journal of Modern Education Studies
This work is licensed under a Creative Commons Attribution 4.0 International License.