Iconicity in VR: Experiences of Language Learning with Commercial VR Apps
Keywords:
Virtual Reality (VR), Iconicity, Immersion, Language Learning, Second Language Acquisition (SLA)
Abstract
Abstract: Iconicity, the perceived relationship between form and meaning, is essential for language learning but remains underexplored in VR. While accurate form representation in VR apps is common in scale-specific fields like telemedicine, it is less prevalent in apps designed for language learning, leading to various graphical representations. This study employs iconicity as an analytical framework to examine how representations influence immersion and learning approaches. This mixed-method study integrates quantitative data from 61 online survey responses with qualitative data from nine semi-structured interviews to investigate the role of iconicity in VR language learning. The survey and interview questions were based on a novel assessment tool for measuring iconicity in dynamic virtual environments. Additional sections on immersion and language learning approaches were also included. Participant iconicity ratings of both language-learning-specific and non-specific apps show that varying degrees of iconicity, based on design, amplify or attenuate immersion and learning. The findings extend previous research on the importance of iconicity in VR and show the potential for enhancing immersive language learning experiences. The work serves as a foundation for future investigations into the role of iconicity and its impact across different apps and platforms.
Received Date: September 26, 2024
Revised Date: November 2, 2024
Accepted Date: December 10, 2024
References
- Adams, P. C. (2014). Communication in virtual worlds. Oxford University Press. doi:10.1093/oxfordhb/9780199826162.013.003
- An, Y., & Kaplan-Rakowski, R. (2024). Examining adults’ enjoyment, challenges, and cognitive load in informal learning with high-immersion virtual reality. TechTrends. doi:10.1007/s11528-024-00999-2
- Barricelli, B. R., Gadia, D., Rizzi, A., & Marini, D. L. R. (2016). Semiotics of virtual reality as a communication process. Behaviour and Information Technology, 35(11), 879–896. doi:10.1080/0144929X.2016.1212092
- Blasi, D. E., Wichmann, S., Hammarström, H., Stadler, P. F., & Christiansen, M. H. (2016). Sound–meaning association biases evidenced across thousands of languages. Proceedings of the National Academy of Sciences of the United States of America, 113(39), 10818–10823. doi:10.1073/pnas.1605782113
- Chen, C., Hu, X., & Fisher, J. (2024). What is “being there”? An ontology of the immersive experience. Annals of the International Communication Association, 1–24. doi:10.1080/23808985.2024.2382752
- Chobphon, P. (2022). Individual and social factors influencing sports science internship students’ practice-based learning: A phenomenological study. The Qualitative Report. doi:10.46743/2160-3715/2022.5253
- Creswell, J. W., Hanson, W. E., Clark Plano, V. L., & Morales, A. (2007). Qualitative research designs. The Counseling Psychologist, 35(2), 236–264. doi:10.1177/0011000006287390
- Ding, M. (2024). The impact of high-immersion virtual reality on EFL learners’ foreign language speaking anxiety: A mixed-method approach. ReCALL, 1–19. doi:10.1017/S0958344024000156
- Dörnyei, Z., & Dewaele, J.-M. (2022). Questionnaires in second language research: Construction, administration, and processing. Routledge. doi:10.4324/9781003331926
- Ellis, R. (2008). The study of second language acquisition (2nd ed.). Oxford University Press.
- EN-JP language exchange—Launch instance—VRChat. (n.d.). https://vrchat.com/home/launch?worldId=wrld_153be667-a86e-4aaf-9eed-921bd568ee9b
- Fort, M., & Schwartz, J.-L. (2022). Resolving the bouba-kiki effect enigma by rooting iconic sound symbolism in physical properties of round and spiky objects. Scientific Reports, 12(1), 19172. https://doi.org/10.1038/s41598-022-23623-w
- Goodwin, C. (2013). The co-operative, transformative organization of human action and knowledge. Journal of Pragmatics, 46(1), 8–23. https://doi.org/10.1016/J.PRAGMA.2012.09.003
- Helping Hands—YouTube. (n.d.). https://www.youtube.com/@helpinghands3286
- Hua, C., & Wang, J. (2023). Virtual reality-assisted language learning: A follow-up review (2018–2022). Frontiers in Psychology, 14, 1153642. https://doi.org/10.3389/fpsyg.2023.1153642
- Hunter, J. D. (2007). Matplotlib: A 2D graphics environment. Computing in Science and Engineering, 9(3), 90–95. https://doi.org/10.1109/MCSE.2007.55
- IBM Corp. (2021). IBM SPSS Statistics for windows (version 27.0) [Computer software]. IBM Corp. https://www.ibm.com/products/spss-statistics
- Kaplan-Rakowski, R., & Gruber, A. (2019). Low-immersion versus high-immersion virtual reality: Definitions, classification, and examples with a foreign language focus. Proceedings of the Innovation in Language Learning International Conference, Pixel (pp. 552–555). https://conference.pixel-online.net/files/ict4ll/ed0012/FP/6143-SLA4232-FP-ICT4LL12.pdf
- Jiang, Y., Yu, C., Xie, T., Li, X., Feng, Y., Wang, H., Li, M., Zhang, J., & Jiang, C. (2024, July). VR-GS: A physical dynamics-aware interactive Gaussian splatting system in virtual reality. ACM SIGGRAPH 2024 Conference Papers (pp. 1-1). https://doi.org/10.1145/3641519.3657448
- Lin, T. J., & Lan, Y. J. (2015). Language learning in virtual reality environments: Past, present, and future. Journal of Educational Technology and Society, 18(4), 486–497. https://www.jstor.org/stable/jeductechsoci.18.4.486
- Lyster, R. (1987). Speaking immersion. The Canadian Modern Language Review , 43 (4), 697–713. doi:10.3138/cmlr.43.4.697
- Mondly, V. R. (n.d.). Language learning immersion.https://www.mondly.com/vr
- Motamedi, Y., Little, H., Nielsen, A., & Sulik, J. (2019). The iconicity toolbox: Empirical approaches to measuring iconicity. Language and Cognition , 11 (2), 188–207. doi:10.1017/LANGCOG.2019.14
- Murgiano, M., Motamedi, Y., & Vigliocco, G. (2021). Situating language in the real world: The role of multimodal iconicity and indexicality. Journal of Cognition , 4 (1), 38. doi:10.5334/JOC.113
- Nicolaidou, I., Pissas, P., & Boglou, D. (2023). Comparing immersive Virtual Reality to mobile applications in foreign language learning in higher education: A quasi-experiment. Interactive Learning Environments , 31 (4), 2001–2015. doi:10.1080/10494820.2020.1870504
- Nielsen, A., & Rendall, D. (2011). The sound of round: Evaluating the sound-symbolic role of consonants in the classic takete-maluma phenomenon. Canadian Journal of Experimental Psychology , 65 (2), 115–124. doi:10.1037/A0022268
- Nielsen, A. K., & Dingemanse, M. (2021). Iconicity in word learning and beyond: A critical review. Language and Speech , 64 (1), 52–72. doi:10.1177/0023830920914339:1177
- Nölle, J., & Peeters, D. (2023). Virtual Reality: A tool to study language evolution . doi:10.31234/OSF.IO/B8F6H
- Parmaxi, A. (2023). Virtual reality in language learning: A systematic review and implications for research and practice. Interactive Learning Environments , 31 (1), 172–184. doi:10.1080/10494820.2020.1765392
- Pawluczuk, M. (2024). What does Gorilla Tag’s one-million mark say about VR engagement? – AR insider. https://arinsider.co/2024/07/11/what-does-gorilla-tags-milestone-mean-for-vr-retention/
- Peixoto, B., Pinto, R., Melo, M., Cabral, L., & Bessa, M. (2021). Immersive virtual reality for foreign language education: A PRISMA systematic review. IEEE Access, 9, 48952–48962. doi:10.1109/ACCESS.2021.3068858
- Python Software Foundation. (2023). Python (version 3.10) [Programming language]. https://www.python.org/
- Richards, J. C., & Rodgers, T. S. (2014). Approaches and methods in language teaching. Cambridge University Press. doi:10.1017/9781009024532
- Roberts, G., Lewandowski, J., & Galantucci, B. (2015). How communication changes when we cannot mime the world: Experimental evidence for the effect of iconicity on combinatoriality. Cognition, 141, 52–66. doi:10.1016/J.COGNITION.2015.04.001
- Sinclair, S., & Rockwell, G. (2021). Voyant tools [Computer software]. Voyant tools. https://voyant-tools.org/
- Thrasher, T. (2022). The impact of virtual reality on L2 French learners’ language anxiety and oral comprehensibility: An exploratory study. CALICO Journal, 39(2), 219–238. doi:10.1558/cj.42198
- Thrasher, T. K., Kaplan-Rakowski, R., Chun, D., & Sadler, R. (2023). Virtual reality: “Awesome,” “OK,” or “Not so good” for language learning? Proceedings of the 2023 EUROCALL Conference. Editorial Universitat Politècnica de València. doi:10.4995/EuroCALL2023.2023.16948
- VERBI software. (2021). MAXQDA 2022 [Computer software]. VERBI Software. https://www.maxqda.com/
Published
2024-12-15
Section
Articles
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
