DOI : https://doi.org/10.18517/ijaseit.9.6.6833

Implementing Augmented Reality (AR) on Phonics-based Literacy among Children with Autism

Zainal Rasyid Mahayuddin (1), Najmiah Mamat (2)
(1) Center for Artificial Intelligence Technology (CAIT), Faculty of Information Science and Technology Universiti Kebangsaan Malaysia (UKM), 43600 Bangi, Malaysia
(2) Faculty of Information Science and Technology Universiti Kebangsaan Malaysia (UKM), 43600 Bangi, Malaysia
Fulltext View | Download
How to cite (IJASEIT) :
Mahayuddin, Zainal Rasyid, and Najmiah Mamat. “Implementing Augmented Reality (AR) on Phonics-Based Literacy Among Children With Autism”. International Journal on Advanced Science, Engineering and Information Technology, vol. 9, no. 6, Dec. 2019, pp. 2176-81, doi:10.18517/ijaseit.9.6.6833.
Citation Format :
The implementation of Augmented Reality (AR) technology in education has created an interesting approach to enhance the effectiveness and attractiveness of teaching and learning for students in real-life scenarios. This medium offers unique affordances, combining physical and virtual worlds, with continuous and implicit user control of the point of view and interactivity. This paper introduces the technology of augmented reality and its capabilities in facilitating children with autism. AR is a technology that overlays digital information on a live view of the physical world to create a blended experience. AR provides unique experiences and opportunities to learn and interact with information in the physical world. Hence, AR can be one of the effective technologies available in developing tools for teaching and learning with the combination of the virtual world and real objects such as transportation, fruits, numbers, and alphabets. This will facilitate the autistic child to recognize the abstract concepts of the real objects and their descriptions. The purpose of this paper was to investigate the use of AR on mobile devices in fostering literacy in academic and learning skills for children with autism using the phonics learning method. This prototype helps the autistic child to capture and associate the graphics or pictures of the surrounding objects so as improving the literacy and learning skills of the children. The results show that the children can pronounce and to distinguish between vowels “a”, “i” and “u”. The children are also able to answer most of the questions in the exercises provided. The interactivity between the children and the application raises their attention and focus mainly in literacy and learning skills.

Kirner, C. & Zorzal, E.R. (2005). XVI Simpósio Brasileiro de Informí¡tica na Educaí§í£o - SBIE - UFJF (2005). Educational Applications in Collaborative Environments with Augmented Reality. 114-124.

N. H. Anas, Z. R. Mahayuddin: Aiding Autistic Children Learn Arabic Through Developing an Engaging User-Friendly Android App. IIOABJ. 2017. Vol.8 (Suppl 3): 87-90.

N. H. Anas, Z. R. Mahayuddin: A Review On Android Applications For Arabic Language Learning. IIOABJ. 2017. Vol.8 (Suppl 3): 102-105.

Zainal Rasyid Mahayuddin, Nur Afyfah Suwadi, Ruzzakiah Jenal, Haslina Arshad, Trio Adiono. Implementing Smart Mobile Application to Achieve a Sustainable Campus. International Journal of Supply Chain Management (IJSCM). 2018. Vol. 7 No. 3: 154-159.

Bai, Z., Blackwell, A. F., and Coulouris, G. Using Augmented Reality to Elicit Pretend Play for Children with Autism. IEEE Transactions on Visualization and Computer Graphics. 2015. Vol. 21 No. 5: 598 - 610.

Aliee, Z. S., Jomhari, N., Rezaei, R., Alias, N. The Effectiveness of Managing Split Attention among Autistic Children Using Computer-Based Intervention. The Turkish Online Journal of Educational Technology. 2013. Vol 12 No. 2: 281 - 302.

Fossett. B. 2004. Visual Support Strategies for Literacy Development. SEA Crosscurrents Magazine.

C. M. Juan, E. Llop, F. Abad and J. Lluch. 2010. 10th IEEE International Conference on Advanced Learning Technologies, Sousse. Learning Words Using Augmented Reality. 422-426.

Rao, S., & Gagie, B. 2006. Learning Through Seeing and Doing Visual Support for Children with Autism. Teaching Exceptional Children. Vol. 38. No. 6: 26-33.

Zhou, F., Duh, H. B. L., Billinghurst, M. 2008. Proceedings of the 7th IEEE / ACM International Symposium on Mixed and Augmented Reality. Trends in Augmented Reality Tracking, Interaction and Display: A Review Of Ten Years In ISMAR. 193-202.

Hameedur Rahman, Haslina Arshad, Rozi Mahmud, Zainal Rasyid Mahayuddin, Waqas Khalid Obeidy. A Framework to Visualize 3D Breast Tumor Using X-Ray Vision Technique in Mobile Augmented Reality. Journal of Telecommunication, Electronic and Computer Engineering. 2017. Vol. 9 No. 2-11: 145-149.

Dillenbourg, P., Jí¤rvelí¤, S., Fischer, F. The Evolution of Research on Computer-Supported Collaborative Learning. Technology-Enhanced Learning. 2009. 3-19.

Tentori, M., Hayes, G. R. 2010. UbiComp '10 Proceedings of the 12th ACM International Conference on Ubiquitous Computing Designing for Interaction Immediacy to Enhance Social Skills of Children with Autism. 51-60.

Craig, A. & McGrath, R. 2007. Augmenting Science Texts with Inexpensive Interactive 3D Illustrations.

Dror, I. E. Technology Enhanced Learning: The Good, The Bad, and The Ugly. Pragmatics Cognition. 2008. Vol 16. No. 2: 215 - 223. John Benjamins Publishing Company.

Martin, S., Diaz, G., Sancristobal, E., Gil, R., Castro, M., Peire, J. New Technology Trends in Education: Seven Years of Forecasts and Convergence. Computers & Education. 2011. Vol. 57. No.3. 1893 - 1906.

Chen, C. H., Lee, I. J., Lin, L. Y. Augmented reality-based self-facial modeling to promote the emotional expression and social skills of adolescents with autism spectrum disorders. Research in Development Disabilities. 2015. Vol. 36: 396-403.

Bruno Malta de La Plata. 2013. 3D Modeling Optimization for Multimedia Production. Thesis Helsinki Metropolia University of Applied Sciences. 30th April 2013.

Juan, C. M., Llop, E., Abad, F., Lluch, J. 2010. 10th IEEE International Conference on Advanced Learning Technologies. Learning Words using Augmented Reality. 422-426.

Delzell, L. A., Browder, D., Wood, L. Effects of Systematic Instruction and an Augmentative Communication Device on Phonic Skills Acquisition for Students with Moderate Intellectual Disability Who are Nonverbal. Education and Training in Autism and Developmental Disabilities. 2014. Vol. 49. No. 4: 517-532.

Rao, S. M., Gagie, B. Learning Through Seeing and Doing Visual Supports for Children with Autism. Teaching Exceptional Children. 2006. Vol. 38. No. 6: 26-33.

Kesim, M. & Ozarslan, Y. Augmented Reality in Education: Current Technologies and the Potential for Education. Procedia - Social and Behavioral Sciences. 2012. Vol. 47: 297 - 302.

Vacca, J. S. Autistic Children Can Be Taught To Read. International Journal of Special Education. 2007. Vol 22. No.3: 54-61.

Khan, M. & Bayoumi, S. 2015. International Conference on Cloud Computing (ICCC). Multimedia as a Help for Children with Special Learning Needs.

Travers, J. C. 2010. Emergent Literacy Skills of Young Children with Autism: A Comparison of Teacher-led and Computer-Assisted Instruction. University of Nevada Las Vegas Theses.

Yahya Othman, Aisah Md. Daud, Azmey Othman, DK. Siti Ardiah Pg. Mohiddin, Maszuraimah Muizz Sulaiman. (2012). Pelaksanaan Pengajaran Membaca Menggunakan Kaedah Fonik Peringkat Prasekolah di Brunei Darussalam. Jurnal Pendidikan Bahasa Melayu. Vol.2. No. 1: 93-109.

Menon, N. 2000. Keberkesanan Kaedah Gabungan Bunyikata dalam Kebolehan Awal Bacaan Dikalangan Kanak-Kanak PraSekolah. Tesis Universiti Putra Malaysia.

Bowman, D., Kruijff, E., LaViola, J. J., Poupyrev, I. P. 2004. 3D User Interfaces: Theory and Practice. Addison Wesley Longman Publishing.

Authors who publish with this journal agree to the following terms:

    1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
    2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
    3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).