DOI : https://doi.org/10.18517/ijaseit.14.2.19473

Performance Analysis of Meta-UI on Membatik Mixed Reality Application Using Nielsen’s Heuristic Method

Hestiasari Rante (1), Kirana Hanifati (2), Oktafian Sultan Hakim (3), Achmad Torikul Huda (4), Agus Prayudi (5), M. Agus Zainuddin (6), Sritrusta Sukaridhoto (7), Felix Pasila (8), Doris Cáliz (9)
(1) Department of Informatics and Computer Engineering, Politeknik Elektronika Negeri Surabaya, Indonesia
(2) Department of Informatics and Computer Engineering, Politeknik Elektronika Negeri Surabaya, Indonesia
(3) Department of Informatics and Computer Engineering, Politeknik Elektronika Negeri Surabaya, Indonesia
(4) Department of Informatics and Computer Engineering, Politeknik Elektronika Negeri Surabaya, Indonesia
(5) Department of Electrical Engineering, Politeknik Elektronika Negeri Surabaya, Indonesia
(6) Department of Informatics and Computer Engineering, Politeknik Elektronika Negeri Surabaya, Indonesia
(7) Department of Informatics and Computer Engineering, Politeknik Elektronika Negeri Surabaya, Indonesia
(8) Department of Electrical Engineering, Petra Christian University, Indonesia
(9) TECO Department Pervasive Computing Systems, Karlsruhe Institute of Technology, Germany
Fulltext View | Download
How to cite (IJASEIT) :
Rante, Hestiasari, et al. “Performance Analysis of Meta-UI on Membatik Mixed Reality Application Using Nielsen’s Heuristic Method”. International Journal on Advanced Science, Engineering and Information Technology, vol. 14, no. 2, Apr. 2024, pp. 492-00, doi:10.18517/ijaseit.14.2.19473.
Citation Format :
Moving beyond immersive learning, the rapid advancement of Mixed Reality (MR) technology is diversifying its applications across various sectors, including education, healthcare, and corporate training. However, standalone MR devices pose challenges related to performance and visualization realism. In this study, we focused on enhancing immersive learning by optimizing the User Interface (UI) of an MR batik-making application using the Meta-UI principle. This research aimed to assess the impact of these UI approaches on user satisfaction, measured through Nielsen's usability methods. User feedback was collected and analyzed to refine the UI design. Nielsen's usability heuristics guided the evaluation of UI attributes such as clarity, efficiency, and user satisfaction. The utilization of Meta-UI demonstrated a notable increase in user satisfaction. Nielsen's usability guidelines indicated ratings ranging from 3.93 (good) to 4.30 (very good), signifying users' positive perceptions of learnability, efficiency, memorability, error handling, and overall satisfaction within the MR batik-making application. This research also addressed these issues by meticulously optimizing 3D assets within MR applications. The results indicated that the application's CPU utilization is around 22%, attributed to its startup processes, resource allocation, and any initial computations it performed. However, the application continued to run within 4 GB of installed memory with the network bandwidth usage at 0.27 Mbps. User comfortability was enhanced, which is evident in improved ratings for importance and satisfaction levels (4.26 and 4.16, respectively) in the MR application.

J. T. Verhey, J. M. Haglin, E. M. Verhey, and D. E. Hartigan, “Virtual, augmented, and mixed reality applications in orthopedic surgery,” The International Journal of Medical Robotics and Computer Assisted Surgery, vol. 16, no. 2, Apr. 2020, doi: 10.1002/rcs.2067.

S. Chabot, J. Drozdal, M. Peveler, Y. Zhou, H. Su, and J. Braasch, “A Collaborative, Immersive Language Learning Environment Using Augmented Panoramic Imagery,” in 2020 6th International Conference of the Immersive Learning Research Network (iLRN), IEEE, Jun. 2020, pp. 225–229. doi: 10.23919/iLRN47897.2020.9155140.

J. Gerup, C. B. Soerensen, and P. Dieckmann, “Augmented reality and mixed reality for healthcare education beyond surgery: an integrative review,” Int J Med Educ, vol. 11, pp. 1–18, Jan. 2020, doi: 10.5116/ijme.5e01.eb1a.

M. F. Syahputra, R. Zanury, U. Andayani, and S. M. Hardi, “Heart Disease Simulation with Mixed Reality Technology,” J Phys Conf Ser, vol. 1898, no. 1, p. 012025, Jun. 2021, doi: 10.1088/1742-6596/1898/1/012025.

R. Anthony, J. De Belen, and T. Bednarz, “Mixed Reality and Internet of Things (MRIoT) Interface Design Guidelines for Elderly People.”

G. Martin et al., “Use of the HoloLens2 Mixed Reality Headset for Protecting Health Care Workers During the COVID-19 Pandemic: Prospective, Observational Evaluation,” J Med Internet Res, vol. 22, no. 8, p. e21486, Aug. 2020, doi: 10.2196/21486.

A. Syahry, D. Kurnia Basuki, S. Sukaridhoto, R. Putri Nourma Budiarti, K. Hanifati, and I. Muntahir, “Implementation of Augmented Reality in Medical Education,” in 2022 International Electronics Symposium (IES), IEEE, Aug. 2022, pp. 684–690. doi: 10.1109/IES55876.2022.9888706.

M. I. Muntahir et al., “Implementation of Immersive Technology on Medical Education,” in 2022 International Electronics Symposium (IES), IEEE, Aug. 2022, pp. 651–657. doi: 10.1109/IES55876.2022.9888379.

M. A. M. AlGerafi, Y. Zhou, M. Oubibi, and T. T. Wijaya, “Unlocking the Potential: A Comprehensive Evaluation of Augmented Reality and Virtual Reality in Education,” Electronics (Basel), vol. 12, no. 18, p. 3953, Sep. 2023, doi: 10.3390/electronics12183953.

S. Talwar, P. Kaur, R. Nunkoo, and A. Dhir, “Digitalization and sustainability: virtual reality tourism in a post pandemic world,” Journal of Sustainable Tourism, vol. 31, no. 11, pp. 2564–2591, Nov. 2023, doi: 10.1080/09669582.2022.2029870.

H. Matovu et al., “Immersive virtual reality for science learning: Design, implementation, and evaluation,” Stud Sci Educ, vol. 59, no. 2, pp. 205–244, Jul. 2023, doi: 10.1080/03057267.2022.2082680.

S. Rokooei, A. Shojaei, A. Alvanchi, R. Azad, and N. Didehvar, “Virtual reality application for construction safety training,” Saf Sci, vol. 157, p. 105925, Jan. 2023, doi: 10.1016/j.ssci.2022.105925.

R. Rasim, Y. Rosmansyah, A. Z. R. Langi, and M. Munir, “Immersive Intelligent Tutoring System for Remedial Learning Using Virtual Learning Environment,” Indonesian Journal of Science and Technology, vol. 6, no. 3, pp. 507–522, Aug. 2021, doi: 10.17509/ijost.v6i3.38954.

S. Mystakidis and V. Lympouridis, “Immersive Learning,” Encyclopedia, vol. 3, no. 2, pp. 396–405, Mar. 2023, doi: 10.3390/encyclopedia3020026.

M. A. Kuhail, A. ElSayary, S. Farooq, and A. Alghamdi, “Exploring Immersive Learning Experiences: A Survey,” Informatics, vol. 9, no. 4, p. 75, Sep. 2022, doi: 10.3390/informatics9040075.

D. Hamilton, J. McKechnie, E. Edgerton, and C. Wilson, “Immersive virtual reality as a pedagogical tool in education: a systematic literature review of quantitative learning outcomes and experimental design,” Journal of Computers in Education, vol. 8, no. 1, pp. 1–32, Mar. 2021, doi: 10.1007/s40692-020-00169-2.

A. Dengel, “What Is Immersive Learning?,” in 2022 8th International Conference of the Immersive Learning Research Network (iLRN), IEEE, May 2022, pp. 1–5. doi: 10.23919/iLRN55037.2022.9815941.

D. Economou, Immersive Learning Research Network, IEEE Education Society, and Institute of Electrical and Electronics Engineers., Proceedings of 6th International Conference of the Immersive Learning Research Network (iLRN 2020) : date and venue, June 21 -25, 2020, Online.

D. Beck, L. Morgado, and P. O’Shea, “Educational Practices and Strategies With Immersive Learning Environments: Mapping of Reviews for Using the Metaverse,” IEEE Transactions on Learning Technologies, vol. 17, pp. 319–341, 2024, doi: 10.1109/TLT.2023.3243946.

C. Aguayo and C. Eames, “Using mixed reality (XR) immersive learning to enhance environmental education,” J Environ Educ, vol. 54, no. 1, pp. 58–71, Jan. 2023, doi: 10.1080/00958964.2022.2152410.

S. Mariam, K. F. Khawaja, M. N. Qaisar, and F. Ahmad, “Blended learning sustainability in business schools: Role of quality of online teaching and immersive learning experience,” The International Journal of Management Education, vol. 21, no. 2, p. 100776, Jul. 2023, doi: 10.1016/j.ijme.2023.100776.

C. Lion-Bailey, J. Lubinsky, and M. Shippee, “The XR ABC Framework: Fostering Immersive Learning Through Augmensyahryed and Virtual Realities,” in Immersive Education, Cham: Springer International Publishing, 2022, pp. 123–134. doi: 10.1007/978-3-031-18138-2_8.

D. Allcoat, T. Hatchard, F. Azmat, K. Stansfield, D. Watson, and A. von Mühlenen, “Education in the Digital Age: Learning Experience in Virtual and Mixed Realities,” Journal of Educational Computing Research, vol. 59, no. 5, 2021, doi: 10.1177/0735633120985120.

T.-W. Hsu et al., “Design and Initial Evaluation of a VR based Immersive and Interactive Architectural Design Discussion System,” in 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), IEEE, Mar. 2020, pp. 363–371. doi: 10.1109/VR46266.2020.00056.

L. Zhang, W. He, H. Bai, Q. Zou, S. Wang, and M. Billinghurst, “A hybrid 2D–3D tangible interface combining a smartphone and controller for virtual reality,” Virtual Real, vol. 27, no. 2, pp. 1273–1291, Jun. 2023, doi: 10.1007/s10055-022-00735-2.

A. Vermast and W. Hürst, “Introducing 3D Thumbnails to Access 360-Degree Videos in Virtual Reality,” IEEE Trans Vis Comput Graph, vol. 29, no. 5, pp. 2547–2556, May 2023, doi: 10.1109/TVCG.2023.3247462.

E. J. Pretty, H. M. Fayek, and F. Zambetta, “A Case for Personalized Non-Player Character Companion Design,” Int J Hum Comput Interact, pp. 1–20, Mar. 2023, doi: 10.1080/10447318.2023.2181125.

S. Guertin-Lahoud, C. K. Coursaris, S. Sénécal, and P.-M. Léger, “User Experience Evaluation in Shared Interactive Virtual Reality,” Cyberpsychol Behav Soc Netw, vol. 26, no. 4, pp. 263–272, Apr. 2023, doi: 10.1089/cyber.2022.0261.

A. Firmanda, S. Sukaridhoto, H. Rante, C. Miranto, Evianita Dewi Fajrianti, and S. Prasetyaningsih, “Meta-Interface Analysis for Interaction in Mobile Augmented Reality,” Indonesian Journal of Computer Science, vol. 11, no. 2, Aug. 2022, doi: 10.33022/ijcs.v11i2.3058.

C. Miranto, H. Rante, and S. Sukaridhoto, “Exploring Concept Design of User Experience with Diegetic Approach for Cultural Heritage Virtual Realtity Exhibition,” in Proceedings of the 4th International Conference on Applied Science and Technology on Engineering Science, SCITEPRESS - Science and Technology Publications, 2021, pp. 272–277. doi: 10.5220/0010943900003260.

E. D. Fajrianti et al., “Evaluation of Meta-UI in AR and VR Application for Medical Education,” International Journal of Information and Education Technology, vol. 13, no. 2, pp. 203–210, 2023, doi: 10.18178/ijiet.2023.13.2.1797.

P. Jansen, J. Britten, A. Häusele, T. Segschneider, M. Colley, and E. Rukzio, “AutoVis: Enabling Mixed-Immersive Analysis of Automotive User Interface Interaction Studies,” in Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, New York, NY, USA: ACM, Apr. 2023, pp. 1–23. doi: 10.1145/3544548.3580760.

Z. Wang et al., “User-centric immersive virtual reality development framework for data visualization and decision-making in infrastructure remote inspections,” Advanced Engineering Informatics, vol. 57, p. 102078, Aug. 2023, doi: 10.1016/j.aei.2023.102078.

X.-Z. Li and X. Kang, “Intangible Cultural Heritage Based Augmented Reality Mobile Learning: Application Development and Heuristics Evaluation,” in 2023 Joint International Conference on Digital Arts, Media and Technology with ECTI Northern Section Conference on Electrical, Electronics, Computer and Telecommunications Engineering (ECTI DAMT & NCON), IEEE, Mar. 2023, pp. 26–30. doi: 10.1109/ectidamtncon57770.2023.10139422.

K. Hanifati, H. Rante, and S. Sukaridhoto, “Gamification Interaction Design for Membatik Application in Mixed Reality,” in 2023 International Electronics Symposium (IES), IEEE, Aug. 2023, pp. 631–636. doi: 10.1109/IES59143.2023.10242568.

H. Rante, M. A. Zainuddin, C. Miranto, F. Pasila, W. Irawan, and E. D. Fajrianti, “Development of Social Virtual Reality (SVR) as Collaborative Learning Media to Support Merdeka Belajar,” International Journal of Information and Education Technology, vol. 13, no. 7, pp. 1014–1020, 2023, doi: 10.18178/ijiet.2023.13.7.1900.

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with this journal agree to the following terms:

    1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
    2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
    3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).