Improvement of the Usability of Online Mentoring Website

Daeseop Kim (1), Jae-Kyeong Lee (2), Dong-Gu Shin (3), Mi-Hwan Hyun (4)
(1) Korea Institute of Science and Technology Information
(2) Idea Commercialization Center, Korea Institute of Science and Technology Information, 02456, Republic of Korea.
(3) Convergence Service Center, Korea Institute of Science and Technology Information, 02456, Republic of Korea.
(4) Open Access Center, Korea Institute of Science and Technology Information, 02456, Republic of Korea.
Fulltext View | Download
How to cite (IJASEIT) :
Kim, Daeseop, et al. “Improvement of the Usability of Online Mentoring Website”. International Journal on Advanced Science, Engineering and Information Technology, vol. 8, no. 4-2, Sept. 2018, pp. 1540-5, doi:10.18517/ijaseit.8.4-2.5741.
The purpose of this study is to improve the usability of the current online mentoring website by deriving what should be improved through assessment and reflecting it to system improvement. The related data such as search log and Think Aloud were collected from user groups (9 users in total), and usability was tested according to the predefined test procedures. The collected data were analyzed, using quantitative methods. In terms of search log, the related items including effectiveness, efficiency, satisfaction and error were quantified according to usability testing standards. Then, descriptive statistics was performed. According to usability comparison before and after system improvement, it has mostly improved such as improved effectiveness (increase by 15 points), better efficiency (reduction by 41 seconds), increase in satisfaction (by 8 points) and decrease in error frequency (decrease by 1.2 times). Usability testing should be viewed as a process, not outcome itself. Therefore, it could be used during system prototype in addition to the current system and useful in system improvement.

ISO, IOFS, "ISO 9241-11: 1998: Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs)-Part 11: Guidance on Usability", International Organization for Standardization, 1998.

Nielsen, Jakob, Designing web usability: The practice of simplicity. New Riders Publishing, 1999.

Shneiderman, Ben, et al, “Designing the user interface: strategies for effective human-computer interaction”, 2016.

Hooshyar, Danial, Moslem Yousefi, and Heuiseok Lim, "Data-Driven Approaches to Game Player Modeling: A Systematic Literature Review", ACM Computing Surveys, 50.6, 2018.

Hooshyar, Danial, Moslem Yousefi, and Heuiseok Lim, "A systematic review of data-driven approaches in player modeling of educational games", Artificial Intelligence Review, 1-21, 2017

Nielsen, J., Usability Engineering, Academic Press, Boston, MA., 1993

Lund, Arnold M, “Expert ratings of usability maxims”, Ergonomics in Design, 5.3: 15-20, 1997

JI, Hyesung, et al, “An adaptable UI/UX considering user’s cognitive and behavior information in distributed environment”. Cluster Computing, 1-14, 2017.

PREECE, Jenny, et al, Interface Metaphors and Conceptual Models. Human-Computer Interation, 1994.

í…gerfalk, Pí¤r J., et al. “Setting the scene for actability evaluation: understanding information systems in context”. In: Proceedings of the 9th European Conference on IT Evaluation, p. 15-16, 2002.

Standard, I, “Ergonomics of human-system interaction-usability methods supporting human-centred design. ISO Standard TR 16982: 2002”, International Organization for Standardization, 2002.

Kaur, Kawaljit; Singh, Hardeep. “Analysis of Website using Click Analytics. International Journal of Science”, Engineering and Computer Technology, 5.6: 185, 2015

Ericsson, Karl Anders; Simon, Herbert Alexander. “Protocol analysis: Verbal reports as data”, Rev. the MIT Press, 1993.

Wang, Peiling; Hawk, William B.; Tenopir, Carol. “Users’ interaction with World Wide Web resources: An exploratory study using a holistic approach”, Information processing & management, 36.2: 229-251, 2000.

Nielsen, Jakob. “Why you only need to test with 5 users”, 2000.

Authors who publish with this journal agree to the following terms:

    1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
    2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
    3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).