Cite Article

A Review of Multimodal Interaction Technique in Augmented Reality Environment

Choose citation format

BibTeX

@article{IJASEIT6824,
   author = {Siti Soleha Muhammad Nizam and Rimaniza Zainal Abidin and Nurhazarifah Che Hashim and Meng Chun Lam and Haslina Arshad and Nazatul Aini Abd Majid},
   title = {A Review of Multimodal Interaction Technique in Augmented Reality Environment},
   journal = {International Journal on Advanced Science, Engineering and Information Technology},
   volume = {8},
   number = {4-2},
   year = {2018},
   pages = {1460--1469},
   keywords = {review; multimodal interaction technique; augmented reality},
   abstract = {

Augmented Reality (AR) has proposed several types of interaction techniques such as 3D interactions, natural interactions, tangible interactions, spatial awareness interactions and multimodal interactions. Usually, interaction technique in AR involve unimodal interaction technique that only allows user to interact with AR content by using one modality such as gesture, speech, click, etc. Meanwhile, the combination of more than one modality is called multimodal. Multimodal can contribute to human and computer interaction more efficient and will enhance better user experience. This is because, there are a lot of issues have been found when user use unimodal interaction technique in AR environment such as fat fingers. Recent research has shown that multimodal interface (MMI) has been explored in AR environment and has been applied in various domain. This paper presents an empirical study of some of the key aspects and issues in multimodal interaction augmented reality, touching on the interaction technique and system framework. We reviewed the question of what are the interaction techniques that have been used to perform a multimodal interaction in AR environment and what are the integrated components applied in multimodal interaction AR frameworks. These two questions were used to be analysed in order to find the trends in multimodal field as a main contribution of this paper. We found that gesture, speech and touch are frequently used to manipulate virtual object. Most of the integrated component in MMI AR framework discussed only on the concept of the framework components or the information centred design between the components. Finally, we conclude this paper by providing ideas for future work involving this field.

},    issn = {2088-5334},    publisher = {INSIGHT - Indonesian Society for Knowledge and Human Development},    url = {http://ijaseit.insightsociety.org/index.php?option=com_content&view=article&id=9&Itemid=1&article_id=6824},    doi = {10.18517/ijaseit.8.4-2.6824} }

EndNote

%A Muhammad Nizam, Siti Soleha
%A Zainal Abidin, Rimaniza
%A Che Hashim, Nurhazarifah
%A Lam, Meng Chun
%A Arshad, Haslina
%A Abd Majid, Nazatul Aini
%D 2018
%T A Review of Multimodal Interaction Technique in Augmented Reality Environment
%B 2018
%9 review; multimodal interaction technique; augmented reality
%! A Review of Multimodal Interaction Technique in Augmented Reality Environment
%K review; multimodal interaction technique; augmented reality
%X 

Augmented Reality (AR) has proposed several types of interaction techniques such as 3D interactions, natural interactions, tangible interactions, spatial awareness interactions and multimodal interactions. Usually, interaction technique in AR involve unimodal interaction technique that only allows user to interact with AR content by using one modality such as gesture, speech, click, etc. Meanwhile, the combination of more than one modality is called multimodal. Multimodal can contribute to human and computer interaction more efficient and will enhance better user experience. This is because, there are a lot of issues have been found when user use unimodal interaction technique in AR environment such as fat fingers. Recent research has shown that multimodal interface (MMI) has been explored in AR environment and has been applied in various domain. This paper presents an empirical study of some of the key aspects and issues in multimodal interaction augmented reality, touching on the interaction technique and system framework. We reviewed the question of what are the interaction techniques that have been used to perform a multimodal interaction in AR environment and what are the integrated components applied in multimodal interaction AR frameworks. These two questions were used to be analysed in order to find the trends in multimodal field as a main contribution of this paper. We found that gesture, speech and touch are frequently used to manipulate virtual object. Most of the integrated component in MMI AR framework discussed only on the concept of the framework components or the information centred design between the components. Finally, we conclude this paper by providing ideas for future work involving this field.

%U http://ijaseit.insightsociety.org/index.php?option=com_content&view=article&id=9&Itemid=1&article_id=6824 %R doi:10.18517/ijaseit.8.4-2.6824 %J International Journal on Advanced Science, Engineering and Information Technology %V 8 %N 4-2 %@ 2088-5334

IEEE

Siti Soleha Muhammad Nizam,Rimaniza Zainal Abidin,Nurhazarifah Che Hashim,Meng Chun Lam,Haslina Arshad and Nazatul Aini Abd Majid,"A Review of Multimodal Interaction Technique in Augmented Reality Environment," International Journal on Advanced Science, Engineering and Information Technology, vol. 8, no. 4-2, pp. 1460-1469, 2018. [Online]. Available: http://dx.doi.org/10.18517/ijaseit.8.4-2.6824.

RefMan/ProCite (RIS)

TY  - JOUR
AU  - Muhammad Nizam, Siti Soleha
AU  - Zainal Abidin, Rimaniza
AU  - Che Hashim, Nurhazarifah
AU  - Lam, Meng Chun
AU  - Arshad, Haslina
AU  - Abd Majid, Nazatul Aini
PY  - 2018
TI  - A Review of Multimodal Interaction Technique in Augmented Reality Environment
JF  - International Journal on Advanced Science, Engineering and Information Technology; Vol. 8 (2018) No. 4-2
Y2  - 2018
SP  - 1460
EP  - 1469
SN  - 2088-5334
PB  - INSIGHT - Indonesian Society for Knowledge and Human Development
KW  - review; multimodal interaction technique; augmented reality
N2  - 

Augmented Reality (AR) has proposed several types of interaction techniques such as 3D interactions, natural interactions, tangible interactions, spatial awareness interactions and multimodal interactions. Usually, interaction technique in AR involve unimodal interaction technique that only allows user to interact with AR content by using one modality such as gesture, speech, click, etc. Meanwhile, the combination of more than one modality is called multimodal. Multimodal can contribute to human and computer interaction more efficient and will enhance better user experience. This is because, there are a lot of issues have been found when user use unimodal interaction technique in AR environment such as fat fingers. Recent research has shown that multimodal interface (MMI) has been explored in AR environment and has been applied in various domain. This paper presents an empirical study of some of the key aspects and issues in multimodal interaction augmented reality, touching on the interaction technique and system framework. We reviewed the question of what are the interaction techniques that have been used to perform a multimodal interaction in AR environment and what are the integrated components applied in multimodal interaction AR frameworks. These two questions were used to be analysed in order to find the trends in multimodal field as a main contribution of this paper. We found that gesture, speech and touch are frequently used to manipulate virtual object. Most of the integrated component in MMI AR framework discussed only on the concept of the framework components or the information centred design between the components. Finally, we conclude this paper by providing ideas for future work involving this field.

UR - http://ijaseit.insightsociety.org/index.php?option=com_content&view=article&id=9&Itemid=1&article_id=6824 DO - 10.18517/ijaseit.8.4-2.6824

RefWorks

RT Journal Article
ID 6824
A1 Muhammad Nizam, Siti Soleha
A1 Zainal Abidin, Rimaniza
A1 Che Hashim, Nurhazarifah
A1 Lam, Meng Chun
A1 Arshad, Haslina
A1 Abd Majid, Nazatul Aini
T1 A Review of Multimodal Interaction Technique in Augmented Reality Environment
JF International Journal on Advanced Science, Engineering and Information Technology
VO 8
IS 4-2
YR 2018
SP 1460
OP 1469
SN 2088-5334
PB INSIGHT - Indonesian Society for Knowledge and Human Development
K1 review; multimodal interaction technique; augmented reality
AB 

Augmented Reality (AR) has proposed several types of interaction techniques such as 3D interactions, natural interactions, tangible interactions, spatial awareness interactions and multimodal interactions. Usually, interaction technique in AR involve unimodal interaction technique that only allows user to interact with AR content by using one modality such as gesture, speech, click, etc. Meanwhile, the combination of more than one modality is called multimodal. Multimodal can contribute to human and computer interaction more efficient and will enhance better user experience. This is because, there are a lot of issues have been found when user use unimodal interaction technique in AR environment such as fat fingers. Recent research has shown that multimodal interface (MMI) has been explored in AR environment and has been applied in various domain. This paper presents an empirical study of some of the key aspects and issues in multimodal interaction augmented reality, touching on the interaction technique and system framework. We reviewed the question of what are the interaction techniques that have been used to perform a multimodal interaction in AR environment and what are the integrated components applied in multimodal interaction AR frameworks. These two questions were used to be analysed in order to find the trends in multimodal field as a main contribution of this paper. We found that gesture, speech and touch are frequently used to manipulate virtual object. Most of the integrated component in MMI AR framework discussed only on the concept of the framework components or the information centred design between the components. Finally, we conclude this paper by providing ideas for future work involving this field.

LK http://ijaseit.insightsociety.org/index.php?option=com_content&view=article&id=9&Itemid=1&article_id=6824 DO - 10.18517/ijaseit.8.4-2.6824