A New Native Video Filtering based on OpenGL ES for Mobile Platform

Sari Wijayanti (1), Burhan Alfironi Muktamar (2), Sunu Wibirama (3), Agus Bejo (4)
(1) Department of Information System, Faculty of Engineering and Information Technology, Jenderal Achmad Yani University, Jl. Siliwangi, Yogyakarta, 55294, Indonesia
(2) Department of Information System, Faculty of Engineering and Information Technology, Jenderal Achmad Yani University, Jl. Siliwangi, Yogyakarta, 55294, Indonesia
(3) Department of Electrical Engineering and Information Technology, Faculty of Engineering, Universitas Gadjah Mada
(4) Department of Electrical Engineering and Information Technology, Faculty of Engineering, Universitas Gadjah Mada
Fulltext View | Download
How to cite (IJASEIT) :
Wijayanti, Sari, et al. “A New Native Video Filtering Based on OpenGL ES for Mobile Platform”. International Journal on Advanced Science, Engineering and Information Technology, vol. 9, no. 3, May 2019, pp. 759-65, doi:10.18517/ijaseit.9.3.7329.
In the last five years, there have been many Android applications implementing video filter or video effect as an excellent feature. Open CV is an open source computer vision library that can be simply and easily used for video filtering in Android application. However, using OpenCV library for video filtering commonly yields a bigger size of Android application. The concept of “Develop for Billion People” has enforced the developers to optimize the size of their applications to preserve resources and size of memory—as not all Android devices come with sufficiently large memory. On the other hand, OpenGL ES does not burden the filtering process because of its smaller size when it is implemented during the application development. In this research, we present a new native video processing technique using OpenGL ES. We implement the proposed method on a native video file without decreasing its quality before video filtering process. The experiments were conducted with five different mobile devices. We compared several metrics including: quality of the resulted video, file size of the apk, power consumption, and memory usage. Based on the experimental results, OpenGL ES produces smaller file size of apk (2 MB) compared with the produced file size of apk by Open CV (20MB). The resulted file after video filtering possesses same properties as observed before video filtering. Additionally, OpenGL ES uses more efficient power with 0.1965 mAh, while OpenCV consumes 0.283 mAh. Finally, video filtering with OpenGL ES uses 29.3% lesser memory than video filtering with OpenCV. The proposed method is proven to be more appropriate with “Develop for Billion People” as it preserves more computational resources compared with the existing video filtering technique in Android.

Google Developers Guide. (2019) OpenGL ES. [Online]. Available: https://developer.android.com/guide/topics/graphics/opengl.

B. van der Wielen. (2018) Insight into the 2.3 Billion Android Smartphones in Use around the World. [Online]. Available: https://newzoo.com/insights/articles/insights-into-the-2-3-billion- android-smartphones-in-use-around-the-world/.

A. Kaehler and G. Bradski, Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library, California, United States of America: O'Reilly, 2017.

B. Radovic, G. Miljkovic, B. Bogicevic, and V. Mihic, “Rendering of digital video content through OpenGL ES on Smart TV,” in 2013 21st Telecommunications Forum Telfor, TELFOR 2013 - Proceedings of Papers, 2013, pp. 709-712.

E. Angel, “The Case for Teaching Computer Graphics with WebGL: A 25-Year Perspective,” IEEE Comput. Graph. Appl., vol. 37, no. 2, pp. 106-112, 2017.

M. Borg and C. J. Debono, “Fast High Definition Video Rendering on Mobile Devices,” in Proc. 18th Mediterr. Electrotech. Conf. MELECON 2016, 2016, pp. 18-20.

V. P. S., S. Kamath, H. Sarojadevi, and N. N. Chiplunkar, “An Approach for Bitstream Video Watermarking on Mobile Device,” in Proc. of. International conference on Signal Processing, Communication, Power and Embedded System (SCOPES), 2016, pp. 578-583.

P. S. Venugopala, A. A. Nayak, H. Sarojadevi, and N. N. Chiplunkar, “Various challenges in video watermarking for Android mobile devices,” in Proc. - IEEE Int. Conf. Inf. Process. ICIP, 2015, pp. 248-253.

S. B. Chaudhari and S. A. Patil, “Real Time Video Processing and Object Detection on Android Smartphone,” in Proc. of International Conference on Electrical, Electronics, Signals, Communication and Optimization (EESCO), 2015.

K. M. bin Saipullah, A. Anuar, N. A. binti Ismail, and Y. Soo, “Real-Time Video Processing Using Native Programming on Android Platform,” in 2012 IEEE 8th Int. Colloq. Signal Process. its Appl., pp. 276-281, 2012.

C. Wu, B. Yang, W. Zhu, and Y. Zhang, “Toward High Mobile GPU Performance Through Collaborative Workload Offloading,” IEEE Trans. Parallel Distrib. Syst., vol. 29, no. 2, pp. 435-449, 2018.

J. Song, P. Wang, Q. Miao, R. Liu, and B. Huang, “The Reconnection of Contour Lines from Scanned Color Images of Topographical Maps Based on GPU Implementation,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., vol. 10, no. 2, pp. 400-408, 2017.

Y. Shen, M. Yang, B. Wei, C. T. Chou, and W. Hu, “Learn to Recognise: Exploring Priors of Sparse Face Recognition on Smartphones,” IEEE Trans. Mob. Comput. vol. 16, no. 6, pp. 1705-1717, 2017.

Z. Zhang and C. Yin, “Research on video rendering on android,” in Proc. of The 8th International Conference on Wireless Communications, Networking and Mobile Computing, 2012, pp. 1- 4.

J. Luo, J. Chen, L. Han, and M. Li, “Video after-effect rendering based on pipelining principle,” in Proc. - 6th Int. Conf. Internet Comput. Sci. Eng. ICICSE 2012, 2012, pp. 102-106.

Google Developers Guide. (2019) Platform Architecture. [Online]. Available: https://developer.android.com/guide/platform.

S. Wibirama, H. A. Nugroho, and K. Hamamoto, "Evaluating 3D Gaze Tracking in Virtual Space: A Computer Graphics Approach," Entertainment Computing, Vol. 21, pp. 11-17, 2017.

Authors who publish with this journal agree to the following terms:

    1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
    2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
    3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).