REAL-TIME HAND DETECTION BY DEPTH IMAGES: A SURVEY

Authors

  • Mostafa Karbasi Khulliyyah of Information and Communication Technology, International Islamic University Malaysia
  • Zeeshan Bhatti Khulliyyah of Information and Communication Technology, International Islamic University Malaysia
  • Reza Aghababaeyan Department of Computer, Rodehen Branch, Islamic Azad University, Rodehen, Iran
  • Sara Bilal Khulliyyah of Information and Communication Technology, International Islamic University Malaysia
  • Abdolvahab Ehsani Rad Department of Computer Engineering, Faculty of Advance Informatics School, University Teknologi of Malaysia
  • Asadullah Shah Khulliyyah of Information and Communication Technology, International Islamic University Malaysia
  • Ahmad Waqas Khulliyyah of Information and Communication Technology, International Islamic University Malaysia

DOI:

https://doi.org/10.11113/jt.v78.5292

Keywords:

HCI Application, Depth Camera, Hand Detection, Depth Data, Depth Images

Abstract

Human hand detection can enable human to communicate with a machine and interact without any external device. Human hands play an important role in different applications such as medical image processing, sign language translator, gesture recognition and augmented reality. A human hand has different length and breadth for male and female. So, it is a complex articulated object consisting many connected parts and joints. Traditional methods for hand detection and tracking used color and shape information from RGB camera. Using a depth camera for hand detection and tracking is a challenging and interesting domain in computer vision. Some research has shown that using depth data for hand detection can improve human computer interaction. Recently, researchers used depth data in different hand detection and tracking methods in real time application. This paper explains different types of methods which are used for human hand detection. Various techniques and methods are explored and analyzed in this survey to determine the shortfalls and future directions in the field of hand detection from depth data.

References

Barczak, Andre LC, and Dadgostar, Farhad. 2005. Real-time Hand Tracking Using a Set of Cooperative Classifiers Based on Haar-Like Features.

Biswas, K. K., and Basu, Saurav Kumar, 2011. Gesture Recognition using Microsoft Kinect®. Paper presented at the Automation, Robotics and Applications (ICARA). 2011 5th International Conference on.

Breuer, Pia, Eckes, Christian, and Müller, Stefan. 2007. Hand Gesture Recognition with a Novel IR Time-Of-Flight Range Camera–A Pilot Study Computer Vision/Computer Graphics Collaboration Techniques. Springer. 247-260.

Cerlinca, Tudor Ioan, and Pentiuc, Stefan Gheorghe. 2012. Robust 3D Hand Detection for Gestures Recognition Intelligent Distributed Computing. Springer. 259-264.

Chen, Chia-Ping, Chen, Yu-Ting, Lee, Ping-Han, Tsai, Yu-Pao, and Lei, Shawmin. 2011. Real-time Hand Tracking on Depth Images. Paper presented at the Visual Communications and Image Processing (VCIP), 2011IEEE.

Dadgostar, Farhad, and Sarrafzadeh, Abdolhossein. 2006. An Adaptive Real-time Skin Detector Based on Hue Thresholding: A Comparison on Two Motion Tracking Methods. Pattern Recognition Letters. 27(12): 1342-1352.

Frati, Valentino, and Prattichizzo, Domenico. 2011. Using Kinect for Hand Tracking and Rendering in Wearable Haptics. Paper presented at the World Haptics Conference (WHC), 2011 IEEE.

Hamester, Dennis, Jirak, Doreen, and Wermter, Stefan. 2013. Improved Estimation of Hand Postures Using Depth Images. Paper presented at the Advanced Robotics (ICAR). 16th International Conference on. 2013.

Keskin, Cem, Kıraç, Furkan, Kara, Yunus Emre, and Akarun, Lale. 2012. Hand Pose Estimation and Hand Shape Classification Using Multi-Layered Randomized Decision Forests Computer Vision–ECCV. Springer. 852-863.

Keskin, Cem, Kıraç, Furkan, Kara, Yunus Emre, and Akarun, Lale. 2013. Real Time Hand Pose Estimation Using Depth Sensors Consumer Depth Cameras for Computer Vision. Springer. 119-137.

Li, Yi. 2012. Hand Gesture Recognition Using Kinect. Paper presented at the Software Engineering and Service Science (ICSESS), 3rd International Conference on. 2012 IEEE.

Liu, Xia, and Fujimura, Kikuo. 2004. Hand gesture Recognition Using Depth Data. Paper presented at the Automatic Face and Gesture Recognition, 2004. Proceedings. Sixth IEEE International Conference on.

Mo, Zhenyao, and Neumann, Ulrich. 2006. Real-time Hand Pose Recognition Using Low-Resolution Depth Images. Paper presented at the CVPR. 2.

Ong, Eng-Jon, and Bowden, Richard. 2004. A Boosted Classifier Tree for Hand Shape Detection. Paper presented at the Automatic Face and Gesture Recognition, 2004. Proceedings. Sixth IEEE International Conference on.

Park, MS, Hasan, Md Mehedi, Kim, Jaemyun, and Chae, Oksam. 2012. Hand detection and tracking using depth and color information. Paper presented at the Proceedings of the International Conference on Image Processing, Computer Vision, and Pattern Recognition (IPCV’12).

Poularakis, Stergios, and Katsavounidis, Ioannis. 2014. Finger Detection and Hand Posture Recognition Based on Depth Information. Paper presented at the Acoustics, International Conference on. Speech and Signal Processing (ICASSP), 2014 IEEE.

Ren, Zhou, Meng, Jingjing, Yuan, Junsong, and Zhang, Zhengyou. 2011. Robust Hand Gesture Recognition with Kinect Sensor. Paper presented at the Proceedings of the 19th ACM international conference on Multimedia.

Ren, Zhou, Yuan, Junsong, and Zhang, Zhengyou. 2011. Robust Hand Gesture Recognition Based On Finger-Earth Mover's Distance with a Commodity Depth Camera. Paper presented at the Proceedings of the 19th ACM international conference on Multimedia.

Suau, Xavier, Ruiz-Hidalgo, Javier, and Casas, Josep R. 2012. Real-time head and Hand Tracking Based on 2.5 D Data. Multimedia, IEEE Transactions on. 14(3): 575-585.

Suryanarayan, Poonam, Subramanian, Anbumani, and Mandalapu, Dinesh. 2010. Dynamic Hand Pose Recognition Using Depth Data. Paper presented at the Pattern Recognition (ICPR), 2010. 20th International Conference on.

Uebersax, Dominique, Gall, Juergen, Van den Bergh, Michael, and Van Gool, Luc. 2011. Real-time Sign Language Letter and Word Recognition from Depth Data. Paper presented at the Computer Vision Workshops (ICCV Workshops), International Conference on. 2011 IEEE.

Van Bang Le, Anh Tu Nguyen, and Zhu, Yu. Hand Detecting and Positioning Based on Depth Image of Kinect Sensor.

Van den Bergh, Michael, Koller-Meier, Esther, Bosché, Frédéric, and Van Gool, Luc. 2009. Haarlet-based Hand Gesture Recognition for 3D Interaction. Paper presented at the Applications of Computer Vision (WACV). Workshop on. 2009.

Van den Bergh, Michael, and Van Gool, Luc. 2011. Combining RGB and ToF Cameras for Real-Time 3D Hand Gesture Interaction. Paper presented at the Applications of Computer Vision (WACV). 2011 IEEE.

Weng, JJ, and Cui, Y. 1998. Recognition of Hand Signs from Complex Backgrounds. Computer Vision for Human-Machine Interaction.

Xiao, Zheng, Mengyin, Fu, Yi, Yang, and Ningyi, Lv. 2012. 3D Human Postures Recognition Using Kinect. Paper presented at the Intelligent Human-Machine Systems and Cybernetics (IHMSC), 4th International Conference on. 2012.

Yao, Yuan, and Fu, Yun. 2012. Real-time Hand Poses Estimation from RGB-D Sensor. Paper presented at the Multimedia and Expo (ICME), International Conference on. 2012 IEEE.

Zainordin, Faeznor Diana, Lee, Hwea Yee, Sani, Noor Atikah, Wong, Yong Min, and Chan, Chee Seng. 2012. Human Poses Recognition Using Kinect and Rule-Based System. Paper presented at the World Automation Congress (WAC), 2012.

Reza, A. and S.F.S.Asrari. 2016. DIGITAL IMAGE OF WATERMARKING: A SURVEY. Jurnal Teknologi. 78(1): 209-216.

Downloads

Published

2016-02-09

Issue

Vol. 78 No. 2: February 2016

Section

Science and Engineering

License

Copyright of articles that appear in Jurnal Teknologi belongs exclusively to Penerbit Universiti Teknologi Malaysia (Penerbit UTM Press). This copyright covers the rights to reproduce the article, including reprints, electronic reproductions, or any other reproductions of similar nature.

How to Cite

REAL-TIME HAND DETECTION BY DEPTH IMAGES: A SURVEY. (2016). Jurnal Teknologi (Sciences & Engineering), 78(2). https://doi.org/10.11113/jt.v78.5292