FAST AND ROBUST STEREO MATCHING ALGORITHM FOR OBSTACLE DETECTION IN ROBOTIC VISION SYSTEMS

Authors

  • Masoud Samadi Malaysia-Japan International Institute of Technology (MJIIT), Universiti Teknologi Malaysia, Kuala Lumpur, Malaysia
  • Mohd Fauzi Othman Malaysia-Japan International Institute of Technology (MJIIT), Universiti Teknologi Malaysia, Kuala Lumpur, Malaysia
  • Muhamad Farihin Talib Malaysia-Japan International Institute of Technology (MJIIT), Universiti Teknologi Malaysia, Kuala Lumpur, Malaysia

DOI:

https://doi.org/10.11113/jt.v78.9284

Keywords:

Stereo vision, obstacle detection, robotic, stereo matching, differential transform

Abstract

In this paper, we propose a new area-based stereo matching method by improving the classical Census transform. It is a difficult task to match the corresponding points in two images taken by stereo cameras, mostly under variant illumination and non-ideal conditions. The classic Census nonparametric transform offers some improvements in the accuracy of disparity map in these conditions but it also has some disadvantages. Because of the complexity of the algorithm, the performance is not suitable for real-time robotic systems. In order to solve this problem, this paper presents the differential transform using Maximum intensity differences of the pixel placed in the center of a defined window and the pixel in the neighborhood to reduce complexity and obtain better performance compared to the Census transform. Experimental results show that the proposed method, achieves better efficiency in terms of speed and memory consumption.  Moreover, we have added a new feature to widen the depth detection range. With the help of the proposed method, robots can detect obstacles between 25cm to 400cm from robot cameras. The result shows that the method has the ability to work in a wide variety of lighting conditions, while the stereo matching performs the depth detection computation with speed of 30FPS.  

References

J. Calderon, A. Obando, and D. Jaimes. 2007. Road Detection Algorithm For An Autonomous Ugv Based On Monocular Vision. Electronics, Robotics and Automotive Mechanics Conference, 2007. CERMA 2007. Sept 2007. 253–259.

M. Brown, D. Burschka, and G. Hager. 2003. Advances in computational stereo. Pattern Analysis and Machine Intelligence, IEEE Transactions on. Aug 2003. 25(8): 993–1008.

D. Scharstein and R. Szeliski. 2001. A Taxonomy And Evaluation Of Dense Two-Frame Stereo Correspondence Algorithms. International Journal Of Computer Vision. 47: 7–42.

S. M. Grigorescu, G. Macesanu, T. T. Cocias, D. Puiu, and F. Moldoveanu. 2011. Robust Camera Pose And Scene Structure Analysis For Service Robotics. Robotics and Autonomous Systems. 59(11): 899–909.

H. Hirschmuller and D. Scharstein. 2009. Evaluation Of Stereo Matching Costs On Images With Radiometric Differences. Pattern Analysis and Machine Intelligence. IEEE Transactions on. Sept 2009. 31(9): 1582–1599.

T. Kanade, H. Kano, S. Kimura, A. Yoshida, and K. Oda. 1995. Development of a video-rate stereo machine. In Intelligent Robots and Systems 95. Human Robot Interaction and Cooperative Robots. Proceedings. 1995 IEEE/RSJ International Conference on. Aug 1995. 3.

M. J. Hannah. 1974. Computer Matching Of Areas In Stereo Images. Ph.D. dissertation, Stanford, CA, USA.

P. Ben-Tzvi and X. Xin. 2010. An Embedded Feature-Based Stereo Vision System For Autonomous Mobile Robots. In Robotic and Sensors Environments (ROSE), 2010 IEEE International Workshop on. 1–6.

B. H. Schfer, M. Proetzsch, and K. Berns. 2005. Stereo-Vision-Based Obstacle Avoidance In Rough Outdoor Terrain. International Symposium on Motor Control and Robotics.

B. Khaleghi, S. Ahuja, and Q. Wu. 2008. An Improved Real-Time Miniaturized Embedded Stereo Vision System (mesvs-ii). In Computer Vision and Pattern Recognition Workshops, CVPRW ’08. IEEE Computer Society Conference on. 1–8.

R. Zabih and J. Woodfill. 1994. Non-Parametric Local Transforms For Computing Visual Correspondence. In Proceedings of the Third European Conference-Volume II on Computer Vision - Volume II, ser. ECCV ’94. UK: Springer-Verlag. 151–158.

Fusiello, E. Trucco, and A. Verri. 2000. A Compact Algorithm For Rectification Of Stereo Pairs. Mach. Vision Appl.12(1): 16–22.

Zinner, M. Humenberger, K. Ambrosch, and W. Kubinger. 2008. An Optimized Software-Based Implementation of a Census-Based Stereo Matching Algorithm, ser. Lecture Notes in Computer Science. 5358: 216–227.

M. Weber, M. Humenberger, and W. Kubinger. 2009. a VERY FAST CENSUSBASED STEREO MATCHING IMPLEMENTATION ON A GRAPHICS PROCESSING UNIT. In Computer Vision Workshops (ICCV Workshops). IEEE 12th International Conference on. 786–793.

V. Ganapathy and O.-E. Ng. 2008. Stereo vision based robot controller. In Systems, Man and Cybernetics, 2008. SMC 2008. IEEE International Conference on. 1849–1854.

M. Samadi, M. F. Othman and SH. H. M. Amin. 2013. Stereo Vision Based Robots: Fast and Robust Obstacle Detection Method. The 9th Asian Control Conference (ASCC 2013). June 2013.

Samadi, M. and M. Othman. 2013. A New Fast and Robust Stereo Matching Algorithm for Robotic Systems. The 9th International Conference on Computing and Information Technology (IC2IT2013). In P. Meesad, H. Unger, and S. Boonkrong (Ed). Springer Berlin Heidelberg. 281-290.

Middlebury. 2012 The Middlebury Stereo Evaluation Website.

Downloads

Published

2016-06-28

How to Cite

FAST AND ROBUST STEREO MATCHING ALGORITHM FOR OBSTACLE DETECTION IN ROBOTIC VISION SYSTEMS. (2016). Jurnal Teknologi (Sciences & Engineering), 78(6-13). https://doi.org/10.11113/jt.v78.9284