AN S-PI VISION-BASED TRACKING SYSTEM FOR OBJECT MANIPULATION IN AUGMENTED REALITY
DOI:
https://doi.org/10.11113/jt.v75.5060Keywords:
Component, augmented reality, vision-based tracking, gesture interaction, object manipulationAbstract
In this paper, we describe a new tracking approach for object handling in Augmented Reality (AR). Our approach improves the standard vision-based tracking system during marker extraction and its detection stage. It transforms a unique tracking pattern into set of vertices which are able to perform interaction such as translate, rotate, and copy. This is based on arobust real-time computer vision algorithm that tracks a paddle that a person uses for input. A paddle pose pattern is constructed in a one-time calibration process and through vertex-based calculation of the camera pose relative to the paddle we can show 3D graphics on top of it. This allows the user to look at virtual objects from different viewing angles in the AR interface and perform 3D object manipulation. This approach was implemented using marker-based tracking to improve the tracking in term of the accuracy and robustness in manipulating 3D objects in real-time. We demonstrate our improved tracking system with a sample Tangible AR application, and describe how the system could be improved in the future.
References
Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier and B. MacIntyre. 2001. Recent Advances in Augmented Reality. IEEE Computer Graphics & Applications. 21(6): 34-47.
White, S., D. Feng and S. Feiner. 2009. Poster: Shake Menus: Activation and Placement Techniques for Prop-based 3D Graphical Menus. In Proc. IEEE Symposium on 3D User Interfaces. Lafayette, LA.14-15 March 2009. 129-130.
Billinghurst, M., H. Kato and I. Poupyrev. 2001. The Magic-Book – Moving Seamlessly between Reality and Virtuality. In Healy, G., Shafer, S. and Wolff, L. Physics Based Vision: Principles and Practice, COLOR. Boston: Jones and Bartlett.
Geiger, C., L. Oppermann and C. Reimann. 2003. 3D-Registered Interaction-Surfaces in Augmented Reality Space. In Proceedings of 2nd IEEE International Augmented Reality Toolkit Workshop. Tokyo, Japan. 7 October 2003. 5-13.
Kiyokawa, K., H. Takemura and N.Yokoya. 1999. A Collaboration Support Technique by Integrating a Shared Virtual Reality and a Shared Augmented Reality. In Proceedings of IEEE International Conference on Systems Man and Cybernetics. Tokyo, Japan. 12-15 October 1999. 6: 48-53.
Kato, H., M. Billinghurst, I. Poupyrev, N. Tetsutani and K. Tachibana. 2001. Tangible Augmented Reality for Human Computer Interaction. In Proceedings of 17thNicograph (In Japanese). Nagoya, Japan. 39-44.
Szalavari, Z. and M.Gervautz. 1997. The Personal Interaction Panel – A Two-Handed Interface for Augmented Reality. In Proceedings of EUROGRAPHICS, Computer Graphics Forum. 16(3): 335-346.
Buchmann, S. Violich, M. Billinghurst and A. Cockburn. 2004. FingARtips: Gesture based Direct Manipulation in Augmented Reality. In Proc. 2nd International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia. Singapore. 15-18June 2004. 212-221.
Zhou, F., H. B. L. Duh and M. Billinghurst. 2008. Trends in Augmented Reality Tracking, Interaction and Display: A Review of Ten Years of ISMAR. In Proc. IEEE ISMAR. Cambridge, UK. 15-18 September 2008. 193-202.
Ismail, A. W., M. S. Sunar and C. S. Yusof. 2011. Single-Point
Interaction for 3D Object Handling in Augmented Reality. Journal of Computing. 3(1):61-65.
Ishii, H. and B. Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. In ACM CHI 97. Los Angeles, USA. 18-23 April 1997. 234-241.
Kato, H., M. Billinghurst, I. Poupyrev, K. Imamoto and K. Tachibana. 2000. Virtual Object Manipulation on a Table-Top AR Environment. In Proceedings of the International Symposium on Augmented Reality (ISAR 2000). Munich. 5-6 October 2000. 111–119.
Irawati, S., S. Green, M. Billinghurst, A. Duenser and H. Ko. 2006. An Evaluation of an Augmented Reality Multimodal Interface using Speech and Paddle Gestures. 2006. In Pan, Z., Cheok, D. A. D., Haller, M., Lau, R., Saito, H., Liang, R. (eds.). ICAT 2006. Springer, Heidelberg.
Henrysson, A., M. Billinghurst and M. Ollila. 2005. Virtual Object Manipulation using a Mobile Phone. In Proceedings of the 2005 International Conference on Augmented Tele-Existence. Christchurch, New Zealand. 5-8 Dec. 2005. 164-171.
Lee, B. S. and J. C. Chun. 2010. Interactive Manipulation of Augmented Objects in Marker-Less AR using Vision-Based Hand Mouse. In Inn Conference on Information Technology (ITNG). Las Vegas, NV. 12-14 April 2010. 398-403.
Billinghurst, M., I. Poupyrev, H. Kato and R. May. 2000. Mixing Realities in Shared Space: An Augmented Reality Interface for Collaborative Computing. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME2000). New York. 30July–2 August 2000. 3: 1641-1644.
Fiala, M. 2005. ARTag, A Fiducial Marker System using Digital Techniques. In Proc. CVPR 2005. San Diego, CA. 20-25 June 2005. 2: 590-596.
Lee, T. and T. Hollerer. 2008. Hybrid Feature Tracking and User Interaction for Markerless Augment Reality. In IEEE International Conference on Virtual Reality'08. Reno, NE. 8-12 March 2008. 145-152.
Lee, T. and T. Hollerer. 2007. Hand AR: Markerless Inspection of Augmented Reality Objects using Fingertip Tracking. In Proc. IEEE ISWC '07. Boston, MA. 11-13 October 2007. 83-90.
Lee, T. and T. Hollerer. 2007. Initializing Markerless Tracking using a Simple Hand Gesture. In Proc. ACMIIEEE ISMAR '07. Nara. 13-16 November 2007. 1-2.
Dorfmüller-Ulhaas, K. and D. Schmalstieg. 2001. Finger Tracking for Interaction in Augmented Environments. In IEEE and ACM International Symposium on Augmented Reality (ISAR 01). New York, NY. 29-30 October 2001. 55-64.
Malik, S., C. McDonald and G. Roth. 2002. Hand Tracking for Interactive Pattern-Based Augmented Reality. In Proceedings of the 1st International Symposium on Mixed and Augmented Reality (ISMAR 02). Darmstadt, Germany. 30 September–1 October 2002. 117-126.
Philip L. ARToolKit. [Online] From: http://www.hitl.washington.edu/artoolkit.
Park, J., B. Jiang and U. Neumann. 1999. Vision-based Pose Computation: Robust and Accurate Augmented Reality Tracking. In 2nd IEEE and ACMInternational Workshop on Augmented Reality (IWAR 99). San Francisco, California. 20-21 October 1999. 3-12.
Klein, G. and T. Drummond. 2003. Robust Visual Tracking for Non-Instrumented Augmented Reality. In Proceedings of the 2nd International Symposium on Mixed and Augmented Reality (ISMAR 03). Tokyo, Japan. 7-10 October 2003. 113-122.
Bajura, M. and N. Ulrich. 1995. Dynamic Registration Correction in Video-Based Augmented Reality Systems. IEEE Computer Graphics and Applications. 15(5): 52-60.
Sunar, M. S., A. M. Zin and T. M. Tengku Sembok. 2008. Improved View Frustum Culling Technique for Real-Time Virtual Heritage Application. The International Journal of Virtual Reality. 7(3): 43-48.
Noh, Z., M. S. Sunar and Z. Pan. 2009. Review on Augmented Reality for Virtual Heritage System. Edutainment 2009 Springer-Verlag Berlin Heidelberg. Lecture Note in Computer Science LNCS 5670.
Leap Motion, Inc. Leapmotion.[Online] From https://www.leapmotion.com/.
Ren, Z., J. Yuan, J. Meng and Z. Zhang. 2013. Robust Part-Based Hand Gesture Recognition using Kinect Sensor. IEEE Transactions on Multimedia. 15(5): 1110-1120.
Downloads
Published
Issue
Section
License
Copyright of articles that appear in Jurnal Teknologi belongs exclusively to Penerbit Universiti Teknologi Malaysia (Penerbit UTM Press). This copyright covers the rights to reproduce the article, including reprints, electronic reproductions, or any other reproductions of similar nature.
