A REVIEW ON AUGMENTED REALITY TRACKING METHODS FOR MAINTENANCE OF ROBOTS
Keywords:Augmented reality, AR, maintenance, robot, tracking
AbstractAugmented reality (AR) in maintenance is a broad subject with many nuances when it comes to their implementation. The applications of these systems range from maintenance of large-scale assets such as buildings to smaller scale assets such as robots. Applications of AR in maintenance typically serves as a visual guide to assist users in diagnosis or steps needed to be performed for maintenance. In this paper, the tracking methods utilized in AR-based maintenance for robots are qualitatively evaluated. The reviewed works in this paper are between the years of 2015 to 2020 to ensure that the AR tracking methods are relatively state of the art. It is found that applications of AR-based maintenance for robots are uncommon in the scope defined in this research especially in the industrial environment as most reviewed works are conducted in a laboratory setting. In addition to that, it is found that marker-based tracking methods are commonly utilized in these applications.
Amin, D. and S. Govilkar, Feb. 2015, â€œComparative Study of Augmented Reality Sdkâ€™s,â€ Int. J. Comput. Sci. Appl., vol. 5, no. 1, pp. 11â€“26.
Mekni, M. and A. Lemieux, â€œAugmented Reality : Applications , Challenges and Future Trends,â€ 2014.
Schmalstieg, D. and T. Hollerer, â€œAugmented reality: Principles and practice,â€ in 2017 IEEE Virtual Reality (VR), 2017, pp. 425â€“426.
Palmarini, R., J. A. Erkoyuncu, R. Roy, and H. Torabmostaedi, Feb. 2018, â€œA systematic review of augmented reality applications in maintenance,â€ Robot. Comput. Integr. Manuf., vol. 49, pp. 215â€“228
Rongting, Z., S. Yiran, H. Tongliang, and F. Asmi, â€œApplying Augmented Reality Technology to E-Learning: Science Educational AR Products as an Example,â€ in 2016 IEEE 13th International Conference on e-Business Engineering (ICEBE), Nov. 2016, pp. 129â€“133.
Detmer, F. J., J. Hettig, D. Schindele, M. Schostak, and C. Hansen, 2017, â€œVirtual and Augmented Reality Systems for Renal Interventions: A Systematic Review,â€ IEEE Rev. Biomed. Eng., vol. 10, pp. 78â€“94.
Alrashed, M., Y. Yadekar, J. A. Erkoyuncu, and Y. Zhao, Jan. 2016, â€œExamination of Robotic Aerospace Engines Maintenance Supported by Augmented Reality through Cloud Manufacturing,â€ Proc. Int. Conf. Artif. Life Robot., vol. 21, pp. 445â€“449.
Luxenburger, A. et al., â€œAugmented Reality for Human-Robot Cooperation in Aircraft Assembly,â€ in 2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), Dec. 2019, pp. 263â€“2633.
Flatt, H., N. Koch, A. GÃ¼nter, C. RÃ¶cker, and J. Jasperneite, A Context-Aware Assistance System for Maintenance Applications in Smart Factories based on Augmented Reality and Indoor Localization. 2015.
Brizzi, F., L. Peppoloni, A. Graziano, E. D. Stefano, C. A. Avizzano, and E. Ruffaldi, 2018, â€œEffects of Augmented Reality on the Performance of Teleoperated Industrial Assembly Tasks in a Robotic Embodiment,â€ IEEE Trans. Human-Machine Syst., vol. 48, no. 2, pp. 197â€“206.
Sreeram, S., K. K. Nisha, and R. Jayakrishnan, â€œVirtual Design Review and Planning Using Augmented Reality and Drones,â€ in 2018 Second International Conference on Intelligent Computing and Control Systems (ICICCS), 2018, pp. 915â€“918.
ZaldÃvar-Colado, U., S. Garbaya, P. Tamayo-Serrano, X. ZaldÃvar-Colado, and P. Blazevic, â€œA mixed reality for virtual assembly,â€ in 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), 2017, pp. 739â€“744.
FernÃ¡ndez del Amo, I., J. A. Erkoyuncu, R. Roy, R. Palmarini, and D. Onoufriou, Dec. 2018, â€œA systematic review of Augmented Reality content-related techniques for knowledge transfer in maintenance applications,â€ Comput. Ind., vol. 103, pp. 47â€“71.
Coleta, G. F. Dela, A. Cardoso, E. A. L. JÃºnior, and G. F. M. de Lima, â€œTelecommunications Field Operations Supported by Augmented Reality â€“ a Systematic Review,â€ in 2019 21st Symposium on Virtual and Augmented Reality (SVR), 2019, pp. 77â€“83.
Fraga-Lamas, P., T. M. FernÃ¡Ndez-CaramÃ©S, Ã“. Blanco-Novoa, and M. A. Vilar-Montesinos, 2018, â€œA Review on Industrial Augmented Reality Systems for the Industry 4.0 Shipyard,â€ IEEE Access, vol. 6, pp. 13358â€“13375.
Andersson, N. et al., 2016, â€œAR-Enhanced Human-Robot-Interaction - Methodologies, Algorithms, Tools,â€ Procedia CIRP, vol. 44, pp. 193â€“198.
Booth, A., D. Papaioannou, and A. Sutton, Systematic Approaches to a Successful Literature Review. 2016, SAGE Publications Ltd.
Aschenbrenner, D. et al., â€œComparing Different Augmented Reality Support Applications for Cooperative Repair of an Industrial Robot,â€ in 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), 2018, pp. 69â€“74.
Avalle, G., F. De Pace, C. Fornaro, F. Manuri, and A. Sanna, 2019, â€œAn Augmented Reality System to Support Fault Visualization in Industrial Robotic Tasks,â€ IEEE Access, vol. 7, pp. 132343â€“132359.
Guhl, J., S. Tung, and J. Kruger, â€œConcept and architecture for programming industrial robots using augmented reality with mobile devices like microsoft HoloLens,â€ in 2017 22nd IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), 2017, pp. 1â€“4.
Zou, W., M. Andulkar, and U. Berger, â€œDevelopment of Robot Programming System through the use of Augmented Reality for Assembly Tasks,â€ in ISR 2018; 50th International Symposium on Robotics, 2018, pp. 1â€“7.
Linnerud, Ã…. S., R. SandÃ¸y, and L. E. Wetterwald, â€œCAD-based system for programming of robotic assembly processes with human-in-the-loop,â€ in 2019 IEEE 28th International Symposium on Industrial Electronics (ISIE), 2019, pp. 2303â€“2308.
Costa, C. M. et al., â€œModeling of video projectors in OpenGL for implementing a spatial augmented reality teaching system for assembly operations,â€ in 2019 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), 2019, pp. 1â€“8.
Blankemeyer, S., R. Wiemann, L. Posniak, C. Pregizer, and A. Raatz, 2018, â€œIntuitive Robot Programming Using Augmented Reality,â€ Procedia CIRP, vol. 76, pp. 155â€“160.
Mourtzis, D., V. Zogopoulos, and E. Vlachou, 2017, â€œAugmented Reality Application to Support Remote Maintenance as a Service in the Robotics Industry,â€ Procedia CIRP, vol. 63, pp. 46â€“51.
De Pace, F., F. Manuri, A. Sanna, and D. Zappia, Mar. 2019, â€œA Comparison Between Two Different Approaches for a Collaborative Mixed-Virtual Environment in Industrial Maintenance,â€ Front. Robot. AI, vol. 6.
Alves, J., B. Marques, M. Oliveira, T. AraÃºjo, P. Dias, and B. S. Santos, â€œComparing Spatial and Mobile Augmented Reality for Guiding Assembling Procedures with Task Validation,â€ in 2019 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), 2019, pp. 1â€“6.