DEEP LEARNING BASED MALAYSIAN COINS RECOGNITION FOR VISUAL IMPAIRED PERSON
DOI:
https://doi.org/10.11113/aej.v12.17143Keywords:
Visual impaired, Deep learning, AlexNet, GoogleNet, MobileNetV2, Coins recognitionAbstract
Currency recognition has been widely developed using various types of techniques and able to assist people who have a visual impairment. Machine learning is one of the methods implemented where deep learning architecture is one of them. The deep learning approach is reliable and can be used in detection and recognition of objects based on images. As currency recognition has been developed for other currencies, thus in this project, currency recognition using Malaysian coins has been developed by modeling Convolutional Neural Network (CNN) in recognizing coin images. Malaysian coins dataset was developed consist of 2400 images of four classes of coins, 5 sen, 10 sen, 20 sen, and 50 sen. In this study, pretrained CNN which are AlexNet, GoogleNet, and MobileNetV2 were formulated in recognizing such coins. Performance of each trained model was evaluated using confusion matrix and GoogleNet obtained the best performance with 99.2% testing accuracy, 99.2% precision, 99.18% recall, and 99.19% F1 score. From the trained model, it can be further developed and implemented in assisting visually impaired persons by producing a prototype using Raspberry Pi and FPGA before it can be clinically tested on the subject.
References
W. H. Organization, 2019. “Blindness and Vision Impairment,” [Online]. Available: https://www.who.int/news-room/fact-sheets/detail/blindness-and-visual-impairment. [Accessed: 19-Oct-2019].
E. E. Freeman and E. W. Gower, 2013“Visual Impairment,” in Women and Health (Second Edition), Second Edi., R. T. and K. M. R. Marlene B. Goldman, Ed. Elsevier. 1463–1472.
M. Hu, Y. Chen, G. Zhai, Z. Gao, and L. Fan. 2019., “An Overview of Assistive Devices for Blind and Visually Impaired People,” International Journal of Robotics and Automation, 34(5) :
S. Sumit. 2018., “A Comprehensive Guide to Convolutional Neural Networks — the ELI5 way,” [Online]. Available: https://towardsdatascience.com/a-comprehensive-guide-to-convolutional-neural-networks-the-eli5-way-3bd2b1164a53. [Accessed: 19-Oct-2019].
Y. Lecun, Y. Bengio, and G. Hinton. 2015., “Deep Learning,” Nature, 521(7553) : 436–444,
L. D. Dunai, M. C. Pérez, G. Peris-Fajarnés, and I. L. Lengua, 2017. “Euro Banknote Recognition System for Blind People,” Sensors (Switzerland). 17(1) : 184
“BrainPort Vision Pro. 2019 [Online]. Available: https://www.wicab.com/brainport-vision-pro. [Accessed: 19-Oct-2019].
I. Abu Doush and S. AL-Btoush, 2017. “Currency Recognition using A Smartphone : Comparison between Color SIFT and Gray Scale SIFT Algorithms,” Journal of King Saud University - Computer and Information Sciences., 29(4) : 484–492.
K. N. N. Hlaing and A. K. Gopalakrishnan, 2016. “Myanmar Paper Currency Recognition using GLCM and k-NN,” 2016 2nd Asian Conf. Def. Technol. ACDT 2016, 67–72,
N. A. Jasmin Sufri et al., 2017.“Image Based Ringgit Banknote Recognition for Visually Impaired,” Journal of Telecommunication, Electronic and Computer Engineering., 9( 3–9) : 103–111,
L. Zhang, F. Yang, Y. Daniel Zhang, and Y. J. Zhu, 2016. “Road Crack Detection using Deep Convolutional Neural Network,” IEEE International Conference on Image Processing (ICIP). ICIP, 3708–3712
S. Albawi, T. A. Mohammed, and S. Al-Zawi, 2018.“Understanding of A Convolutional Neural Network,” International Conference on Engineering and Technology (ICET) ICET 2017,: 1–6,
P. Harsha Vardhan and P. S. Uma Priyadarsini, 2016.“Transfer Learning using Convolutional Neural Networks for Object Classification within X-ray Baggage Security Imagery,” Res. J. Pharm. Biol. Chem. Sci., 7 : 222–229
J. Zhu, S. Liao, D. Yi, Z. Lei, and S. Z. Li, 2015.“Multi-label CNN Based Pedestrian Attribute Learning for Soft Biometrics,” International Conference on Biometrics (ICB) ICB 2015, 535–540
S. Miao, Z. J. Wang, and R. Liao, 2015. “A Convolutional Neural Network Approach for 2D/3D Medical Image Registration,”
S. Kumbhar, S. Patil, A. Nilawar, B. Mahalakshmi, and M. Nipane, 2019. “Farmer Buddy-Web Based Cotton Leaf Disease Detection Using CNN,” 14(11) : 2662–2666,
“Convolutional Neural Network.” [Online]. Available: https://www.mathworks.com/solutions/deeplearning/convolutional-neural-network.html. [Accessed: 09-Jul-2020].
J. E. Luján-García, C. Yáñez-Márquez, Y. Villuendas-Rey, and O. Camacho-Nieto, 2020 “A Transfer Learning Method for Pneumonia Classification and Visualization,” Applied Sciences., 10(8) : 2908
A. U. Tajane, J. M. Patil, A. S. Shahane, P. A. Dhulekar, S. T. Gandhe, and G. M. Phade, 2018 “Deep Learning Based Indian Currency Coin Recognition,” International Conference On Advances in Communication and Computing Technology (ICACCT), 130–134,
R. A. Minhas, A. Javed, A. Irtaza, M. T. Mahmood, and Y. B. Joo, 2019. “Shot Classification of Field Sports Videos Using AlexNet Convolutional Neural Network,” Applied Sciences., 9(3): 483
A. Titoriya and S. Sachdeva, 2019. “Breast Cancer Histopathology Image Classification using AlexNet,” 2019 4th International Conference on Information Systems and Computer Networks (ISCON), 708–712,
S. Liawatimena et al., 2019. “A Fish Classification on Images using Transfer Learning and Matlab,” 1st 2018 Indones. Indonesian Association for Pattern Recognition International Conference (INAPR). 2018 - Proc. 108–112,
C. Szegedy, S. Reed, P. Sermanet, V. Vanhoucke, and A. Rabinovich, 2014. “Going deeper with convolutions,” 1–12,
H. Hendrick, W. Zhi-Hao, C. Hsien-I, C. Pei-Lun, and J. Gwo-Jia, 2019. “IOS mobile APP for tuberculosis detection based on chest X-ray image,” Proc. ICAITI 2019 - 2nd International Conference on Applied Information Technology and Innovation (ICAITI)., 122–125,
J. Ma, J. Rao, Y. Qiao, and W. Liu, 2018. “Sprouting Potato Recognition Based on Deep Neural Network GoogLeNet,” IEEE 3rd International Conference on Cloud Computing and Internet of Things (CCIOT), 502–505
M. Al-Qizwini et al., 2017. “Deep Learning Algorithm for Autonomous Driving using GoogLeNet,” no. Iv,
M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L. C. Chen, 2018, “MobileNetV2: Inverted Residuals and Linear Bottlenecks,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 4510–4520.
T. Akiyama, Y. Kobayashi, Y. Sasaki, K. Sasaki, T. Kawaguchi, and J. Kishigami, 2019. “Mobile Leaf Identification System using CNN Applied to Plants in Hokkaido,” IEEE 8th Global Conference on Consumer Electronics (GCCE) 324–325,
H. Yuan, H. Chen, S. Liu, J. Lin, and X. Luo, 2019. “A Deep Convolutional Neural Network for Detection of Rail Surface Defect,” 2 IEEE Vehicle Power and Propulsion Conference (VPPC) - Proc., 6–9,
L. Ale, X. Fang, D. Chen, Y. Wang, and N. Zhang, 2020. “Lightweight Deep Learning Model for Facial Expression Recognition,” 707–712,
A. A. Almisreb and M. A. Saleh, 2019.Transfer Learning Utilization for Banknote Recognition: A Comparative Study Based on Bosnian Currency,” Southeast Europe Journal of Soft Computing 8(1): 1–5
S. Kaur and M. Kaur, 2015. “Coin Recognition System with Rotation Invariant using Artificial Neural Network,”
S. M. M. Roomi and R. B. J. Rajee, 2015. “Coin Detection and Recognition using Neural Networks,” in IEEE International Conference on Circuit, Power and Computing Technologies, ICCPCT 2015
G. Farooque, A. B. Sargano, I. Shafi, and W. Ali, 2017 “Coin Recognition with Reduced Feature Set SIFT Algorithm Using Neural Network,” in Proceedings - 14th International Conference on Frontiers of Information Technology, FIT 2016, :93–98.
N. Capece, U. Erra, and A. V. Ciliberto, 2017. “Implementation of a Coin Recognition System for Mobile Devices with Deep Learning,” Proc. - 12th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS. 186–192,
Z. Qiu, P. Shi, D. Pan, and D. Zhong, 2017. “Coin Detection and Recognition in the Natural Scene,” Proc. 2016 IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC) .653–657.
H. Anwar, S. Anwar, S. Zambanini, and F. Porikli, 2019. “CoinNet: Deep Ancient Roman Republican Coin Classification via Feature Fusion and Attention,” 1–34,
J. Kim and V. Pavlovic, 2016. “Discovering Characteristic Landmarks on Ancient Coins using Convolutional Networks,” Proc. - 23rd International Conference on Pattern Recognition (ICPR). 1595–1600,
I. Schlag and O. Arandjelovic, 2017. “Ancient Roman Coin Recognition in the Wild Using Deep Learning Based Recognition of Artistically Depicted Face Profiles.” 2898–2906
