DESIGN OF THE USABILITY MEASUREMENT TOOL FOR MULTIMODAL MOBILE APPLICATIONS
DOI:
https://doi.org/10.11113/jt.v77.6810Keywords:
Usability tool, usability evaluation, multi-modality, mobile AppsAbstract
Nowadays, mobile phones provide not just voice call and messaging services, but plethora of other services. Those computational capabilities allow mobile phones to serve people in various areas including education, banking, commerce, travelling, and other daily life aspects. Meanwhile, the number of mobile phone users has increased dramatically in the last decade. On the other hand, the usability of an application can usually be verified through the user interface. Therefore, this paper aims to design a measurement tool to evaluate the usability of mobile applications based on the usability attributes and dimensions that must be considered in the interface. To obtain the appropriate attributes, a Systematic Literature Review (SLR) has been conducted and the Goal Question Metric (GQM) has been used to design the tool. From 261 related works only 18 most relevant ones were selected, through four SLR. 25 dimensions were found through the SLR, but some of these dimensions are synonymous or a part of other dimensions. Consequently, three dimensions must be included in any usability evaluation instrument, which is broken down into ten sub dimensions.
References
Rosnita, B., Dalbir, S. and Rozilawati, R., 2013. Usability Dimensions for Mobile Applications-A Review. Research Journal of Applied Sciences. 5(6): 2225-2231.
Stacy, K. C., Jaffe, J., Boggs, R., and Stephen, D. D. 2011. Worldwide Mobile Worker Population 2011–2015 Forecast. [Online]. From: http://cdn.idc.asia/files/5a8911ab-4c6d-47b3-8a04-01147c3ce06d.pdf. [Accessed on 09 April 2015].
Aram, S., Troiano, A., and Pasero, E. 2012. Environment Sensing Using Smartphone. Sensors Applications Symposium (SAS). Brescia, Italy. 7-9 February 2012. 1-4.
Nusca, A. 2009. Smartphone vs. Feature Phone Arms Race Heats Up; Which Did you Buy? [Online]. From: http:// www.zdnet.com/blog/gadgetreviews/smartphone-vs-feature-phone-arms-race-heats-up-which-did-you-buy/6836. [Accessed on 08 April 2015].
Charlesworth, A. 2009. The Ascent of Smartphone. Engineering & Technology. 4(3): 32-33.
Istepanian, R., Laxminarayan, S., & Pattichis, C. S. 2006. M-health: Emerging Mobile Health Systems. 1st edtion. New Jersey, USA: Springer.
Brown, B. and Chalmers, M. 2003. Tourism and Mobile Technology. 8th European Conference on Computer Supported Cooperative Work (ECSCW) 2003. Helsinki, Finland. 14–18 September 2003. 335-354.
Ally, M. 2009. Mobile Learning: Transforming the Delivery of Education and Training. 1st edtion. Athabasca: Au Press.
Lane, N. D., Miluzzo, E., Lu, H., Peebles, D., Choudhury, T., and Campbell, A. T. 2010. A Survey of Mobile Phone Sensing. Communications Magazine, IEEE. 48(9): 140-150.
Chan, F. T., and Chan, H. K. 2008. A Survey on Reverse Logistics System of Mobile Phone Industry in Hong Kong. Management Decision. 46(5): 702-708.
Hasegawa, S., Sato, K., Matsunuma, S., Miyao, M., and Okamoto, K. 2005. Multilingual Disaster Information System: Information Delivery Using Graphic Text for Mobile Phones. AI & SOCIETY. 19(3): 265-278.
Monares, Ã., Ochoa, S. F., Pino, J. A., Herskovic, V., Rodriguez-Covili, J., and Neyem, A. 2011. Mobile Computing in Urban Emergency Situations: Improving the Support to Firefighters in the Field. Expert Systems With Applications. 38(2): 1255-1267.
Singhal, M. and Shukla, A. 2012. Implementation of Location based Services in Android using GPS and Web Services. IJCSI International Journal of Computer Science Issues. 9(1): 237-242.
Bertoa, M. F., Troya, J. M., and Vallecillo, A. 2006. Measuring the Usability of Software Components. Journal of Systems and Software. 79(3): 427-439.
Sears, A. 1995. AIDE: A Step Toward Metric-Based Interface Development Tools. The 8th Annual ACM Symposium On User Interface And Software Technology. Pittsburgh, Pennsylvania, United States. 15 -17 November 1995. 101-110.
Macleod, M., Bowden, R., Bevan, N., and Curson, I. 1997. The MUSiC Performance Measurement Method. Behaviour & Information Technology. 16(4-5): 279-293.
Macleod, M. and Rengger, R. 1993. The Development of DRUM: A Software Tool for Video-Assisted Usability Evaluation. In J. L. Alty, and D. Diaper (ed.). People and Computers. Cambridge, UK: Cambridge University Press.
Juristo, N., Windl, H., and Constantine, L. 2001. Guest Editors' Introduction: Introducing Usability. IEEE Software. 18(1): 20-21.
Abran, A., Khelifi, A., Suryn, W., and Seffah, A. 2003. Usability Meanings and Interpretations in ISO Standards. Software Quality Journal. 11(4): 325-338.
DIN, E. 1998. 9241-11. Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs)–Part 11: Guidance on usability. The International Organization for Standardization.
Roda, C., Borel, A. M., Gentchev, E., and Thomas, J. 2005. Digital Image Library Development in Academic Environment: Designing and Testing Usability. OCLC Systems & Services. 21(4): 264-284.
Jordan, P. W. 1998. An Introduction to Usability. 1st edtion. Gunpowder Square, Londin, UK: Taylor & Francis Ltd.
Shneiderman, B., Plaisant, C., Cohen, M., and Jacobs, S. 2010. Designing the User Interface: Strategies for Effective Human-Computer Interaction. 5th edtion. Boston, USA: Pearson Addison Wesley.
Sauro, J. and Kindlund, E. 2005. A Method to Standardize Usability Metrics into a Single Score. The SIGCHI conference on Human Factors In Computing Systems. Oregon, US. 5-7 April 2005. 401-409.
Biel, B., Grill, T. and Gruhn, V. 2010. Exploring the Benefits of the Combination of a Software Architecture Analysis and a Usability Evaluation of a Mobile Application. Journal of Systems and Software. 83(11): 2031-2044.
Nayebi, F., Desharnais, J.-M., and Abran, A. 2012. The State Of The Art of Mobile Application Usability Evaluation. 25th IEEE Canadian Conference on Electrical & Computer Engineering (CCECE). Montreal, QC, Canada. 29 April-2 May 2012. 1-4.
Coursaris, C. K., & Kim, D. 2006. A Qualitative Review of Empirical Mobile Usability Studies. The 12th Americas Conference on Information Systems (AMCIS).Acapulco, Mexico. 4-6 August 2006. 2884-2897.
Coursaris, C. K., & Kim, D. 2011. A Meta-Analytical Review of Empirical Mobile Usability Studies. Journal of usability studies. 6(3): 117-171.
Simes-Ma, M. and Nunes, I. 2012. Usability of Interfaces. In Isabel L. Nunes (ed.). Ergonomics-A Systems Approach Rijeka, Croatia: InTech.
Treeratanapon, T. 2012. Design of the Usability Measurement Framework for Mobile Applications. The 15th international Conference on Computer and Information Technology (ICCIT). Chittagong, Bangladesh. 20-23 December 2012. 16-17.
Kitchenham, B. 2004. Procedures for Performing Systematic Reviews (Vol. 33, pp. 1-33): Keele, UK, Keele University.
Navas-Acien, A. 2015. Systematic Reviews and Meta-Analyses: The Road from Medicine to Environmental Health. AAAS Annual Meeting. San Jose, CA, USA. 12-16 February 2015.
Nguyen-Duc, A., Cruzes, D. S., and Conradi, R. 2015. The Impact of Global Dispersion on Coordination, Team Performance and Software Quality–A Systematic Literature Review. Information and Software Technology. 57(1): 277-294.
Shojania, K. G., Sampson, M., Ansari, M. T., Ji, J., Doucette, S., & Moher, D. 2007. How Quickly Do Systematic Reviews Go Out Of Date? A Survival Analysis. Annals of Internal Medicine. 147(4): 224-233.
Hussain, A., & Kutar, M. 2012. Usability Evaluation of SatNav Application on Mobile Phone Using mGQM. International Journal of Computer Information Systems and Industrial Management Applications. 4(2012): 92-100.
Mohammadi, H. 2015. A Study of Mobile Banking Loyalty in Iran. Computers in Human Behavior. 44(3): 35-47.
Molina, A. I., Redondo, M. A., Lacave, C., & Ortega, M. 2014. Assessing the Effectiveness of New Devices for Accessing Learning Materials: An Empirical Analysis Based on Eye Tracking and Learner Subjective Perception. Computers in Human Behavior. 31(2): 475-490.
Negahban, A. and Chung, C.-H. 2014. Discovering Determinants of Users Perception of Mobile Device Functionality Fit. Computers in Human Behavior. 35(6): 75-84.
Shuib, L., Shamshirband, S., and Ismail, M. H. 2015. A Review of Mobile Pervasive Learning: Applications and Issues. Computers in Human Behavior. 46(5): 239-244.
Salazar, L. H. A., Lacerda, T., Nunes, J. V., and von Wangenheim, C. G. 2013. A Systematic Literature Review on Usability Heuristics for Mobile Phones. International Journal of Mobile Human Computer Interaction (IJMHCI). 5(2): 50-61.
Motamedi S.and Choe, P. 2015. Smartphone Information Displays When Reading News in Persian and English Languages. International Journal of Human-Computer Interaction. 31(6): 427-439.
Youngblood, N. E. and Youngblood, S. A. 2013. User Experience and Accessibility: An Analysis of County Web Portals. Journal of Usability Studies. 9(1): 25-41.
Li, M., Arning, K., Sack, O., Park, J., Kim, M.-H., Ziefle, M., and Kobbelt, L. 2013. Evaluation of a Mobile Projector-Based Indoor Navigation Interface. Interacting with Computers. 26(6): 1-19.
Choe, P. and Schumacher, D. 2015. Influence of Different Types of Vibrations on Technical Acceptance of a Mobile Game Aiming for Hedonic Satisfaction. International Journal of Human-Computer Interaction. 31(1): 33-43.
Silvennoinen, J., Vogel, M., and Kujala, S. 2014. Experiencing Visual Usability and Aesthetics in Two Mobile Application Contexts. Journal of Usability Studies. 10(1): 46-62.
Weiss, D. M. and Basili, V. R. 1985. Evaluating software development by analysis of changes: Some data from the software engineering laboratory. IEEE Transactions on Software Engineering. 11(2): 157-168.
Chin, J. P., Diehl, V. A., & Norman, K. L. 1988. Development of an Instrument Measuring User Satisfaction of the Human-Computer Interface. The SIGCHI conference on Human factors in computing systems. Washington, DC, USA. 15-19 June 1988. 213-218.
Davis, F. D. 1989. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS quarterly. 13(3): 319-340.
Lewis, J. R. 1995. IBM Computer Usability Satisfaction Questionnaires: Psychometric Evaluation and Instructions for Use. International Journal of Human-Computer Interaction. 7(1): 57-78.
Kirakowski, J. 1996. The Software Usability Measurement Inventory: Background and Usage. In P. W. Jordan, B. Thomas, I. L. McClelland and B. Weerdmeester (ed.). Usability Evaluation In Industry. London, UK: Taylor &Francis Ltd.
Lin, H. X., Choong, Y.-Y., and Salvendy, G. 1997. A Proposed Index of Usability: A Method for Comparing the Relative Usability of Different Software Systems. Behaviour & Information Technology. 16(4-5): 267-277.
Lund, A. M. 2001. Measuring Usability with the USE Questionnaire. Usability interface. 8(2): 3-6.
Szuc, D. 2002. Mobility and Usability. [Oline]. From: http:// apogeehk.com/archives/mobility-and-usability/. [Accessed on 23 July 2015].
Ryu, Y. S. 2005. Development of Usability Questionnaires for Electronic Mobile Products and Decision Making Methods. Ph.D Thesis, Industrial and Systems Engineering, Faculty of Virginia Polytechnic Institute and State University. Virginia, United States.
Downloads
Published
Issue
Section
License
Copyright of articles that appear in Jurnal Teknologi belongs exclusively to Penerbit Universiti Teknologi Malaysia (Penerbit UTM Press). This copyright covers the rights to reproduce the article, including reprints, electronic reproductions, or any other reproductions of similar nature.
