• Azham Hussain School of Computing, Universiti Utara Malaysia, 06010 UUM Sintok. Kedah, Malaysia.
  • Abdulkarim Saleh School of Computing, Universiti Utara Malaysia, 06010 UUM Sintok. Kedah, Malaysia.
  • Abdussalam Taher School of Computing, Universiti Utara Malaysia, 06010 UUM Sintok. Kedah, Malaysia.
  • Imman Ahmed School of Computing, Universiti Utara Malaysia, 06010 UUM Sintok. Kedah, Malaysia.
  • Mohammed Lammasha School of Computing, Universiti Utara Malaysia, 06010 UUM Sintok. Kedah, Malaysia.



M-learning, usability evaluation, agile development process.


The use of mobile phones for academic purpose has been on the rise in recent years. Most m-learning applications have been proved that they did not undergo usability evaluation while a few of the application underwent reliable usability evaluations. This paper reviews previous research that has been carried out to evaluate the usability of m-learning applications and how this approach could be integrated into the Agile development process in a bid to make a more effective and usable m-learning application. We focus on previous works that has been done in both, mobile application usability and integration of agile approaches for Usability evaluation. The incorporation of agile development processes and the usability evaluation of m-learning applications has produced a significant impact. This is seen as more m-learning applications are done in the sprints with the usability evaluation preceding it and following the development process which makes the applications more usable and user friendly.


A. M. Kaplan and M. Haenlein. 2010. “Users of the world, unite! The challenges and opportunities of Social Media,â€. Bus. Horiz. 53: 59–68.

C. X. N. Cota, A. I. M. Díaz, and M. Ã. R. Duque. 2014. “Developing a Framework to Evaluate Usability in m-Learning Systems: Mapping Study and Proposal,†Proc. Second Int. Conf. Technol. Ecosyst. Enhancing Multicult. . ACM. 357–364.

F. Lettner and C. Holzmann. 2012. “Automated and unsupervised user interaction logging as basis for usability evaluation of mobile applications,†Proc. 10th Int. Conf. Adv. Mob. Comput. Multimed. - MoMM ’12. 118.

F. T. W. Au, S. Baker, I. Warren, and G. Dobbie. 2008. “Automated Usability Testing Framework,†Australas. User Interface Conf. 76(January): 55–64.

A. Hussain, Abbas, S. A. A., Abdulwaheed, M. S., Mohammed, R. G., & Abdulhussein, A. A. 2015. "Usability Evaluation of Mobile Game Applications: A Systematic Review". International Journal of Computer and Information Technology. 4(3).

C. Ardito, M. F. Costabile, M. De Marsico, R. Lanzilotti, S. Levialdi, T. Roselli, and V. Rossano, 2006. “An approach to usability evaluation of e-learning applications,†Univers. Access Inf. Soc. 4: 270–283.

D. Jadhav, G. Bhutkar, and V. Mehta. 2013. “Usability evaluation of messenger applications for Android phones using cognitive walkthrough,†Proc. 11th Asia Pacific Conf. Comput. Hum. Interact. - APCHI ’13. 9–18

D. A. Norman and J. Nielsen. 2010. “Gestural Interfaces: A Step Backward In Usability,†interactions.. 46–49.

D. Norman. 1993. “Things That Make Us Smart: Defending Human Attributes in the Machine Age,†Addison-Wesley, 43–76.

C. O’Malley, G. Vavoula, J. P. Glew, J. Taylor, M. Sharples, P. Lefrere, P. Lonsdale, L. Naismith, and J. Waycott. 2005. “Guidelines for Learning/Teaching/Tutoring in a Mobile Environment.,†MOBIlearn [UoN, UoB, OUF] WP4.

H. Crompton. 2013. “A historical overview of mobile learning: Toward learner-centered education. In Handbook of mobile learning,â€. 3–14.

U. N. E. S. and Cultural and Organization, 2013. “The Future of mobile Learning: Implications for Policy Markers and Planners,â€

W. Siu Keung, T. Thi Nguyen, E. Chang, and N. Jayaratna. 2003 “Usability Metrics for E-learning,†in On The Move to Meaningful Internet Systems 2003: OTM 2003 Workshops. Springer Berlin Heidelberg. 235–252.

C. Ardito, M. De Marsico, R. Lanzilotti, S. Levialdi, T. Roselli, V. Rossano, M. Tersigni, I. Università , and L. Sapienza. 2004. “Usability of E-Learning Tools,†Ai ’04. 80–84.

I. of E. and E. Engineers. 1990. “Dictionary: A Compilation of IEEE Standard Computer Glossaries. New York, NY,â€

J. Rubin and D. Chisnell. 2008. Handbook of usability testing: how to plan, design and conduct effective tests. John Wiley & Sons.

J. Nielsen. 2012. “Usability 101: Introduction to Usability. Online article.â€

A. Alsumait and A. Al-Osaimi, 2010. “Usability Heuristics Evaluation for Child E- learning Applications,†Comput. Eng. 5: 654–661,.

D. Kane, “Finding a place for discount usability engineering in agile development: throwing down the gauntlet.,†in Agile Development Conference, 2003, pp. 40–46.

O. Sohaib and K. Khan, 2010. “Integrating usability engineering and agile software development: A literature review,†Comput. Des. Appl. (ICCDA 2: V2–32–V2–38

T. S. Da Silva, A. Martin, F. Maurer, and M. Silveira, 2011. “User-centered design and agile methods: A systematic review,†Proc. - 2011 Agil. Conf. Agil. 2011. 77–86

P. McInerney and F. Maurer, 2005. “UCD in agile projects,†Interactions.12: 19–23.

S. Keele. 2007. “Guidelines for performing systematic literature reviews in software engineering Technical report, EBSE Technical Report EBSE-2007-01.,â€

J. Scholtz, “Usability Evaluation,†2006. [Online]. Available:

J. Nielsen. 2005. Medical usability: How to kill patients through bad design.

A. Kaikkonen, T. Kallio, A. Kekäläinen, A. Kankainen, and M. Cankar. 2005. “Usability testing of mobile applications: A comparison between laboratory and field testing,†J. Usability Stud. 1: 4–16,

S. R. Humayoun, Y. Dubinsky, T. Catarci, E. Nazarov, and A. Israel. 2012. “A model-based approach to ongoing product evaluation,†Proc. Int. Work. Conf. Adv. Vis. Interfaces - AVI ’12. 596.

J. C. Lee and J. C. Lee. 2006. “Embracing agile development of usable software systems,†Conf. Hum. Factors Comput. Syst. 1767–1770.

L. L. Constantine. 2002. “Process agility and software usability: Toward lightweight usage-centered design,†Inf. Age.1: 1–10.

E. Nelson, “Extreme programming vs. interaction design,†FTP Online, 2002. [Online]. Available:

T. Memmel, F. Gundelsweiler, and H. Reiterer. 2007. “Agile Human-Centered Software Engineering,†Proc. 21st Br. HCI Gr. Annu. Conf. People Comput. HCI...but not as we know it - .1:167–175.

D. Sy. 2007. “Adapting Usability Investigations for Agile User-Centered Design,†J. Usability Stud. 2(3): 112–132,

M. Najafi and L. Toyoshiba. 2008 “Two Case Studies of User Experience Design and Agile Development,†Agil. 2008 Conf. 531–536.




How to Cite

Hussain, A., Saleh, A., Taher, A., Ahmed, I., & Lammasha, M. (2015). USABILITY EVALUATION METHOD FOR MOBILE LEARNING APPLICATION USING AGILE: A SYSTEMATIC REVIEW. Jurnal Teknologi, 77(5).