ANALYZING THE SCOPE OF INTEGRATING ELECTRONIC MEDICAL RECORDS (EMR) AND ELECTRONIC HEALTH RECORDS (EHR) WITH MULTIMODAL HUMAN COMPUTER INTERACTION (MMHCI)
DOI:
https://doi.org/10.11113/jt.v78.5571Keywords:
Multimodal interaction, clinical data, interfaces, modality fission, fusion, context management, dialog managementAbstract
Developing applications using Multi Modal Human Computer Interaction (MMHCI) remains a great challenge due to the advancement of technologies. Enhanced interaction applications and tools employed in medical records will help to improve the quality of patients’ healthcare and it opens a variety of research challenges. Replacing a difficult system to store complex data related to medical history of patients through Electronic Medical Records (EMR)/Electronic Health Records (EHR) would offer several advantages that include confidentiality and patient details reliability along with the mechanisms for quick and flexible retrieval of data/information. The task of designing MMHCI applications for real time environment for EMR/EHR is thus complex. As the inputs to medical systems are heterogeneous, the associated issues grow up with the need for new system since the existing frameworks have many gaps and drawbacks. This paper attempts to discuss the possible guidelines, standards, tools and techniques involved in integrating MMHCI with EMR/EHR.
References
Bouchet, J., Nigay, L., Ganille, T. 2004. ICARE Software Components for Rapidly Developing Multimodal Interfaces. Conference Proceedings of ICMI'2004. State College, Pennsylvania, USA, ACM Press. October 2004: 251-258.
Chen, W. and Shih, C. C. 2012. Architecture Of Portable Electronic Medical Records System Integrated With Streaming Media. Journal of Medical Systems. 36(1): 25-31.
Cohen, P. R., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L., Clow, J. 1997. QuickSet: Multimodal Interaction For Distributed Applications. Proceedings of the Fifth ACM international Conference on Multimedia. Seattle, USA. Nov 09-13, 1997: 31-40.
D. Lalanne, L. Nigay, P. Palanque, P. Robinson, and J. Vanderdonckt. 2009. Fusion Engines for Multimodal Input: A Survey. Proceedings of International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction [ICMI-MLMI 2009], Cambridge, MA, USA. Nov 02-06:2009: 153-160.
Flippo, F., Krebs, A. Marsic I. 2003. A Framework for Rapid Development of Multimodal Interfaces. Proceedings of ICMI'03, 5th International Conference on Multimodal Interfaces. Vancouver. British Columbia. Canda. Nov. 5-7, 2003: 109-116.
Jie Shen, Maja Pantic. 2009. A Software Framework for Multimodal Human Computer Interaction Systems. Proceedings of the 2009 IEEE International Conference on Systems, Man and Cybernetics. SMC2009. San Antonio, USA. Oct 11-14, 2009: 2038-2045.
Karl A Stroetmann, Michael Pieper and Veli N Stroetmann. 2003. Understanding Patients: Participatory Approaches for the User Evaluation of Vital Data Presentation. Proceedings of 2003 Conference on Universal Usability. CUU ’03. Nov 10-11: 93-97
Krahnstoever, N., Kettebekov, S., Yeasin, M. Sharma, R. 2002. A Real-Time Framework For Natural Multimodal Interaction With Large Screen Displays. ICMI’02 Proceedings of 4th IEEE International Conference on Multimodal Interfaces. Pittsburgh, USA. Oct 14, 2002: 349.
Krist, A.H. and Woolf, S.H. 2011. A Vision For Patient-Centered Health Information Systems. The Journal Of The American Medical Association. 305(3): 300-301.
M. Schneider-hufschmidt, L. Groh, P. Perrin, N. Hine, U. Dundee, and S. Furner. 2001. Human Factors Guidelines For Multimodal Interaction, Communication And Navigation. The Employment Situation Of People With Disabilities In The European Union (2001) DG Employment and Social Affairs, Brussels. 1: 2-5.
Norman, D. A. 1998. The Design of Everyday Things. New York. Basic Books. ISBN: 9780262640374. Chapter 4.
N. Sebe, 2009. Multimodal interfaces: Challenges and perspectives. Journal of Ambient Intelligence and Smart Environments. 1(1): 23-30.
N. B. Sarter. 2006. Multimodal Information Presentation: Design Guidance And Research Challenges. International Journal of Industrial Ergonomics. 36(5): 439-445.
Oviatt, S. L. 2003. Advances in Robust Multimodal Interface Design. IEEE Computer Graphics and Applications. 23(5): 62-68.
Oviatt, S. L., Cohen, P. R., Wu, L., Vergo, J., Duncan, L., Suhm, B., Bers, J., Holzman, T., Winograd, T., Landay, J., Larson, J., Ferro, D. 2000. Designing The User Interface For Multimodal Speech And Gesture Applications: State-Of-The-Art Systems And Research Directions. Journal on Human Computer Interaction. 15(4): 263-322.
I. Poggi and F. D’Errico. 2009. Social Signals And The Action – Cognition Loop. The Case Of Overhelp And Evaluation. IEEE International Conference on Affective Computing and Intelligent Interaction. 2009: 1-8.
V. Charissis, B.M. Ward, M. Naef, D. Rowley, L. Brady and P. Anderson. 2008. An Enquiry into VR Interface Design for Medical Training: VR Augmented Anatomy Tutorials for Breast Cancer. The Proceedings of SPIE-IS&T Electronic Imaging. SPIE Vol, 6804: 680404.
Michael Bodell, Michael Johnson, Sunil Kumar, Stephen Potter and Keith Waters. 2003. W3C Multimodal Interaction Framework [Online]. From http://www.w3.org/TR/mmi-framework. [Accessed on 08-Oct-2014].
Zeljko Obrenovic, Dusan Starcevic. 2004. Modeling Multimodal Human Computer Interaction. Journal Computer. 37(9): 65-72.
Downloads
Published
Issue
Section
License
Copyright of articles that appear in Jurnal Teknologi belongs exclusively to Penerbit Universiti Teknologi Malaysia (Penerbit UTM Press). This copyright covers the rights to reproduce the article, including reprints, electronic reproductions, or any other reproductions of similar nature.
