THE INTER-RATER AND INTRA-RATER RELIABILITY ANALYSIS OF WORKPLACE ERGONOMIC RISK ASSESSMENT
DOI:
https://doi.org/10.11113/jt.v80.10285Keywords:
Ergonomics, observation tools, risk assessment, work-related musculoskeletal disordersAbstract
Observation tools have found wide application in ergonomic assessment of musculoskeletal disorders (MSD) because of their ease of use, ability to be used by multiple users with less specialised training and less operation time. However, their major challenge remains the reliability of their findings. Since MSD is a multidisciplinary problem, there is need for observation tools to be precise when used by practitioners from different professions. This study therefore, investigated the intra-rater and inter-rater reliability of workplace ergonomic risk assessment (WERA) observation tool. Thirteen ergonomics and safety stakeholders, from four different professions were trained and thereafter, independently asked to carry out risk assessment of ten different videos-captured work activities. WERA was used to evaluate the participants’ exposure to six physical risk factors of MSDs in six body regions, so as to determine their risk level. The assessment was repeated after two weeks. The interclass reliability analysis was carried out using the intraclass correlation coefficient (ICC) with the two-way mixed model and absolute agreement as the preferred types. Two of the tasks, tyre extraction and quay crane operation were rated as high risked with an exposure rating greater than 60%, while the remaining eight were medium-risked. The body regions with high probability of MSD exposure were the neck (70%), leg (60%), wrist (60%) and back (50%). Inter-rater reliability (ICC) of the activities by the professionals ranged between 0.97 and 0.99 while intra-rater reliability of the participants ranged between 0.81 and 1.0. The reliability analysis demonstrated consistency among the different professionals using WERA. Therefore,there is a need to urgently redesign the tasks and carry out ergonomic interventions in the work activities assessed.  Â
Â
References
Aziz, R. A., A. J. Adeyemi, A. Z. A. Kadir, J. M. Rohani, and M. R. Abdul Rani. 2015. Effect of Working Posture on Back Pain Occurrence Among Electronics Workers in Malaysia. Procedia Manufacturing, 2: 296-300.
Roman-liu, D. 2014. Comparison of Concepts in Easy-to-Use Methods for MSD risk assessment. Applied Ergonomics. 45 (3): 420-427.
Liberty Mutual Research Institute for Safety. 2011. Liberty Mutual Workplace Safety Index.
Gallagher, S. and M. C. Schall Jr. 2016. Musculoskeletal Disorders as a Fatigue Failure Process: Evidence, Implications And Research Needs. Ergonomics. DOI. 10.1080/00140139.2016.1208848.
Rohani, J. M., A. N. Nordin, N. Z. Abidin, R. M. Zain, and I. A. Rahman. Knowledge, Attitude and Practices of Musculosketal Injuries in Malaysian Industries Employer’s Perspective. Proceedings of the 4th Scientific Conference on Occupational Safety and Health (SciCOSH2016). Johor Bahru, Malaysia.
James, A. A., J. M. Rohani and M. R. A. Rani. 2012. Development of a Holistic Backpack-back Pain Model for School Children. Proceedings of Southeast Asian Network of Ergonomics Societies Conference (SEANES). 1-5.
NIOSH. 2014. Observation-based Posture Assessment: Review o Current Practice and Recommendations for Improvement.
Adeyemi, A. J., J. M. Rohani, and M. Abdul Rani. 2017. Backpack-back Pain Complexity and the Need for Multifactorial Safe Weight Recommendation. Applied Ergonomics. 58: 573-582.
Adeyemi, A. J., J. M. Rohani, and M. Abdul Rani. 2014. Back Pain Arising from Schoolbag Usage Among Primary Schoolchildren. International Journal of Industrial Ergonomics. 44(4): 590-600.
Rahman, M. R. A. M. N. Abdol Rani and J. M. Rohani. 2011. Investigation of Work-related Musculoskeletal Disorders Among Workers in Wall Plastering Job At Construction Industry. Work: A Journal of Prevention, Assessment and Rehabilitation. 43(4): 507-514.
Dockrell, S., E. O’Grady, K. Bennett, C. Mullarkey, R. Mc Connell, R. Ruddy, S. Twomey, and C. Flannery. 2012. An Investigation of the reliability of Rapid Upper Limb Assessment (RULA) as A Method of Assessment Of Children’s Computing Posture. Appied Ergonomics. 43(3): 632-636.
Gallagher, S. and J. R. Heberger. 2012. Examining the Interaction of Force and Repetition on Musculoskeletal Disorder Risk: A Systematic Literature Review. Human Factors: The Journal of the Human Factors and Ergonomics Society. 55(1): 108-124.
Kee, D. and I. Lee. 2012. Relationships between Subjective and Objective Measures in Assessing Postural Stresses. Applied Ergonomics. 43(2): 277-82.
Coenen, P., I. Kingma, C. R. L. Boot, P. M. Bongers, and J. H. van Dieën. 2013. Inter-rater Reliability of a Video-Analysis Method Measuring Low-back Load in a Field Situation. Appied Ergonomics. 44(5): 828-34.
Takala, E.-P., I. Pehkonen, M. Forsman, G.-Å. Hansson, S. E. Mathiassen, W. P. Neumann, G. Sjøgaard, K. B. Veiersted, R. H. Westgaard, and J. Winkel. 2010. Systematic Evaluation of Observational Methods Assessing Biomechanical Exposures at Work. Scandinavian Journal of Work, Environment and Health. 36(1): 3-24.
Spallek, M., W. Kuhn, S. Uibel, A. Van Mark, and D. Quarcoo. 2010. Work-related Musculoskeletal Disorders in the Automotive Industry Due to Repetitive Work-Implications For Rehabilitation. Journal of Occupational Medicine and Toxicology. 5: 6.
Neumann, W. P., R. P. Wells, R. W. Norman, D. M. Andrews, J. Frank, H. S. Shannon, and M. S. Kerr. 1999. Comparison of Four Peak Spinal Loading Exposure Measurement Methods and Their Association With Low-back Pain. Scandinavian Journal of Work, Environment and Heath. 25(5): 404-409.
Norman, R., R. Wells, P. Neumann, J. Frank, H. Shannon, M. Kerr, and T. Study. 1998. A Comparison of Peak Vs Cumulative Physical Work Exposure Risk Factors for the Reporting of Low Back Pain in the Automotive Industry. Clinical Biomechanics. 13(8): 561-573.
Graham, R. B., M. J. Agnew, and J. M. Stevenson. 2009. Effectiveness of an On-body Lifting Aid at Reducing Low Back Physical Demands During an Automotive Assembly Task: Assessment of EMG Response and User Acceptability. Appied Ergonomics. 40(5): 936-942.
Burdorf, A. and H. Zondervan. 1990. An Epidemiological Study of Low-back Pain in Crane Operators. Ergonomics. (33): 981-987.
Abbe, O. O., C. M. Harvey, L. H. Ikuma, and F. Aghazadeh. 2011. Modeling the Relationship Between Occupational Stressors, Psychosocial/Physical Symptoms and Injuries in the Construction Industry. International Journal of Industrial Ergonomics. 41(2): 106-117.
Krishna, O. B., J. Maiti, and P. K. Ray. 2015. Assessment of Risk of Musculoskeletal Disorders among Crane Operators in a Steel Plant: A Data Mining–based Analysis. Human Factors and Ergonomics in Manufacturing and Service Industries. 25(5): 559-572.
Downloads
Published
Issue
Section
License
Copyright of articles that appear in Jurnal Teknologi belongs exclusively to Penerbit Universiti Teknologi Malaysia (Penerbit UTM Press). This copyright covers the rights to reproduce the article, including reprints, electronic reproductions, or any other reproductions of similar nature.
