Developing leading indicators from OHS management audit data: Determining the measurement properties of audit data from the field

OHS management audits are one means of obtaining data that may serve as leading indicators. The measurement properties of such data are therefore important. This study used data from Workwell audit program in Ontario, a Canadian province. The audit instrument consisted of 122 items related to 17 OHS...

Full description

Saved in:
Bibliographic Details
Published in:Journal of safety research Vol. 61; pp. 93 - 103
Main Authors: Robson, Lynda S., Ibrahim, Selahadin, Hogg-Johnson, Sheilah, Steenstra, Ivan A., Van Eerd, Dwayne, Amick, Benjamin C.
Format: Journal Article
Language:English
Published: United States Elsevier Ltd 01.06.2017
Elsevier Science Ltd
Subjects:
Audit
Audits
Canada
Consistency
Data processing
Decision analysis
Empirical analysis
Factor analysis
Factor Analysis, Statistical
Humans
Indicators
Leading indicator
Management
Management Audit - statistics & numerical data
Management audits
Management system
Middle Aged
Ontario
Performance measurement
Properties (attributes)
Regression analysis
Reproducibility of Results
Studies
Workers
Workers compensation
Workers' Compensation - statistics & numerical data
Workplace - statistics & numerical data
Audit
Leading indicator
Performance measurement
Management system
ISSN:0022-4375, 1879-1247, 1879-1247
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:OHS management audits are one means of obtaining data that may serve as leading indicators. The measurement properties of such data are therefore important. This study used data from Workwell audit program in Ontario, a Canadian province. The audit instrument consisted of 122 items related to 17 OHS management elements. The study sought answers regarding (a) the ability of audit-based scores to predict workers' compensation claims outcomes, (b) structural characteristics of the data in relation to the organization of the audit instrument, and (c) internal consistency of items within audit elements. The sample consisted of audit and claims data from 1240 unique firms that had completed one or two OHS management audits during 2007–2010. Predictors derived from the audit results were used in multivariable negative binomial regression modeling of workers' compensation claims outcomes. Confirmatory factor analyses were used to examine the instrument's structural characteristics. Kuder–Richardson coefficients of internal consistency were calculated for each audit element. The ability of audit scores to predict subsequent claims data could not be established. Factor analysis supported the audit instrument's element-based structure. KR-20 values were high (≥0.83). The Workwell audit data display structural validity and high internal consistency, but not, to date, construct validity, since the audit scores are generally not predictive of subsequent firm claim experience. Audit scores should not be treated as leading indicators of workplace OHS performance without supporting empirical data. Analyses of the measurement properties of audit data can inform decisionmakers about the operation of an audit program, possible future directions in audit instrument development, and the appropriate use of audit data. In particular, decision-makers should be cautious in their use of audit scores as leading indicators, in the absence of supporting empirical data. •OHS management audit scores may serve as a measure of workplace OHS performance.•Measurement properties of data from an auditing program were explored.•Audit data displayed structural validity and high internal consistency.•Audit data were generally not predictive of later firm workers' compensation claims.•Decision-makers should be cautious in their use of audit scores as leading indicators.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
ISSN:0022-4375
1879-1247
1879-1247
DOI:10.1016/j.jsr.2017.02.008