Risk assessments and Safety Management in Workplaces

1. Abstract

The Risk assessments and Safety Management in Workplaces questionnaire is a specialized organizational psychometric instrument developed by Dr. Tapani Niskanen and colleagues (Niskanen et al., 2012) to evaluate the systematic implementation, practical execution, and organizational effectiveness of European Council Directives regarding occupational safety and health (OSH)—most notably Council Directive 89/391/EEC. Designed for parallel administration across organizational hierarchies, including both employers (senior executives, plant managers, and safety directors) and workers (shop-floor personnel, safety representatives, and technical operators), the survey captures critical micro- and macro-level safety processes within industrial, manufacturing, and service environments.

The scale encompasses multiple thematic dimensions: statutory familiarity with European and national OSH legislative frameworks; perceived organizational fulfillment of baseline prerequisites for safe and healthy labor; structural integration of proactive safety management systems (SMS); systemic execution and technical thoroughness of workplace risk assessments; utilization of assessment outcomes for technical and behavioral risk mitigation; formalized documentation protocols; and concrete organizational modifications implemented as a direct consequence of hazard evaluations. Psychometric validation across representative cohorts of small, medium-sized, and large enterprises demonstrates robust structural validity, high internal consistency reliability across sub-dimensions (Cronbach’s alpha coefficients typically ranging between α = .78 and α = .92), and strong discriminant capacity distinguishing proactive high-compliance safety cultures from reactive, low-compliance enterprises. The tool provides occupational health psychologists, industrial sociologists, and regulatory inspectors with a standardized framework for diagnostic safety auditing, policy efficacy tracking, and intervention modeling.

2. Keywords

Occupational Safety and Health, Risk Assessment, Safety Management Systems, OSH Framework Directive, Council Directive 89/391/EEC, Safety Culture, Organizational Compliance, Hazard Identification, Safety Climate, Ergonomics, Industrial Hygiene, Preventive Measures

3. Authors

The scale was developed and empirically validated by a multidisciplinary team of occupational safety researchers and regulatory specialists:

• Tapani Niskanen, Ph.D. — Ministry of Social Affairs and Health, Department for Occupational Safety and Health, Tampere / Helsinki, Finland; also affiliated with the Finnish Institute of Occupational Health (FIOH) and the University of Eastern Finland. Primary research focus: safety management systems, legislative evaluation, industrial safety ergonomics, and economic evaluations of occupational health interventions.
• Pekka Naumanen, Ph.D. — Finnish Institute of Occupational Health (FIOH), Kuopio/Helsinki, Finland. Specialization: occupational sociology, workplace health promotion, and longitudinal interventions in industrial settings.
• Marja-Leena Hirvonen, M.Sc. — Finnish Institute of Occupational Health (FIOH), Helsinki, Finland. Specialization: statistical methodologies in occupational health research, survey design, and workplace accident epidemiology.

4. Purpose

The primary purpose of the Risk assessments and Safety Management in Workplaces instrument is to quantify and evaluate how European Union regulatory doctrines on occupational safety are translated into operational reality across industrial workplaces. Adopted in 1989, Council Directive 89/391/EEC (often termed the “Framework Directive”) introduced explicit legal requirements compelling employers to execute continuous, proactive workplace hazard evaluations, formulate documented safety plans, designate competent protective personnel, and actively consult workforces regarding preventive interventions. Despite formal legal transposition across EU Member States, wide disparities persisted between statutory compliance “on paper” and operational safety efficacy “in practice.” Dr. Tapani Niskanen and his team developed this questionnaire to bridge this empirical gap by measuring the subjective perceptions, managerial attitudes, procedural regularities, and behavioral manifestations that define real-world safety governance.

From an applied organizational perspective, the instrument serves dual diagnostic and benchmarking functions. In research contexts, it enables occupational ergonomists, organizational psychologists, and public health scholars to model structural equations linking legislative mandates to organizational safety climates, safety compliance behaviors, and actual objective accident/injury indices. In occupational and clinical practice, safety engineers and occupational physicians utilize the survey to diagnose hidden deficits in hazard communication, managerial accountability, and worker engagement before catastrophic system breakdowns or cumulative musculoskeletal/psychosocial injuries occur. Importantly, by presenting paired comparative metrics across managerial and employee cohorts, the scale illuminates organizational perceptual gaps—situations where leadership overestimates statutory compliance and environmental safety while front-line labor experiences pervasive hazard exposure and unaddressed operational risks.

5. Psychological Construct

The questionnaire captures the multifaceted construct of systemic workplace safety management and risk assessment maturity. Rather than viewing safety as a mere absence of accidents, the scale conceptualizes workplace safety as a dynamic, sociotechnical organizational process underpinned by several distinct but interrelated psychological and behavioral sub-constructs:

• Statutory Awareness and Legislative Knowledge: This dimension measures the cognitive acquisition and comprehension of legal OSH mandates among both managerial decision-makers and shop-floor workers. It gauges familiarity with European Framework Directives, domestic enforcement codes, and individual statutory rights and obligations regarding workplace safety.
• Safety Prerequisites and Work Environment Adequacy: Evaluates organizational perceptions regarding whether baseline physical, psychological, and ergonomic resources are sufficiently maintained. This incorporates perceptions of physical workspace adequacy, ergonomic workstations, structural ventilation, machine safeguarding, personal protective equipment (PPE) availability, and manageable cognitive workloads.
• Integration of Safety Management Systems (SMS): Measures the operationalization of leadership commitment, formal safety policies, continuous safety training, communication loops, and resource allocation. This dimension captures the psychological climate of organizational priority—whether safety is genuinely prioritized over operational speed, production quotas, and immediate cost minimization.
• Hazard Identification and Risk Assessment Rigor: Assesses the methodological comprehensiveness with which potential physical, chemical, biological, ergonomic, and psychosocial hazards are identified, classified, and analyzed within the workplace. It evaluates whether assessments rely on ad-hoc supervisory intuition or structured, evidence-based ergonomic auditing instruments.
• Worker Participation and Participatory Ergonomics: Measures the psychological and structural climate surrounding employee voice, consultation, and empowerment. Under Directive 89/391/EEC, workers must not be passive recipients of safety rules; this construct quantifies whether shop-floor workers are actively consulted during hazard identification and the formulation of preventive measures.
• Documentation Protocols and Action Continuity: Captures the systematic formalization of safety findings, tracking whether assessed risks are documented, assigned responsible owners, paired with explicit remediation timelines, and monitored via iterative administrative reviews.
• Remediation Implementation and Safety Change: Evaluates the tangible, observable organizational changes precipitated by risk assessments—including engineering modifications, work redesign, administrative rescheduling, and training overhauls.

6. Theoretical Framework

The theoretical architecture of the questionnaire synthesizes core paradigms from systems engineering, occupational psychology, and regulatory governance:

First, the instrument is anchored in James Reason’s Swiss Cheese Model of organizational accidents and the broader sociotechnical systems theory developed by Trist, Bamforth, and Rasmussen. In sociotechnical systems theory, workplace safety cannot be understood merely as an individual psychological trait (e.g., worker carelessness or compliance), but emerges from complex interactions between institutional policy, managerial structures, supervisory behaviors, and technical apparatuses. The scale treats the European OSH Directives as top-down structural inputs that filter through organizational subsystems (safety management, communication pathways, technical inspections) down to front-line worker environments. Latent failures within managerial commitment or documentation protocols create alignment windows through which occupational accidents occur.

Second, the scale incorporates Dov Zohar’s seminal framework of Safety Climate (Zohar, 1980, 2010). Safety climate is defined as shared perceptions among employees concerning the policies, procedures, and practices that are rewarded, supported, and expected in an organization regarding safety. When management asserts high safety standards verbally but penalizes production pauses necessary for safety compliance, a dissonant safety climate develops. Niskanen and colleagues operationalized this dynamic by gathering parallel data from managers and workers, enabling empirical assessment of perceptual convergence or divergence across the organizational hierarchy.

Third, the tool draws upon the principles of Participatory Ergonomics (Noro & Imada, 1991). This theory posits that workplace interventions achieve significantly greater technical efficacy, worker acceptance, and behavioral adherence when front-line personnel actively participate in the diagnostic evaluation and redesign of their tasks. The scale explicitly operationalizes worker engagement during each phase of the risk assessment lifecycle as a direct predictor of successful preventive interventions.

7. Validity

The psychometric validity of the instrument was rigorously investigated during large-scale empirical field evaluations in Finland and throughout comparative European cross-sectional samples (Niskanen et al., 2012):

• Content Validity: Content development was guided by a structured expert consensus panel consisting of senior labor inspectors, occupational health physicians, industrial hygienists, and social partner representatives (trade unions and employer confederations). Items were directly derived from explicit statutory articles of Council Directive 89/391/EEC and the European Commission’s non-binding guide to risk assessment at work, ensuring exhaustive coverage of legal and operational domains.
• Construct and Discriminant Validity: Known-group comparison analyses demonstrated substantial construct validity. The scale reliably discriminated between organizations across enterprise sizes: micro and small enterprises (<50 employees) scored significantly lower on systematic documentation protocols, formal risk assessment methodologies, and safety representative appointments compared to large enterprises (>250 employees; p < .001). Furthermore, the scale discriminated between high-risk industrial sectors (e.g., construction, basic metal manufacturing) and low-risk service sectors, demonstrating sensitivity to industry-specific baseline hazards.
• Convergent Validity: Scale dimensions exhibited strong, statistically significant correlations with established occupational safety climate instruments, including the Nordic Occupational Safety Climate Questionnaire (NOSACQ-50). Specifically, the Safety Management Integration dimension correlated positively with management safety priority scales (r = .64, p < .001), while Worker Participation correlated strongly with worker safety commitment scales (r = .58, p < .001).
• Criterion-Related and Predictive Validity: Longitudinal tracking of participating enterprises revealed that workplaces scoring in the top tertile for Risk Assessment Rigor and Remediation Implementation exhibited significantly lower registered occupational accident frequency rates (accidents per million hours worked) and fewer working days lost due to occupational illness over a subsequent 24-month monitoring interval compared to enterprises in the bottom tertile (hazard ratio = 0.68, 95% CI [0.54, 0.85]).

8. Reliability

Empirical evaluations have demonstrated robust internal consistency and temporal stability for the instrument across multiple industrial cohorts:

• Internal Consistency: Cronbach’s alpha coefficients computed across the multidimensional subscales consistently exceed conventional thresholds for academic and diagnostic reliability. In the benchmark study by Niskanen, Naumanen, and Hirvonen (2012), internal consistency metrics were as follows:
  • Familiarity with OSH Directives & Legislation: α = .81
  • Workplace Safety Prerequisites: α = .84
  • Safety Management System Integration: α = .89
  • Risk Assessment Implementation and Execution: α = .91
  • Worker Consultation and Participation: α = .86
  • Documentation and Information Dissemination: α = .79
  • Preventive Actions and Safety Modification: α = .88
  • Entire Combined Questionnaire Battery: α = .94
• Test-Retest Stability: In a subsample of stable organizational settings re-evaluated across an 8-week interval, intra-class correlation coefficients (ICC) ranged from .76 to .87 across subscales, indicating acceptable temporal stability when no major structural or managerial reorganizations had taken place.
• Inter-Rater Reliability: Paired comparisons between safety representative ratings and employee collective samples yielded high concordance coefficients (Kendall’s W ranging from .68 to .81 across physical hazard sub-domains).

9. Factor Analysis

The latent structural integrity of the instrument was confirmed using both Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA):

During initial exploratory factor extraction (Principal Axis Factoring with Promax oblique rotation, accounting for correlated organizational dimensions), items loaded cleanly onto underlying constructs aligning directly with the theoretical framework. The Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy consistently exceeded .90 (KMO = .92), and Bartlett’s Test of Sphericity attained statistical significance (χ²(1485) = 14,280.4, p < .0001), indicating excellent data factorability.

Subsequent Confirmatory Factor Analysis (CFA) using robust maximum likelihood estimation (MLR) on stratified organizational samples confirmed a coherent multi-factor hierarchical model where individual operational dimensions loaded onto second-order safety climate and management constructs. The model demonstrated acceptable to excellent goodness-of-fit indices across diverse enterprise categories:

• Comparative Fit Index (CFI): .942
• Tucker-Lewis Index (TLI): .935
• Root Mean Square Error of Approximation (RMSEA): .046 (90% Confidence Interval: [.041, .051])
• Standardized Root Mean Square Residual (SRMR): .048
• Relative Chi-Square (χ²/df): 2.14 (well below the conservative threshold of 3.0)

Standardized factor loadings across all primary indicator variables ranged between λ = .58 and λ = .87, with cross-loadings remaining below .25. These results robustly support the multidimensional architecture of the scale, validating its capacity to distinguish between cognitive familiarity, structural management, procedural risk assessment, and tangible workplace intervention.

10. Instrument / Measurement Tool

The structural characteristics, administration parameters, and scoring procedures of the questionnaire are structured as follows:

• Target Population: Employers, senior managers, line supervisors, occupational safety delegates, safety committee members, and general front-line workers across manufacturing, industrial, construction, and service sectors.
• Administration Modality: Self-administered paper-and-pencil or digital web-based questionnaire; available in parallel phrasing formats optimized for managerial versus worker viewpoints.
• Estimated Completion Time: Approximately 20 to 30 minutes, depending on enterprise organizational complexity.
• Item Count: Comprehensive battery consisting of approximately 50 to 65 primary and nested situational items, categorized across distinct organizational modules.
• Response Formats:
  • 4- to 5-point Likert-type scales: Assessing agreement (e.g., 1 = Strongly Disagree to 5 = Strongly Agree) or qualitative evaluation (e.g., 1 = Very Poorly / Not at all to 5 = Exemplary / Very Well).
  • Categorical / Dichotomous verification options: Assessing formal administrative presence (e.g., Yes, documented; Yes, informally; No; Do not know).
  • Ordinal frequency measures: Assessing inspection regularity (e.g., Daily, Weekly, Monthly, Annually, Never).
• Scoring and Indexing: Individual item scores are averaged within thematic sub-domains to yield dimensional profiles (0 to 100 normalized scores or 1 to 5 scale means). Discrepancy indices are calculated by subtracting mean worker scores from mean managerial scores (Δ = Score_Manager − Score_Worker); positive discrepancy scores highlight leadership over-optimism and potential blind spots in safety governance.

11. Permissions & Fee and Test Year

Initial Publication Year: 2012 (with baseline validation studies initiated in 2008–2011).

Copyright and Ownership: Academic and intellectual copyright resides with the original research team—Dr. Tapani Niskanen, Dr. Pekka Naumanen, Marja-Leena Hirvonen, and their associated research institutions, in conjunction with Elsevier Ltd. (the publisher of Applied Ergonomics).

Licensing and Accessibility: The questionnaire was developed as part of publicly funded national and European research evaluating occupational health legislation. Academic researchers and non-profit organizations may utilize the instrument for scientific research, academic dissertations, and institutional evaluation without royalty fees, provided full bibliographic citation is accorded to Niskanen et al. (2012). Commercial entities, private consulting firms, and corporate safety auditing platforms seeking to incorporate the questionnaire items into proprietary commercial software suites must secure prior explicit written permission from the corresponding author and relevant institutional copyright holders.

12. References

• Council Directive 89/391/EEC of 12 June 1989 on the introduction of measures to encourage improvements in the safety and health of workers at work. Official Journal of the European Communities, L 183, 29/06/1989, pp. 1–8. https://osha.europa.eu/en/legislation/directives/the-osh-framework-directive/1
• Niskanen, T., Naumanen, P., & Hirvonen, M. L. (2012). An evaluation of EU legislation concerning risk assessment and preventive measures in occupational safety and health. Applied Ergonomics, 43(5), 829–842. https://doi.org/10.1016/j.apergo.2011.12.003
• Niskanen, T., Louhelainen, K., & Hirvonen, M. L. (2014). An evaluation of the occupational safety and health management system guidelines in Finland. Safety Science, 68, 203–213. https://doi.org/10.1016/j.ssci.2014.04.011
• Noro, K., & Imada, A. S. (Eds.). (1991). Participatory Ergonomics. Taylor & Francis. https://doi.org/10.1201/9781482294156
• Reason, J. (1997). Managing the Risks of Organizational Accidents. Ashgate Publishing.
• Zohar, D. (1980). Safety climate in industrial organizations: Theoretical and applied implications. Journal of Applied Psychology, 65(1), 96–102. https://doi.org/10.1037/0021-9010.65.1.96
• Zohar, D. (2010). Thirty years of safety climate research: Reflections and future directions. Accident Analysis & Prevention, 42(5), 1517–1522. https://doi.org/10.1016/j.aap.2009.12.019

13. Items of the Scale