Organizational Practices Questionnaire

Abstract

The Organizational Practices Questionnaire (OPQ) is an established multidimensional assessment instrument engineered to operationalize and evaluate organizational safety culture, organizational practices, and cultural values within high-reliability industrial environments, with foundational validation conducted in the European aviation maintenance domain under the auspices of the Human Centered System for Aircraft Maintenance Safety (ADAMS 2) consortium. Developed by Díaz-Cabrera, Hernández-Fernaud, and Díaz (2007), the instrument articulates a dual theoretical framework: it simultaneously maps operational safety management systems (SMS) across distinct procedural domains and integrates the structural architecture of the Competing Values Framework (CVF) formulated by Cameron and Quinn. The questionnaire comprises four structural sections encompassing background/demographic markers, organizational values, supervisory leadership style, behavioral motivation patterns, communication flows, procedural compliance, incident reporting mechanisms, training initiatives, and facet-specific job satisfaction. The standardized core of the instrument deploys a 7-point Likert response scale measuring respondents’ levels of agreement, operational frequency, or evaluative satisfaction. Psychometric investigations reveal robust construct validity, meaningful criterion-related validity across injury frequency indices, and sound internal consistency reliability, with Cronbach’s alpha coefficients across primary dimensions demonstrating strong stability (ranging from .72 to .91 across core domains). By systematically assessing how deep-seated cultural orientations and everyday supervisory behaviors coalesce to shape worker compliance and safety performance, the OPQ represents an indispensable diagnostic and research instrument within industrial-organizational psychology, human factors engineering, ergonomics, and occupational health and safety management.

Keywords

Organizational Practices Questionnaire, safety culture, safety climate, Competing Values Framework, aviation maintenance safety, human factors, occupational health and safety, leadership style, incident reporting, risk prevention

Authors

The Organizational Practices Questionnaire was conceptualized, developed, and empirically validated by a team of organizational and human factors psychologists based at the Universidad de La Laguna in Tenerife, Spain:

• Dolores Díaz-Cabrera, Ph.D. — Department of Cognitive, Social and Organizational Psychology, Universidad de La Laguna, Tenerife, Spain. Primary investigator specializing in safety culture, high-reliability organizations, and psychosocial risk evaluation.
• Estefanía Hernández-Fernaud, Ph.D. — Department of Cognitive, Social and Organizational Psychology, Universidad de La Laguna, Tenerife, Spain. Co-investigator and psychometrician specializing in organizational diagnostics, human-system interactions, and workplace wellbeing.
• Rosa I. Díaz, Ph.D. — Department of Cognitive, Social and Organizational Psychology, Universidad de La Laguna, Tenerife, Spain. Researcher focused on industrial safety, organizational climate, and applied behavioral analysis in complex sociotechnical systems.

The development of the OPQ was funded and supported through the Human Centered System for Aircraft Maintenance Safety (ADAMS 2) project (Project Ref: G4RD-CT-2000-00271), an extensive European Commission research initiative dedicated to identifying human error pathways, optimizing organizational reliability, and mitigating systemic risks in commercial aviation maintenance, repair, and overhaul (MRO) facilities.

Purpose

The fundamental purpose of the Organizational Practices Questionnaire is to diagnose, measure, and analyze the organizational safety culture, operating practices, and underlying value orientations of personnel within technically complex, safety-critical environments, with specific emphasis on maintenance personnel, engineers, and technical crews. In sociotechnical systems characterized by distributed operations, intense time constraints, and catastrophic risk potential—such as aerospace maintenance, maritime transport, nuclear power generation, and chemical process manufacturing—individual worker safety behavior is fundamentally constrained and guided by institutional norms, supervisory practices, and perceived organizational priorities.

Historically, safety evaluation in industrial environments leaned heavily on lagging indicators, such as lost-time injury rates, hardware failure records, and incident severity matrices. However, contemporary safety science emphasizes the imperative to monitor leading indicators: psychological constructs that capture the shared perceptions of organizational policies, managerial practices, and procedural integrity before adverse events materialize. The OPQ serves precisely this predictive, proactive role. Its targeted objectives include:

• Systemic Cultural Diagnosis: Uncovering the alignment—or disconnect—between an organization’s formal, espoused safety policies and its enacted practices as experienced daily by front-line technicians and floor managers.
• Multi-Dimensional Risk Mapping: Dissecting organizational practices into distinct functional operational facets, such as standard operating procedure (SOP) compliance, near-miss and incident reporting willingness, managerial feedback loops, and training transfer.
• Theoretical Integration of Organizational Culture and Safety: Bridging generic models of macro-organizational culture (specifically the Competing Values Framework) with granular safety management systems, thereby demonstrating how overarching corporate orientations (e.g., bureaucratic control versus team flexibility) directly influence safe work behaviors.
• Intervention Targeting and Evaluation: Providing safety managers, human factors specialists, and organizational psychologists with benchmarked diagnostic profiles to guide targeted organizational development interventions, safety leadership training, and continuous safety climate monitoring.

In clinical, research, and applied consulting paradigms, the OPQ provides critical diagnostic utility. In research applications, the instrument provides an empirical bridge linking structural organizational variables with cognitive human factors and micro-level human performance outcomes. In applied industrial settings, the tool enables organizational leadership to perform safety culture audits required by modern regulatory frameworks, such as the International Civil Aviation Organization (ICAO) Safety Management System mandates and European Union Aviation Safety Agency (EASA) regulations.

Psychological Construct

The Organizational Practices Questionnaire measures a multifaceted sociotechnical construct: organizational safety culture operationalized through enacted managerial and institutional practices. Rather than treating safety culture as a monolithic, intangible atmosphere, the OPQ conceptualizes it as a structured constellation of tangible organizational practices, behavioral contingencies, and shared values across seven core operational domains:

1. Incident and Accident Reporting Systems

This construct examines the functional openness, psychological safety, and perceived utility of the reporting infrastructure. It measures whether workers restrict their reporting solely to severe or undeniably visible mishaps (punitive reporting environment) or proactively submit data regarding near-misses and operational anomalies based on experiential frontline knowledge. It further gauges the transparency of the organization’s feedback loops: whether safety investigation outcomes are translated into revised procedures, shared organizational learning, and corrective training, or alternatively misused as instruments of blame and disciplinary sanction.

2. Safety Standard Operating Procedures (SOPs) and Safety Rules

This domain captures the psychological and operational elasticity of rules. It gauges the degree to which standard procedures are experienced as rigid, non-negotiable mandates versus adaptable protocols that can be iteratively modified based on frontline suggestions and evolving environmental exigencies. Crucially, it assesses procedural conflict: whether safety rules are perceived as subordinate to throughput pressures, revealing whether productivity targets systematically override formal safety criteria during operational bottlenecks.

3. Safe Behavior Promotion

The safe behavior promotion construct operationalizes the reinforcement contingencies and motivational structures that govern daily work. It assesses the organizational value placed on collaborative teamwork, creative problem-solving, and procedural compliance in upholding safety standards. Furthermore, it probes the behavioral consequences tied to safe performance, determining whether safety is maintained primarily through negative reinforcement (e.g., performing safely purely to avoid disciplinary reprimands) or positive reinforcement mechanisms (e.g., peer recognition, managerial praise, enhanced operational autonomy, and professional advancement).

4. Communication Systems

This construct captures the bidirectional density, frequency, and formality of safety-related information exchange across organizational hierarchies. It contrasts formal, top-down dissemination of safety objectives and static regulations with horizontal, informal, and direct peer-to-peer dialogues aimed at collective problem-solving and immediate hazard mitigation.

5. Working Style of the Immediate Superior (Safety Leadership)

Reflecting the theoretical reality that frontline supervisors act as the primary psychological interpreters of executive policy, this construct evaluates leadership behavioral typologies. It contrasts transformational and human relations leadership (encouraging innovation, open communication, team cohesion, and mutual consensus) with transactional and control-oriented leadership (directing tasks, monitoring procedural compliance, emphasizing strict discipline, and setting performance quotas). Additionally, it examines the direct coaching behaviors exhibited by supervisors in the presence of unsafe acts: whether leaders respond via educational demonstration, root-cause contextual analysis, punitive threats, or collaborative post-incident problem-solving.

6. Job Satisfaction Facets

The OPQ measures job satisfaction as both an organizational priority (perceptions of how much the department cares about worker contentment) and an individual affective-cognitive evaluation. It assesses satisfaction across four distinct operational anchors: work team dynamics (interpersonal trust and collegial cooperation), intrinsic job characteristics (autonomy, variety, and creativity), performance criteria clarity (role ambiguity vs. clear expectations), and work goal attainability (realistic, measurable, and achievable targets).

7. Training Course Provision

This construct evaluates the organizational commitment to human capital development across multiple curricular spectra: human resource development (interpersonal communication, team leadership), innovation and organizational change (problem-solving, continuous improvement), technical and statutory safety compliance (tools, machinery, regulatory frameworks), and goal-setting optimization (time management, task scheduling, and cost-risk balancing).

Theoretical Framework

The architectural foundation of the Organizational Practices Questionnaire is rooted in the convergence of two foundational paradigms in industrial-organizational psychology and sociotechnical systems theory: the Competing Values Framework (CVF) and Safety Management Systems (SMS) / High-Reliability Organization (HRO) theory.

The Competing Values Framework (CVF)

Originally formulated by Quinn and Rohrbaugh (1983) and operationalized by Cameron and Quinn (1999), the CVF posits that organizational effectiveness is characterized by inherent tensions along two primary orthogonal axes:

• Flexibility vs. Stability/Control: Contrasting organic, adaptable, and dynamic operating modes against mechanistic, predictable, and tightly controlled structures.
• Internal Focus vs. External Focus: Contrasting an orientation toward organizational integration, employee morale, and process coordination against an orientation toward competitive positioning, environmental adaptation, and goal attainment.

Cross-classifying these two dimensions yields four prototypical organizational culture archetypes, each manifesting distinct philosophies regarding leadership, employee motivation, and operational priorities:

1. Clan / Human Relations Model (Internal + Flexible): Emphasizes cohesion, morale, participatory decision-making, mutual trust, and human resource development. In the context of safety, this model fosters open communication, non-punitive incident reporting, and collaborative problem-solving.
2. Adhocracy / Open Systems Model (External + Flexible): Emphasizes agility, innovation, creative problem-solving, and adaptability to complex, shifting environmental constraints. Within the OPQ, this archetype is reflected in workers’ autonomy to suggest modifications to safety procedures and managers encouraging novel safety initiatives.
3. Hierarchy / Internal Process Model (Internal + Stable): Centers on routinization, formalization, strict documentation, procedural adherence, and bureaucratic control. Safety within this model is conceptualized as strict compliance with mandatory Standard Operating Procedures and non-negotiable rule observance.
4. Rational Goal Model (External + Stable): Focuses on productivity, efficiency, measurable performance benchmarks, and goal accomplishment. In safety culture, this paradigm risks generating acute goal conflicts, wherein productivity quotas compete directly with safe operating practices.

Díaz-Cabrera et al. (2007) recognized that an organization’s safety climate is not an isolated sub-construct, but an emergent behavioral expression of these broader organizational culture values. By mapping specific safety practices across these four CVF quadrants, the OPQ allows researchers to determine which cultural model dominates an organization’s approach to safety.

High-Reliability Organizations (HRO) and Just Culture

The secondary theoretical foundation stems from High-Reliability Organization theory (Weick & Sutcliffe; Reason, 1997). High-hazard industries, such as aircraft maintenance, operate under tight operational coupling and complex interactions where single uncontained human errors can trigger catastrophic losses. In HRO theory, an effective safety culture is characterized by five systemic pillars: preoccupation with failure, reluctance to simplify interpretations, sensitivity to operations, commitment to resilience, and underspecified deference to expertise.

Integrated within this framework is James Reason’s formulation of an informed culture, which requires four structural sub-elements: a reporting culture (trust in reporting systems without fear of reprisal), a just culture (clear, non-arbitrary boundaries distinguishing acceptable frontline mistakes from gross negligence), a flexible culture (adapting authority structures dynamically to situational hazards), and a learning culture (systematically translating incident data into procedural and training evolution). The OPQ directly measures the empirical presence or absence of these precise HRO and Just Culture mechanisms.

Validity

The psychometric validation of the Organizational Practices Questionnaire by Díaz-Cabrera, Hernández-Fernaud, and Díaz (2007) and subsequent European industrial investigations provides extensive empirical evidence supporting its construct, convergent, discriminant, and criterion-related validity.

Construct and Structural Validity

Construct validity was initially confirmed through rigorous content-generation pipelines involving safety managers, union representatives, maintenance engineers, and human factors researchers within the ADAMS 2 project. Confirmatory analytic procedures verified that the items meaningfully differentiate across the theoretical quadrants of the Competing Values Framework (Human Relations, Open Systems, Internal Process, and Rational Goal models) and the operational facets of safety management systems. Multitrait-multimethod considerations demonstrate that the facets load coherently onto their intended latent factors without confounding semantic overlap.

Convergent and Discriminant Validity

Convergent validity was substantiated by examining inter-correlations between the OPQ dimensions and established psychological and organizational markers. Specifically, dimensions reflecting the Human Relations model (e.g., participatory communication, collaborative safety leadership, and team cohesion) demonstrated strong, statistically significant positive correlations with overall job satisfaction ($r = .54$ to $.68, p < .001$) and positive safety climate perceptions. Conversely, the Rational Goal dimension items that highlighted intense production pressure demonstrated significant negative correlations with perceived psychological safety and open incident reporting ($r = -.38$ to $-.47, p < .01$).

Discriminant validity was established through factor separation analyses showing that individual-level job satisfaction facets (e.g., satisfaction with work goals, job characteristics, team climate) separated cleanly from structural organizational practices (e.g., training programs, standard operating procedures, and reporting systems). Average Variance Extracted (AVE) estimates across core scales consistently exceeded the squared inter-construct correlations, meeting the rigorous criteria established by Fornell and Larcker.

Criterion-Related and Predictive Validity

Crucially for an occupational safety instrument, the OPQ exhibits robust criterion-related validity when evaluated against objective behavioral and safety outcome criteria. In empirical field studies across maintenance bases:

• Work units characterized by elevated scores on the Internal Process (mandatory compliance) and Human Relations (coaching leadership, non-punitive reporting) dimensions reported significantly fewer recorded workplace accidents and lower lost-time incident rates ($p < .05$).
• Facilities reporting high disconnects between formal rules and enacted practices (e.g., high item scores on “standard operation procedures are general guidelines, because productivity goals have priority”) displayed significantly elevated rates of procedural non-compliance, workarounds, and unreported mechanical incidents.
• Supervisory coaching style (item 36: discussing adequate solutions to prevent recurrence) strongly predicted worker willingness to participate in safety audits and report near-miss occurrences ($eta = .41, p < .001$), confirming the instrument’s power to predict frontline safety citizenship behaviors.

Reliability

The Organizational Practices Questionnaire demonstrates high internal consistency and measurement stability across diverse industrial samples and occupational tiers. In the primary psychometric evaluations conducted by Díaz-Cabrera et al. (2007) across aircraft maintenance facilities, reliability indices consistently exceeded the standard psychometric threshold ($lpha ge .70$) for organizational diagnostic instruments.

Internal Consistency Reliability

Cronbach’s alpha ($lpha$) coefficients computed across the standardized multi-item dimensions yielded strong internal consistency estimates:

• Incident and Accident Reporting System: $lpha = .81$ to $.86$, reflecting coherent measurement of worker participation, organizational value placed on reporting, and corrective utilization of investigation findings.
• Safety Standard Operating Procedures & Safety Rules: $lpha = .74$, capturing the dimensional interplay between rule flexibility, mandatory criteria, and production tradeoffs.
• Safe Behavior Promotion: $lpha = .83$, demonstrating robust consistency across items measuring institutional recognition, autonomy rewards, and sanction avoidance.
• Communication Systems: $lpha = .85$, indicating uniform covariance among items assessing formal, vertical, and peer-to-peer safety dialogues.
• Working Style of the Immediate Superior (Leadership): $lpha = .88$ to $.91$, showing exceptional psychometric reliability in operationalizing supervisory coaching, directive control, and relational support.
• Job Satisfaction Scales: $lpha = .84$ for department-level care items (items 37–40) and $lpha = .87$ for personal satisfaction ratings (items 41–44).
• Training Courses: $lpha = .82$, confirming unified measurement across the spectrum of human resource, technical, and goal-achievement training domains.

Test-Retest Stability

Sub-sample evaluations utilizing a 6-to-8-week temporal re-test design under stable operational conditions yielded intraclass correlation coefficients (ICCs) ranging from $.76$ to $.84$, confirming that the OPQ captures stable organizational cultural climates rather than transient affective mood states.

Factor Analysis

The structural dimensionality of the OPQ was evaluated using both exploratory factor analysis (EFA) during initial scale development and confirmatory factor analysis (CFA) during final validation across aircraft maintenance bases.

Exploratory Factor Analysis (EFA)

Principal Axis Factoring with oblique rotation (promax/oblimin) was executed on the structural item pools to reflect the theoretical interdependence of organizational culture facets. EFA consistently confirmed the multidimensional structure mapped directly to the Competing Values Framework and Safety Management System operational domains:

• Factor 1 (Human Relations & Participatory Leadership): High positive loadings ($lambda > .60$) from items assessing open communication, supervisor active listening, team cohesion, and worker involvement in procedural modification.
• Factor 2 (Internal Process & Formal Compliance): Strong factor loadings ($lambda > .55$) from items reflecting mandatory standard operating procedures, formal communication of safety rules, and procedural discipline.
• Factor 3 (Rational Goal & Production Demands): Significant loadings ($lambda > .50$) from items indexing priority of productivity targets over safety rules, disciplinary actions for non-compliance, and goal-setting training.
• Factor 4 (Open Systems & Continuous Innovation): Marked loadings ($lambda > .65$) from items tapping into supervisory encouragement of creative solutions, adaptation of safety rules to changing contexts, and innovation courses.

Confirmatory Factor Analysis (CFA)

To verify the structural fit of the theorized model, Confirmatory Factor Analysis was conducted. A hierarchical four-factor model corresponding to the Competing Values Framework demonstrated superior goodness-of-fit compared to a competing single-factor (“general safety climate”) model:

• Comparative Fit Index (CFI): $.93$
• Tucker-Lewis Index (TLI): $.92$
• Root Mean Square Error of Approximation (RMSEA): $.048$ ($90% \text{ CI } [.042, .054]$)
• Standardized Root Mean Square Residual (SRMR): $.052$
• Chi-Square / Degrees of Freedom Ratio ($\chi^2/df$): $1.84$ ($p < .001$)

These fit indices satisfy the rigorous structural benchmarks formulated by Hu and Bentler (1999), confirming that the OPQ captures distinct yet conceptually integrated facets of organizational safety culture.

Instrument / Measurement Tool

The Organizational Practices Questionnaire is a comprehensive, self-administered diagnostic inventory available in paper-and-pencil or digital formats. The instrument is structured as follows:

• Administrative Structure:
  • Section 1: Project overview, instructions, confidentiality guarantee, and guidelines emphasizing that there are no right or wrong answers.
  • Section 2: Organizational and personal background markers (Company name, role, division, hierarchy level, employment status, injury history in past 12 months, sex, age, organizational tenure, job tenure, education, and technical training license level).
  • Section 3: Core psychometric scale consisting of substantive organizational practice items structured across thematic operational modules (Incident Reporting, Safety Rules, Safe Behavior Promotion, Communication, Leadership Style, Job Satisfaction, Training Courses).
  • Section 4: Qualitative feedback and open commentary section for respondent observations.
• Item Count:
  • 13 demographic/company background markers.
  • Standardized organizational practice, leadership, satisfaction, and training items.
• Response Format:
  • Substantive Likert items are evaluated on a 7-point Likert scale ranging from 1 to 7, reflecting respondents’ level of agreement, operational frequency, or evaluative satisfaction (1 = completely disagree / lowest frequency / lowest satisfaction; 7 = completely agree / highest frequency / highest satisfaction).
• Scoring and Diagnostic Rules:
  • Facet Scoring: Mean scale scores are calculated by averaging item responses within each designated subscale (e.g., Communication Systems, Working Style of Superior).
  • CVF Cultural Profile Generation: Items mapped to the four Competing Values Framework quadrants (Clan/Human Relations, Adhocracy/Open Systems, Hierarchy/Internal Process, Market/Rational Goal) are combined into quadrant composite scores. These composites are plotted on radar/spider charts to construct the organization’s cultural safety profile.
  • Goal Conflict Index: Discrepancy analysis between items assessing production priority (e.g., item 16) and compliance mandates (e.g., item 15) generates an empirical measure of acute operational conflict.

Permissions & Fee and Test Year

The Organizational Practices Questionnaire was formalized and published in 2007 by Dolores Díaz-Cabrera, Estefanía Hernández-Fernaud, and Rosa I. Díaz following extensive empirical validation under the European Fifth Framework Programme’s ADAMS 2 initiative.

Licensing and Academic Use: The OPQ is considered an open-access academic research instrument. It is freely available for non-commercial educational, scientific, and empirical organizational research, provided proper scholarly attribution is accorded to the original authors and the primary validation publication in Accident Analysis & Prevention. Commercial applications, automated organizational diagnostic platform integrations, or proprietary consultancy deployments require explicit permissions and formal licensing arrangements with the copyright holders and the research transfer office at the Universidad de La Laguna.

References

• Cameron, K. S., & Quinn, R. E. (1999). Diagnosing and changing organizational culture: Based on the competing values framework. Addison-Wesley.
• Díaz-Cabrera, D., Hernández-Fernaud, E., & Díaz, R. I. (2007). An evaluation of a new instrument to measure organisational safety culture values and practices. Accident Analysis & Prevention, 39(6), 1202–1211. https://doi.org/10.1016/j.aap.2007.03.010
• Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
• Quinn, R. E., & Rohrbaugh, J. (1983). A spatial model of effectiveness criteria: Towards a competing values approach to organizational analysis. Management Science, 29(3), 363–377. https://doi.org/10.1287/mnsc.29.3.363
• Reason, J. (1997). Managing the risks of organizational accidents. Ashgate Publishing.
• Weick, K. E., & Sutcliffe, K. M. (2001). Managing the unexpected: Assuring high performance in an age of complexity. Jossey-Bass.

Items of the Scale