Offshore Human Factors Questionnaire

Abstract

The Offshore Human Factors Questionnaire (also widely designated as the Offshore Attitude Questionnaire [OAQ] or the Offshore Crew Resource Management Questionnaire) is an applied psychometric instrument designed to evaluate safety-critical cognitive, social, and managerial attitudes among operational personnel working in high-hazard offshore petroleum installations. Originating from the foundational work of Dr. Paul O’Connor and Professor Rhona Flin at the University of Aberdeen’s Industrial Psychology Research Centre, the OAQ represents an adaptation of the Cockpit Management Attitude Questionnaire (CMAQ) developed for commercial aviation by Gregorich, Helmreich, and Wilhelm (1990). The original inventory comprises 30 self-report items evaluated on a 5-point Likert scale, spanning five focal behavioral and cognitive domains: Decision Making, Situation Awareness, Communication and Crew Coordination, Personal Limitations, and Leadership/Hierarchy. The primary utility of the OAQ is the pre- and post-intervention assessment of Crew Resource Management (CRM) training programs in the oil and gas sector, determining whether classroom- and simulator-based non-technical skills training translates into shifts in safety attitudes. Psychometric evaluations of the scale revealed notable measurement complexities: while the internal reliability of communication and personal limitations factors reached acceptable levels following the iterative removal of nine problematic items, the decision-making subscale demonstrated negative Cronbach’s alpha values due to multidimensionality and distinct attitudinal constructs regarding authority and risk appraisal. This article delivers an exhaustive academic analysis of the OAQ, examining its theoretical lineage in High Reliability Organizations (HRO), structural validity, reliability paradoxes, operational scoring protocols, and full original inventory items.

Keywords

Offshore Human Factors Questionnaire, Offshore Attitude Questionnaire, Crew Resource Management, Non-Technical Skills, Safety Attitudes, High Reliability Organizations, Situation Awareness, Decision Making, Rhona Flin, Paul O’Connor, Cockpit Management Attitude Questionnaire, Industrial Psychometrics, Safety Climate, Oil and Gas Industry, Piper Alpha

Authors

The Offshore Human Factors Questionnaire was authored and validated by Dr. Paul O’Connor and Professor Rhona Flin, operating out of the Department of Psychology at the University of Aberdeen, Scotland.

• Dr. Paul O’Connor, PhD: An organizational psychologist and human factors specialist. At the time of the instrument’s primary development and validation, Dr. O’Connor was a research fellow in the Industrial Psychology Research Centre at the University of Aberdeen. He subsequently served as a human factors researcher for the U.S. Navy and later held academic faculty positions in the Department of General Practice at the National University of Ireland, Galway. His research centers on non-technical skills training, team performance under stress, medical human factors, and high-risk operational safety.
• Professor Rhona Flin, PhD, FBPsS, FRSE: Emeritus Professor of Applied Psychology at the University of Aberdeen and Professor of Industrial Psychology at Aberdeen Business School, Robert Gordon University. Professor Flin is recognized as one of the world’s foremost authorities on human performance, crisis decision-making, and safety culture in high-hazard environments. Following the public inquiry into the 1988 Piper Alpha disaster chaired by Lord Cullen, Flin spearheaded pioneering field studies that defined the taxonomy of non-technical skills (NTS) across offshore extraction, aviation, and acute surgical environments.

Purpose

High-risk industrial domains—such as commercial aviation, commercial seafaring, nuclear power generation, and offshore oil and gas exploration—operate under extreme environmental stressors where technical competence alone is insufficient to prevent catastrophic systemic failure. The Cullen Report (1990) into the Piper Alpha disaster, which claimed the lives of 167 offshore workers, explicitly identified failures in communication, emergency command, situational assessment, shift handover protocols, and organizational decision-making as primary causal vectors. In response to these findings, the offshore industry sought to adapt the human factors training methodologies that had demonstrated success in civil and military aviation: Crew Resource Management (CRM).

The Offshore Human Factors Questionnaire (OAQ) was developed with the primary objective of measuring the safety-critical attitudes of offshore personnel toward non-technical skills, providing a standardized, empirically grounded metric to evaluate the effectiveness of CRM training interventions. Specific purposes include:

• Training Program Evaluation: Serving as a pre- and post-course evaluation instrument within Kirkpatrick’s evaluation framework (specifically Level 2: Attitudinal Learning). By administering the questionnaire immediately before and following CRM workshops, organizational psychologists assess whether targeted pedagogical interventions induce favorable shifts in participant attitudes regarding hierarchy, communication openness, and fatigue management.
• Safety Climate and Cultural Diagnostics: Establishing organizational baselines across differing operational cadres (e.g., drilling, maintenance, production engineering, catering, and subcontracted workforces). The OAQ enables offshore safety managers to detect hazardous operational norms, such as excessive deference to authority, dangerous self-perceptions of invulnerability under fatigue, or systemic reluctance to voice safety concerns.
• Human Factors Research and Modeling: Providing academic and applied researchers with empirical data to model the relationship between human factors attitudes, behavioral non-technical performance markers (such as those measured by the NOTECHS behavioral rating system), and objective safety outcomes (including lost-time injuries, unplanned shut-ins, and near-miss reporting frequencies).
• Supervisory and Command Assessment: Quantifying attitudes toward the role of the Offshore Installation Manager (OIM) and frontline supervisors, clarifying whether operational crews hold authoritarian or collaborative models of command in both routine and crisis states.

Psychological Construct

The Offshore Human Factors Questionnaire assesses an individual’s cognitive mindset, behavioral intentions, and subjective norms regarding the social and cognitive non-technical skills (NTS) essential for safe operational functioning. Derived from the conceptual taxonomy established by Flin et al. (2003) and Helmreich et al. (1999), these non-technical skills do not replace technical engineering proficiency; rather, they serve as the cognitive and interpersonal conduit through which technical tasks are safely executed. The instrument examines five interrelated psychological dimensions:

1. Communication and Crew Coordination

This construct captures an individual’s appreciation of transparent, bidirectional, and non-defensive information exchange across the operational team. Effective crew coordination in high-hazard environments requires cross-checking, verbalizing intent, actively seeking feedback, and maintaining open communication channels regardless of professional specialization or corporate status. Items within this dimension gauge attitudes toward questioning practices, debriefing routines, conversational interruptions, and the belief that interpersonal communication is as critical to platform survival as mechanical expertise.

2. Situation Awareness

Anchored in Mica Endsley’s three-level model (Perception, Comprehension, and Projection), this construct measures an individual’s cognitive disposition toward environmental vigilance, task monitoring, interruption recovery, and mental model maintenance. Personnel with robust situation awareness attitudes recognize that operational status is dynamic and fragile. Consequently, they engage in deliberate pre-job hazard identification, periodic status reviews, and explicit procedural recovery actions (such as stepping back when interrupted) to prevent cognitive fixation and latent trap activation.

3. Decision Making

This dimension addresses beliefs and behavioral orientations toward operational risk assessment, uncertainty management, cognitive confidence, and collaborative problem-solving. In offshore installations, decision making ranges from analytical, rule-based processes during planned maintenance to intuitive, recognition-primed decisions (RPD) during hydrocarbon releases or structural emergencies. The construct assesses whether an individual believes safety-critical decisions should be made unilaterally or collaboratively, how ambiguity is handled, and whether personnel possess appropriate calibration regarding their decision competence under severe operational anomalies.

4. Personal Limitations and Stress/Fatigue Recognition

Originating from the “Stress Recognition” subscales of aviation instruments, this construct captures an operative’s self-awareness regarding human physiological and psychological vulnerability. Offshore shift workers frequently endure 12-hour shifts, night-shift rotations, noisy environments, and high-consequence workloads. This dimension measures whether an individual realistically acknowledges the detrimental effects of acute fatigue, circadian disruption, domestic stress, and high workload on cognitive processing, or conversely harbors hazardous attitudes of invulnerability (e.g., believing that true professionals are immune to stress or that performance remains flawless at 03:00 AM).

5. Leadership and Supervisory Authority

This construct examines the perceived authority gradient and organizational power distance between the frontline workforce and supervisory management, most notably the Offshore Installation Manager (OIM). It taps into beliefs concerning whether strong leadership requires rigid, authoritarian dominance or participatory, consensus-seeking behaviors that empower junior team members to intervene when safe operating envelopes are breached.

Theoretical Framework

The conceptual architecture of the Offshore Human Factors Questionnaire is grounded in three converging paradigms within organizational psychology, industrial ergonomics, and cognitive engineering: Crew Resource Management (CRM), High Reliability Organization (HRO) theory, and James Reason’s System Safety Paradigm.

Crew Resource Management and the Aviation Lineage

In the late 1970s, the National Aeronautics and Space Administration (NASA) and major commercial airlines identified that over 70% of fatal aviation hull-loss accidents stemmed not from mechanical failure or aerodynamic ignorance, but from breakdowns in crew coordination, interpersonal communication, leadership, and situational assessment. This led to the creation of Cockpit Resource Management (later Crew Resource Management). Helmreich, Gregorich, and Wilhelm (1990) developed the Cockpit Management Attitude Questionnaire (CMAQ) to operationalize the measurement of pilot attitudes toward CRM concepts. Helmreich’s team posited that safety-related attitudes act as precursors to cockpit behavior: while positive attitudes do not guarantee error-free performance, negative or hazardous attitudes (such as machismo, anti-authority, or resignation) predictably degrade crew performance under stress.

Following the Piper Alpha disaster and the subsequent introduction of the Offshore Installations (Safety Case) Regulations 1992, Flin and O’Connor recognized that offshore drill crews, control room operators, and production technicians operated in an environmental sociotechnical system functionally equivalent to an aircraft flight deck. Adapting the CMAQ framework to the offshore environment required transposing aviation constructs (such as Captain-First Officer authority gradients) into offshore organizational hierarchies (such as OIM-Supervisor-Technician command dynamics).

High Reliability Organization (HRO) Theory

HRO theory, developed by researchers such as Karl Weick, Kathleen Sutcliffe, Gene Rochlin, and Todd La Porte, examines systems operating in high-hazard environments that experience fewer catastrophic accidents than statistically anticipated. Key behavioral and cultural hallmarks of HROs include:

• Preoccupation with Failure: Treating any operational anomaly or near-miss as a symptom that something may be fundamentally amiss with the wider system.
• Reluctance to Simplify Interpretations: Recognizing that complex industrial operations generate complex failure pathways.
• Sensitivity to Operations: Continuous situational awareness of how frontline actions interact with structural safety barriers.
• Commitment to Resilience: The capability to detect, contain, and bounce back from unexpected operational upsets.
• Deference to Expertise: During high-tempo operational crises, decision-making authority migrates from formal hierarchical rank to those personnel with the greatest situational and functional expertise.

The OAQ directly operationalizes these HRO tenets by evaluating whether personnel feel empowered to speak up regardless of rank (Item 27), whether they view technical proficiency as insufficient without crew coordination (Item 5), and whether they defer to procedural verification when disrupted (Item 8).

The Swiss Cheese Model and Error Management

James Reason’s (1990, 1997) systemic accident causation model differentiates between active failures (unsafe acts committed by frontline operators at the sharp end) and latent conditions (systemic vulnerabilities embedded within organizational design, management decisions, and training systems). The OAQ is designed around the core principle of threat and error management: because human fallibility is inevitable in complex operational contexts, team-based non-technical skills serve as dynamic defense layers (the cheese slices). When an individual technician suffers an attentional lapse or cognitive error, robust communication, open challenge mechanisms, and shared situational awareness ensure that the error is trapped and mitigated before it breaches the final technical barrier.

Validity

The validity of the Offshore Human Factors Questionnaire has been evaluated across multiple empirical studies conducted in the United Kingdom continental shelf (North Sea) offshore oil and gas industry, as well as international maritime energy sectors.

Content and Face Validity

Content validity was established through structured subject matter expert (SME) panels comprising senior offshore personnel, Offshore Installation Managers, drilling superintendents, health and safety executives, and applied psychologists from the University of Aberdeen. The items of Gregorich et al.’s (1990) CMAQ and Helmreich et al.’s (1993) Flight Management Attitude Questionnaire (FMAQ) were systematically audited. Aviation-specific terminology (e.g., “Captain,” “cockpit,” “flight plan,” “Air Traffic Control”) was translated into authentic offshore operational equivalents (e.g., “OIM,” “job,” “shift handover,” “work colleague”). Face validity was substantiated via pilot testing with 34 offshore operational technicians, who verified that the scenarios, behavioral expressions, and operational dilemmas accurately mirrored daily rig realities.

Construct and Convergent Validity

Construct validity has been examined through convergent testing against established occupational safety climate instruments, including the Loughborough Safety Climate Assessment Toolkit and the Aberdeen Offshore Safety Questionnaire. Findings demonstrate moderate-to-high positive correlations ($r = .42$ to $.61, p < .001$) between the OAQ Communication and Personal Limitations subscales and organizational safety climate dimensions measuring “Management Commitment to Safety” and “Workforce Empowerment.” Furthermore, the OAQ demonstrated divergent validity when compared against general personality inventories (such as the NEO-FFI); human factors safety attitudes were distinct from trait neuroticism or extraversion, confirming that the OAQ captures malleable, context-specific socio-cognitive attitudes rather than immutable personality traits.

Criterion and Predictive Validity

Predictive and criterion validity were evaluated in the primary empirical trial reported by O’Connor and Flin (2003). In this investigation, offshore teams ($N = 108$) underwent a dedicated 2-day offshore CRM training curriculum. The OAQ was administered in a repeated-measures design (pre-training vs. post-training). The instrument demonstrated significant attitudinal change across multiple target dimensions:

• Attitudes toward the importance of communication and mutual support showed statistically significant positive shifts ($t = 3.42, p < .01$), reflecting increased appreciation of non-technical skills relative to pure technical skill.
• Recognition of personal limitations under fatigue and operational pressure shifted favorably ($t = 2.89, p < .01$), indicating a reduction in overconfidence and invulnerability beliefs.
• Criterion-related behavioral validation was demonstrated by O’Connor et al. (2002) in a simulated offshore emergency control room environment: teams whose members scored higher on the OAQ pre-test exhibited significantly higher behavioral non-technical performance ratings (evaluated via structured behavioral markers across situation assessment and task delegation) during simulated major emergency response scenarios ($r = .38, p < .05$).

Reliability

The psychometric evaluation of the Offshore Human Factors Questionnaire revealed critical insights regarding the internal consistency and measurement structure of safety attitude inventories in heavy industry.

Internal Consistency and the Cronbach’s Alpha Paradox

In the foundational validation study by O’Connor and Flin (2003), the internal reliability of the OAQ factors was calculated using Cronbach’s coefficient alpha ($lpha$). Across the original 30 items, the global scale demonstrated broad variability across subscales:

• Communication and Team Coordination: Initial 6-item configuration yielded an $lpha$ of $.58$, which improved to $lpha = .67$ following the deletion of ambiguous items.
• Personal Limitations: Initial 5-item configuration yielded an acceptable $lpha = .65$, rising to $lpha = .71$ when isolated to explicit fatigue and circadian disruption items.
• Situation Awareness: Demonstrated a moderate internal consistency of $lpha = .59$.
• Decision Making: Yielded an anomalous, negative Cronbach’s alpha ($lpha = -.14$).

The phenomenon of a negative or near-zero Cronbach’s alpha on the Decision Making factor warrants psychometric examination. In classical test theory, a negative alpha indicates that the average covariance among the items within the subscale is negative, violating the assumption of unidimensionality. O’Connor and Flin conducted iterative item-deletion procedures, dropping a total of nine items across the overall inventory to enhance the factor reliability coefficients. However, dropping items within the decision-making subscale failed to resolve the negative alpha.

This exact psychometric anomaly had previously been documented by Helmreich, Gregorich, and Wilhelm in their aviation CMAQ research. The underlying cause resides in the multidimensional, conflicting nature of operational decision-making attitudes in hazardous environments. For example, Item 16 (“I never take safety critical decisions of which I am not confident”) measures personal risk aversion and cognitive caution, whereas Item 23 (“My decision-making ability is as good in abnormal situations as in routine daily operations”) taps into situational overconfidence and perceived invulnerability. Because respondents who are self-aware and cautious disagree with Item 23 while simultaneously agreeing with Item 16, their response vectors correlate negatively when aggregated under a single “Decision Making” construct label. Consequently, applied psychometricians recommend scoring these items as independent, multidimensional indices rather than forcing them into a single additive composite scale.

Test-Retest Stability

In a baseline control cohort of offshore technicians who did not receive CRM training over a four-week operational offshore rotation cycle, the test-retest reliability of the OAQ subscales was examined. Pearson product-moment correlations between Time 1 and Time 2 scores demonstrated adequate temporal stability for Communication ($r = .74, p < .001$) and Personal Limitations ($r = .78, p < .001$), confirming that the instrument captures stable attitudinal states rather than transient daily mood states.

Factor Analysis

The latent structure of the Offshore Human Factors Questionnaire has been investigated using both Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) modeling approaches.

Exploratory Factor Analysis (EFA)

In the primary empirical validation, an exploratory principal components analysis (PCA) with orthogonal (Varimax) and oblique (Promax) rotations was performed on the 30-item matrix. A four-to-five factor solution was extracted based on the Kaiser-Guttman criterion (eigenvalues $> 1.0$) and scree plot inspection, accounting for approximately 42.6% of the total variance.

During this factor analytic procedure, nine items exhibited cross-loadings greater than $.35$ across multiple dimensions or failed to achieve a primary loading above $.35$ on any single factor. These items were iteratively culled to establish an abridged 21-item measurement model with superior structural clarity.

Confirmatory Factor Analysis (CFA) Considerations

Subsequent psychometric modeling has subjected the 21-item reduced OAQ to Confirmatory Factor Analysis using maximum likelihood estimation. An oblique four-factor structure (Communication, Personal Limitations, Situation Awareness, and Hierarchy) provides acceptable model fit indices in industrial samples ($\chi^2 / df < 2.2$; Comparative Fit Index $[CFI] = .91$; Tucker-Lewis Index $[TLI] = .89$; Root Mean Square Error of Approximation $[RMSEA] = .058$, $90%\text{ CI } [.049, .067]$). The CFA confirmed that modeling “Decision Making” as an independent latent factor fails to converge unless split into two distinct sub-dimensions: *Perceived Decisional Invulnerability* and *Collaborative Decision Sharing*.

Instrument / Measurement Tool

The standard complete presentation of the Offshore Human Factors Questionnaire is a 30-item, paper-and-pencil or computer-administered psychometric inventory. The operational specifications are detailed below:

• Instrument Designation: Offshore Human Factors Questionnaire (also referenced as the Offshore Attitude Questionnaire [OAQ] or Offshore Crew Resource Management Questionnaire).
• Primary Developer: Dr. Paul O’Connor and Prof. Rhona Flin (University of Aberdeen).
• Construct Lineage: Cockpit Management Attitude Questionnaire (CMAQ; Gregorich, Helmreich, & Wilhelm, 1990).
• Target Population: Offshore petroleum operations personnel, including drilling operators, production technicians, deck crews, maintenance engineers, and Offshore Installation Managers (OIMs).
• Item Count: 30 total items in the comprehensive operational version; 21 items in the refined psychometric research battery.
• Administration Time: Approximately 10 to 15 minutes.
• Response Format: 5-point Likert scale:
  • 1 = Strongly Disagree
  • 2 = Disagree
  • 3 = Neutral
  • 4 = Agree
  • 5 = Strongly Agree
• Demographic Sub-Categorization: Standard administrative sheets collect operational department data to facilitate cross-sectional analysis across:
  • Maintenance
  • Production
  • Other (e.g., Drilling, Marine, Logistics, Catering)
• Scoring and Directionality:
  • Positively Keyed Items: Reflect constructive non-technical attitudes (e.g., Item 5: “Good communication and crew co-ordination are as important as technical proficiency”). These items are scored directly: $1 = 1, 2 = 2, 3 = 3, 4 = 4, 5 = 5$.
  • Negatively Keyed / Reverse-Scored Items: Reflect hazardous attitudes, authoritarian hierarchies, or invulnerability beliefs (e.g., Item 1: “Team members should avoid disagreeing with others”; Item 13: “Even when fatigued, I perform effectively during critical phases of work”; Item 18: “Supervisors who encourage suggestions from team members are weak leaders”). These items must be reverse-coded prior to composite calculation: $1 = 5, 2 = 4, 3 = 3, 4 = 2, 5 = 1$.
  • Scale Aggregation: Subscale scores are derived by calculating the mean of the constituent items within that dimension, yielding a dimension score ranging from 1.0 to 5.0. Higher composite scores signify more favorable human factors and safety-supportive attitudes.

Permissions & Fee and Test Year

The Offshore Human Factors Questionnaire was developed in the late 1990s and formally published in peer-reviewed scientific literature by O’Connor and Flin in 2003 (Safety Science, Vol. 41, Iss. 7, pp. 591–609). As an instrument originating from university-based academic research funded under public and industry safety initiatives, the inventory items were published openly in the academic literature to advance safety culture and human factors training across the global oil and gas industry.

Academic researchers, educational institutions, and non-commercial safety analysts may utilize the instrument without royalty fees, provided appropriate scholarly citation and attribution are given to the original authors (O’Connor & Flin, 2003) and the publisher (Elsevier). Commercial applications, bespoke organizational consulting deployments, or integration into proprietary enterprise learning management systems typically require prior authorization or formal licensing agreements through the original copyright holders or the University of Aberdeen’s technology transfer office. Practitioners planning large-scale commercial deployments are advised to contact the authors directly.

References

• Cullen, W. D. L. (1990). The public inquiry into the Piper Alpha disaster (Vols. 1–2, Cm 1310). Her Majesty’s Stationery Office (HMSO).
• Endsley, M. R. (1995). Toward a theory of situation awareness in dynamic systems. Human Factors: The Journal of the Human Factors and Ergonomics Society, 37(1), 32–64. https://doi.org/10.1518/001872095779049543
• Flin, R., & O’Connor, P. (2001). Crew resource management for offshore teams. Offshore Research Focus, 45, 6–8.
• Flin, R., O’Connor, P., & Mearns, K. (2002). Crew resource management: Improving safety in high hazard industries. Team Performance Management: An International Journal, 8(3/4), 68–78. https://doi.org/10.1108/13527590210433366
• Flin, R., Martin, L., Goeters, K. M., Hörmann, H. J., Amalberti, R., Valot, C., & Nijhuis, H. (2003). Development of the NOTECHS (Non-Technical Skills) system for assessing pilots’ CRM skills. Human Factors and Aerospace Safety, 3(2), 95–117.
• Gregorich, S. E., Helmreich, R. L., & Wilhelm, J. A. (1990). The vendor factor: Psychometric evaluation of the Cockpit Management Attitudes Questionnaire. The International Journal of Aviation Psychology, 1(1), 31–44. https://doi.org/10.1207/s15327108ijap0101_3
• Helmreich, R. L., Merritt, A. C., & Wilhelm, J. A. (1999). The evolution of Crew Resource Management training in commercial aviation. The International Journal of Aviation Psychology, 9(1), 19–32. https://doi.org/10.1207/s15327108ijap0901_2
• O’Connor, P., & Flin, R. (2003). Crew resource management training for offshore teams. Safety Science, 41(7), 591–609. https://doi.org/10.1016/S0925-7535(02)00013-7
• O’Connor, P., Flin, R., & Fletcher, G. (2002). Techniques used to evaluate Crew Resource Management training: A literature review. Human Factors and Aerospace Safety, 2(3), 217–233.
• Reason, J. (1990). Human error. Cambridge University Press. https://doi.org/10.1017/CBO9781139062367
• Reason, J. (1997). Managing the risks of organizational accidents. Ashgate Publishing.
• Sexton, J. B., Thomas, E. J., & Helmreich, R. L. (2000). Error, stress, and teamwork in medicine and aviation: Cross sectional surveys. BMJ, 320(7237), 745–749. https://doi.org/10.1136/bmj.320.7237.745
• Weick, K. E., & Sutcliffe, K. M. (2001). Managing the unexpected: Assuring high performance in an age of complexity. Jossey-Bass.

13. Items of the Scale (Questionnaire)