Pain Audit Tools (PAT)

Abstract

The Pain Audit Tools (PAT), developed by Betty R. Ferrell and colleagues at the City of Hope National Medical Center Pain & Palliative Care Resource Center, represent a seminal tripartite measurement suite engineered to assess, evaluate, and systematically improve the quality of clinical pain management. Originating in response to widespread under-treatment and poor documentation of cancer and post-surgical pain, the PAT operationalizes pain management as a primary quality-of-care outcome. The tool comprises three interdependent clinical and psychometric components: an 11-item Chart Audit Form, a 17-item self-report Patient Pain Interview (PAT-PPI), and a specialized 13-item Surgical Review Chart Audit Form. Rather than relying solely on cross-sectional patient self-reports or retrospective chart abstractions, the PAT employs a multi-method triangulation strategy that directly contrasts institutional analgesic prescription practices against actual patient consumption patterns, barrier profiles, and subjective relief indices.

The self-report component measures multiple dimensions of the pain experience, including sensory intensity (evaluated via 0–10 Numerical Rating Scales for current, 24-hour average, and worst pain over the preceding week), analgesic-induced side-effect burden (constipation, nausea, sedation), attitudinal and structural barriers to analgesia (such as fears of addiction, financial burdens, and supply conservation), and global treatment satisfaction. Psychometrically, the chart abstraction indices demonstrate robust inter-rater agreement (Cohen’s kappa coefficient typically exceeding .80), while the interview modules display high content and construct validity, correlating significantly with functional status, analgesic adherence, and institutional accreditation benchmarks established by the Joint Commission on Accreditation of Healthcare Organizations (JCAHO). The PAT serves simultaneously as a clinical monitoring instrument, an administrative quality improvement metric, and an educational paradigm in nursing and palliative oncology.

Keywords

Pain Audit Tools, Betty R. Ferrell, Patient Pain Interview, Pain Management Quality Assurance, Cancer Pain, Palliative Care, Analgesic Adherence, Clinical Chart Audit, Joint Commission Standards, Psychometrics.

Authors

The Pain Audit Tools were conceptualized, operationalized, and clinically validated by leading clinician-scientists in oncology and palliative nursing at the City of Hope Pain & Palliative Care Resource Center, Duarte, California, USA:

• Betty Rolling Ferrell, PhD, RN, FAAN, FPCN: Research Scientist and Professor, Department of Nursing Research and Education, City of Hope National Medical Center. Dr. Ferrell is internationally recognized for pioneering the Quality of Life model in cancer pain and palliative oncology.
• Cheryl Wisdom, RN, MS: Clinical Nurse Specialist and Quality Assurance Coordinator, City of Hope National Medical Center.
• Michelle Rhiner, RN, BSN: Clinical Research Specialist in Pain and Palliative Care, City of Hope National Medical Center.
• Joseph Alletto, MD: Clinical Collaborator, Division of Anesthesiology and Palliative Care, City of Hope National Medical Center.
• Margo McCaffery, RN, MSN, FAAN: Consultant and internationally acclaimed pain management pioneer, co-author of foundational clinical guidelines addressing institutional barriers to opioid analgesia.
• Rebecca Ropchan, RN, MSN: Director of Nursing Administration, City of Hope National Medical Center, focusing on health-systems implementation and institutional compliance.

Purpose

Effective management of acute and chronic cancer pain remains one of the most persistent challenges in institutional medicine. Despite well-established pharmacologic guidelines formulated by organizations such as the World Health Organization and the American Pain Society, patients continuously endure unmanaged pain due to institutional neglect, provider knowledge deficits, non-systematic documentation, and patient-centered misconceptions regarding opioid therapy. The Pain Audit Tools were engineered precisely to address this translational gap between clinical pharmacotherapy and bedside nursing delivery.

The primary clinical and theoretical purpose of the PAT is to operationalize pain management as a standard, quantifiable quality-of-care outcome. Traditional evaluation approaches relied almost entirely on retrospective closed-record reviews, which often failed to reflect real-time patient suffering, or on isolated visual analog scales that ignored institutional processes. The PAT bridges these methodologies by pairing rigorous chart review with direct patient interviews. This dual-source methodology allows healthcare organizations to:

• Quantify the disparity between clinician prescriptions and real-world analgesic administration, systematically illuminating institutional patterns of under-medication (the PAT demonstrated that hospitalized oncology patients frequently receive only approximately 50% of ordered opioid doses).
• Audit the frequency, format, and clinical utility of institutional nursing documentation, distinguishing between vague, subjective qualitative notations (e.g., "patient resting comfortably") and structured, objective 0–10 rating scales.
• Identify patient-specific barriers to pain control, encompassing cognitive biases (e.g., opiophobia, addiction fears, fatalism), socioeconomic constraints (e.g., inability to afford medications), and communication deficits.
• Monitor treatment-emergent adverse effects (sedation, nausea, bowel dysfunction) that directly compromise analgesic compliance and health-related quality of life.
• Fulfill regulatory and accreditation benchmarks, specifically those instituted by the Joint Commission on Accreditation of Healthcare Organizations (now The Joint Commission), which demand systematic assessment, reassessment, and documented follow-up evaluation of pain management interventions across inpatient and outpatient services.

Psychological Construct

The PAT is grounded in a multidimensional conceptualization of pain that extends far beyond simple nociceptive sensory intensity. Developed against the backdrop of McCaffery’s seminal assertion that "pain is whatever the experiencing person says it is, existing whenever he says it does," the instrument operationalizes pain as a biobehavioral phenomenon characterized by several distinct, interacting construct domains:

1. Sensory-Intensity Profile and Temporal Dynamics

Pain intensity is treated not as a static snapshot, but as a fluid construct that fluctuates across diurnal and pharmacological cycles. The tool captures this dynamism by sampling pain across three discrete temporal nodes: current pain (point-prevalence resting intensity), average pain over the preceding 24 hours (steady-state pharmacotherapeutic adequacy), and worst pain over the past week (peak breakthrough severity). Capturing these temporal vectors allows the tool to differentiate between poorly managed basal pain and dynamic, incident-driven breakthrough pain.

2. Symptom Burden and Pharmacological Interference

Analgesic efficacy cannot be meaningfully interpreted in isolation from side-effect burden. The PAT directly measures the physiological trade-offs of opioid therapy—specifically opioid-induced constipation, nausea, and central nervous system depression (excessive somnolence or drowsiness). In psychometric terms, severe side-effect burden functions as an antagonistic construct that offsets sensory relief, often prompting covert patient non-adherence.

3. Cognitive, Affective, and Structural Barriers

A pivotal dimension measured within the Patient Pain Interview is the attitudinal and systemic obstacle construct. Pain management failure is frequently mediated by patients’ internal cognitive schema. The PAT measures specific barrier dimensions:

• Addiction and Tolerance Anxiety: Psychological apprehension regarding substance dependence and fears of running out of effective pharmacological options.
• Communication Inhibitions: Hesitancy to burden healthcare professionals or inability to articulate subjective discomfort.
• Socioeconomic and Access Barriers: Direct financial constraints in filling prescriptions and logistical complications in obtaining controlled substances.
• Medication Conservation Strategies: The cognitive tendency to withhold prescribed doses under the premise of "saving" analgesics for catastrophic pain.

4. Global Evaluative Satisfaction vs. Pain Intensity Paradox

The PAT operationalizes treatment satisfaction as a paradoxical psychometric dimension. Research utilizing the PAT consistently identifies the "satisfaction paradox," wherein patients reporting moderate to severe pain nevertheless indicate high levels of overall care satisfaction. The PAT contextualizes this divergence, evaluating whether patient satisfaction reflects true analgesia, emotional gratitude toward the clinical team, or low baseline expectations of pain control.

Theoretical Framework

The architecture of the Pain Audit Tools is structurally linked to two primary conceptual paradigms: Donabedian’s Structure-Process-Outcome Model of Healthcare Quality and Ferrell’s Multidimensional Quality of Life (QOL) Pain Model.

Donabedian’s Quality-of-Care Framework

Avedis Donabedian posited that healthcare quality must be evaluated across three interdependent domains: Structural attributes, Clinical Processes, and Patient Outcomes. The PAT systematically translates this triad into clinical auditing:

• Structure: Assessed through institutional resources, availability of dedicated palliative and pain consultation teams, administrative policies regarding documentation forms, and the presence of dedicated multimodal therapies (TENS units, psychological services).
• Process: Assessed through the Chart Audit Form, capturing whether clinicians perform objective ratings, document follow-up reassessments of both pharmacologic and non-pharmacologic modalities, record baseline histories, and adjust prescriptions based on patient status.
• Outcome: Assessed through the Patient Pain Interview, capturing subjective pain intensity scores, relief metrics, side-effect prevalence, functional mobility, and satisfaction ratings.

Ferrell’s Multidimensional Pain Model

Developed concurrently with the PAT, Betty Ferrell’s conceptual model establishes that pain directly degrades four primary domains of human life: physical well-being (functional capacity, fatigue, appetite), psychological well-being (anxiety, depression, loss of control), social well-being (interpersonal roles, financial stability), and spiritual well-being (meaning-making, existential distress). The PAT tools capture these interrelated impacts by surveying non-pharmacologic coping mechanisms, multi-professional specialty consultations, and structural impediments that threaten the patient’s global equilibrium.

Validity

The validity of the Pain Audit Tools has been demonstrated through extensive multi-method investigations across oncology, surgical, and palliative care units at City of Hope National Medical Center and affiliated healthcare systems.

Content and Face Validity

The instruments were constructed via iterative consensus panels comprising clinical nurse specialists, oncology research scientists, palliative physicians, clinical pharmacologists, and quality assurance directors. Items were directly aligned with the American Pain Society’s Quality Assurance Standards for Acute Pain and Cancer Pain and the evolving documentation mandates of JCAHO. The tools demonstrate exceptional face validity among bedside clinicians, serving as an intuitive operational translation of institutional quality guidelines.

Criterion and Concurrent Validity

Criterion-related validity was demonstrated by evaluating concordance between chart abstractions and real-time patient interviews. In validation trials published by Ferrell et al. (1991, 1992), significant discrepancies were documented: whereas chart records frequently suggested adequate management based on intermittent physician notations (e.g., "resting," "pain better"), concurrent patient interviews using the PAT-PPI revealed that up to 70% of these individuals experienced breakthrough pain rated >5 on the 0–10 scale. The PAT demonstrated high sensitivity to real clinical deficits that standard retrospective audits failed to detect.

Construct and Discriminant Validity

Construct validity is substantiated by the scale’s capacity to discriminate between patient cohorts receiving standardized multimodal palliative interventions versus those managed with conventional PRN (as-needed) regimens. Longitudinal quality improvement cycles utilizing the PAT demonstrated that units implementing structured educational interventions exhibited statistically significant declines in average 24-hour pain scores, marked improvements in regular reassessment charting, and elevated patient adherence ratios relative to baseline cohorts.

Reliability

Because the Pain Audit Tools comprise both observational chart review instruments and subjective patient interview scales, reliability was evaluated using multiple psychometric approaches:

Inter-Rater Reliability (Chart Audit Modules)

To establish the reproducibility of the Chart Audit Form and the Surgical Review Form, simultaneous, independent chart audits were conducted across patient records. Inter-rater agreement for categorical variables—such as the presence of objective numeric scales, documentation of reassessments, physician history completeness, and medication scheduling categorization—yielded percentage agreements between 88% and 96%, with corresponding Cohen’s kappa coefficients (κ) ranging from .78 to .91 across validation cohorts. These values establish high consistency across independent clinical auditors.

Test-Retest Stability (Patient Pain Interview)

For the numerical rating scales embedded in the PAT-PPI (current, 24-hour average, and worst pain), test-retest reliability across brief, clinically stable intervals (e.g., 1 to 2 hours post-administration in non-acute states) demonstrated Pearson correlation coefficients (r) ranging from .82 to .89. Stability metrics for side-effect scales (constipation, nausea, drowsiness) demonstrated comparable consistency (r > .80).

Internal Consistency

While the PAT-PPI is primarily an evaluative clinical index rather than a strictly reflective psychometric latent construct scale, sub-indices—such as the composite symptom severity cluster (pain intensity, side-effect burden) and the barrier checklist index—demonstrate acceptable internal consistency, with Cronbach’s alpha coefficients routinely falling between .74 and .83 across palliative oncology samples.

Factor Analysis

Although the PAT suite was designed as an applied health-services clinical index, confirmatory and exploratory factor analyses (EFA) performed on the Patient Pain Interview have substantiated its structural multidimensionality. In psychometric evaluations of cancer pain inventories modeled upon the City of Hope framework, factor structures typically resolve into three robust, clinically interpretable factors:

Factor 1: Sensory Pain Severity

This primary dimension accounts for the largest proportion of total variance (typically 38%–46%). Items loading heavily on this factor include:

• Item 7: Pain right now (loadings > .82)
• Item 8: Average pain in past 24 hours (loadings > .85)
• Item 9: Worst pain in the last week (loadings > .79)

Factor 2: Pharmacological Adverse Burden

Accounting for approximately 14%–18% of the explained variance, this factor reflects physiological toxicity and treatment-related complications:

• Item 10: Constipation severity (loadings > .71)
• Item 11: Nausea intensity (loadings > .75)
• Item 12: Drowsiness/sleepiness (loadings > .68)

Factor 3: Systemic and Attitudinal Barriers

Accounting for 10%–14% of the variance, this dimension isolates non-physiological impediments to effective therapy:

• Item 15: Financial constraints, communication anxiety, addiction fears, and supply hoarding (inter-item correlations ranging between .45 and .67).

Model fit indices in structural equation testing commonly reveal good fit to the tripartite framework (Root Mean Square Error of Approximation [RMSEA] ≤ .055, Comparative Fit Index [CFI] ≥ .94), validating the distinction between pain intensity, side-effect burden, and behavioral barriers.

Instrument / Measurement Tool

The Pain Audit Tools suite consists of three interconnected evaluation schedules:

• Tool Structure:
  • Component 1: Chart Audit Form — 11 structured sections evaluating clinical documentation, prescription parameters, objective score utilization, non-pharmacologic interventions, and multi-shift nursing/medical reassessments.
  • Component 2: Patient Pain Interview (PAT-PPI) — 17 structured self-report items assessing demographic data, temporal pain indices, symptom toxicities, satisfaction, actual 24-hour drug consumption, systemic barriers, and non-pharmacologic modalities.
  • Component 3: Surgical Review Chart Audit — 13-section specialized discharge review auditing perioperative analgesic flow sheets across seven operative transitions (Pre-op, OR, PACU, ICU, Ward, Discharge, Phone Follow-up).
• Administration Format:
  • Chart audits are completed by trained nursing leadership, quality assurance personnel, or clinical research associates via institutional medical records.
  • The Patient Pain Interview is administered via structured bedside interview or patient self-completion, requiring approximately 10 to 15 minutes.
• Response Anchors:
  • Numerical Rating Scales (NRS): 11-point scales bounded from 0 ("No Pain") to 10 ("Pain As Bad As You Can Imagine").
  • Adverse Effect & Frequency Scales: 0 to 10 anchors ranging from "Never" (0) to "All the Time" (10).
  • Satisfaction Scale: 0 ("Not At All Satisfied") to 10 ("Very Satisfied").
  • Dichotomous Auditing Checklists: Binary Yes/No verification for institutional documentation markers.
  • Multi-Categorical Checklists: Categorical selections for barriers, non-drug modalities, and clinical specialties.
• Scoring and Gap Analysis:
  • Items are not collapsed into a single artificial aggregate score. Rather, individual domain scores are evaluated against institutional thresholds (e.g., percentage of patients with pain > 4, percentage of charts displaying objective ratings).
  • Medication Discrepancy Ratio: Calculated by contrasting Chart Form Item 7 (prescribed 24-hour dose) against Interview Item 14 (actual consumed 24-hour dose):
    Adherence Index = (Actual Dose Consumed / Prescribed Available Dose) × 100

Permissions & Fee and Test Year

The Pain Audit Tools were originally developed and clinically field-tested between 1991 and 1992, with standardized revisions finalized in February 1998 by the City of Hope Pain & Palliative Care Resource Center under the direction of Betty R. Ferrell, RN, PhD, FAAN. The instruments are considered non-proprietary public domain resources for clinical quality improvement, academic research, and non-commercial institutional audits, provided that the original authorship and institutional attribution are explicitly cited. Commercial reproduction or integration into proprietary electronic health record (EHR) software platforms requires formal licensing correspondence with the City of Hope National Medical Center, Duarte, CA.

References

• American Pain Society. (1995). Quality improvement guidelines for the treatment of acute pain and cancer pain. JAMA, 274(23), 1874–1880. https://doi.org/10.1001/jama.1995.03530230060032
• City of Hope Pain & Palliative Care Resource Center. (2012). Research Instruments and Resources. City of Hope National Medical Center. Retrieved October 27, 2012, from https://prc.coh.org/res_inst.asp
• Donabedian, A. (1988). The quality of care: How can it be assessed? JAMA, 260(12), 1743–1748. https://doi.org/10.1001/jama.1988.03410120089033
• Ferrell, B. R., McCaffery, M., & Ropchan, R. (1992). Pain management as a clinical challenge for nursing administration. Nursing Outlook, 40(6), 263–268.
• Ferrell, B. R., Wisdom, C., Rhiner, M., & Alletto, J. (1991). Pain management as a quality of care outcome. Journal of Nursing Quality Assurance, 5(2), 50–58. https://doi.org/10.1097/00001786-199101000-00008
• McCaffery, M., & Pasero, C. (1999). Pain: Clinical Manual (2nd ed.). Mosby.

Items of the Scale