Distress Tolerance Measure

Abstract

The Distress Tolerance Measure (Lass et al., 2023) is an open-ended psychometric and qualitative assessment protocol formulated to systematically investigate how individuals perceive, define, and contextualize their capacity to withstand negative and uncomfortable emotional states. Historically, psychometric instruments designed to quantify distress tolerance (DT)—such as the Distress Tolerance Scale (DTS; Simons & Gaher, 2005)—have operated under the fundamental, unverified assumption that respondents share a homogenous, stable understanding of semantic anchors such as “distress,” “stress,” and “upset.” Developed at the intersection of affective science and contextual behavioral science, the Distress Tolerance Measure addresses this critical measurement gap across 11 primary structured exploratory prompts. The instrument probes semantic conceptualizations, behavioral coping repertoires, perceived stability versus temporal malleability, and situational variance in affective endurance. In its foundational validation study among university students in the United States, respondent narratives were analyzed via rigorous reflexive thematic analysis adhering to Braun and Clarke (2006) and Nowell et al. (2017) guidelines. Intercoder reliability was evaluated using Maxwell’s Random Error coefficient (Maxwell, 1977), demonstrating exceptional coding stability across categorical domains with an average Maxwell’s RE of 0.95 (SD = 0.05). By unveiling profound lay divergences between “stress” and “distress,” as well as documenting systematic context-dependent shifts in tolerance capacity, the Distress Tolerance Measure provides an empirical and conceptual foundation for refining the construct validity, content validity, and clinical utility of contemporary emotion regulation assessments.

Keywords

Distress Tolerance, Concept Attitudes, Affective Science, Emotion Regulation, Construct Validity, Qualitative Psychometrics, Contextual Behavioral Science, Maxwell’s RE, Folk Psychology, State vs Trait

Authors

The Distress Tolerance Measure was conceptualized, designed, and psychometrically examined by a collaborative team of clinical psychologists and affective science researchers:

• Alisson N. S. Lass, Ph.D. — Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota, United States. Correspondence concerning the instrument should be addressed to Alisson N. S. Lass, Mayo Clinic, Department of Psychiatry and Psychology, 200 First St. SW, Rochester, MN 55902. Email: [email protected]. ORCID: 0000-0002-5263-7228.
• Jennifer C. Veilleux, Ph.D. — Department of Psychological Science, University of Arkansas, Fayetteville, Arkansas, United States. Dr. Veilleux is a recognized authority in emotion regulation, distress tolerance, and experiential avoidance paradigms.
• Hilary L. DeShong, Ph.D. — Department of Psychology, Mississippi State University, Starkville, Mississippi, United States. Dr. DeShong specializes in personality pathology, dimensional models of psychopathology, and emotional dysregulation.
• E. Samuel Winer, Ph.D. — Department of Psychology, The New School for Social Research, New York, New York, United States. Dr. Winer conducts extensive investigation into affective processing, reward devaluation, and psychometric theory. ORCID: 0000-0002-3817-874X.

Purpose

The primary purpose of the Distress Tolerance Measure is to critically investigate the ontological and semantic foundations underlying the self-assessment of distress tolerance. In contemporary psychological science, distress tolerance is conventionally operationalized as the perceived or behavioral ability to experience and endure negative emotional, physical, or cognitive states without resorting to maladaptive avoidance or escape behaviors (Leyro et al., 2010; Zvolensky et al., 2010). However, an enduring vulnerability in psychometric literature is the presumption of construct invariance at the linguistic level—specifically, the tacit assumption that research participants, psychotherapy patients, and clinical scientists operationalize terms such as “distress,” “stress,” and “upset” identically.

The Distress Tolerance Measure directly rectifies this theoretical vulnerability through an open-ended, structured qualitative inquiry designed to accomplish three principal measurement objectives:

• Semantic Boundary Clarification: To determine whether non-clinical lay individuals differentiate between the constructs of “stress,” “distress,” and being “upset,” or whether these terms function as interchangeable linguistic tokens. Conventional self-report scales (such as the DTS) frequently instruct respondents to rate items such as “Feeling distressed or upset is unbearable to me” without defining either word, risking significant construct contamination if participants equate distress with normative daily stress or minor irritation.
• Perceived Trait Stability versus Contextual Plasticity: To examine whether individuals perceive their distress tolerance capacity as a static, trait-like disposition or as a dynamic, context-dependent state. Standard quantitative questionnaires assign single global scores to individuals, implicitly modeling distress tolerance as a fixed psychological trait. The Distress Tolerance Measure empirically tests this assumption by querying temporal shifts across the lifespan as well as setting-based fluctuations (e.g., home versus school, private versus occupational domains).
• Behavioral Coping and Ecological Elicitation: To map the real-world behavioral repertoires individuals deploy when confronting states of high negative affect, and to document the everyday ecological triggers that individuals classify as genuinely “distressing” versus merely “upsetting” or “stressful.”

In research contexts, the instrument serves as an essential qualitative diagnostic tool for validating and refining quantitative survey items, ensuring that the nomological network of distress tolerance aligns with actual human phenomenology. Clinically, the measure provides clinicians working in Dialectical Behavior Therapy (DBT), Acceptance and Commitment Therapy (ACT), and Cognitive Behavioral Therapy (CBT) with an individualized idiographic assessment of how patients define their distress, identify specific vulnerability contexts, and articulate perceived limits in distress endurance.

Psychological Construct

The construct assessed by the Distress Tolerance Measure is multidimensional, interrogating both the semantic architecture and the subjective phenomenological experience of distress tolerance. In general psychometrics, distress tolerance encompasses an individual’s perceived capacity to experience negative psychological states (perceived DT) as well as behavioral persistence under laboratory-induced stressors such as breath-holding, cold pressor immersion, or carbon dioxide challenge (behavioral DT). The Distress Tolerance Measure investigates the cognitive appraisals, beliefs, and folk concepts that constitute the subjective core of perceived distress tolerance.

1. Semantic and Conceptual Boundaries (Distress vs. Stress vs. Upset)

A fundamental dimension explored by this measure is conceptual discrimination. Within academic affective science, “stress” typically refers to an organismic physiological and cognitive state elicited by demands that tax or exceed available resources, whereas “distress” denotes a severe, aversive subjective emotional state characterized by psychological pain, helplessness, or acute dysphoria. When laypersons evaluate their ability to “tolerate distress,” psychometric precision depends on whether they are rating their endurance of mild schedule overload (stress) or intense psychic agony (distress). The measure explicitly evaluates the cognitive criteria individuals utilize to demarcate these affective phenomena.

2. Behavioral Manifestations and Response Repertoires

Rather than presuming distress tolerance to be purely internal, the construct encompasses intentional actions taken in response to distress. The measure explores behavioral action tendencies—such as avoidance, social withdrawal, active problem-solving, cognitive rumination, or substance misuse. By capturing self-reported behavioral expressions across varying emotional intensities, the construct captures the behavioral correlates of experiential avoidance versus mindful willingness.

3. Temporal Stability and Lifespan Plasticity

Traditional personality models often conceptualize emotion regulation capacities as stable dispositional traits. In contrast, the construct probed by Lass et al. (2023) frames distress tolerance as a potentially developmental and evolving competency. The measure queries experiential transitions wherein stimuli previously deemed intolerable ceased to elicit distress, or conversely, where novel vulnerabilities emerged over time. This captures the dynamic trajectory of distress tolerance across developmental transitions.

4. Situational and Environmental Contingency

Distress tolerance does not operate in an ecological vacuum. A central dimension of the construct is environmental moderation: how perceived tolerance thresholds expand or contract across social, familial, and professional spheres. For instance, an individual may exhibit high functional distress endurance in high-stakes occupational settings due to external social expectations or professionalism norms, yet demonstrate marked emotional collapse or intolerance within intimate domestic environments where self-regulatory reserves have been exhausted.

5. Inhibitory and Exacerbating Modifiers

The final dimension of the construct encompasses internal and external factors that erode psychological fortitude. Physiological states (sleep deprivation, physical exhaustion, somatic pain), cognitive load, resource depletion, and acute interpersonal conflict serve as modulating parameters that determine the momentary threshold of an individual’s distress tolerance reserve.

Theoretical Framework

The Distress Tolerance Measure is anchored in Functional Contextualism and the overarching framework of Contextual Behavioral Science (CBS) (Hayes et al., 2004). Functional contextualism posits that psychological phenomena cannot be understood in isolation from their historical and situated context. When an individual claims, “I cannot tolerate feeling upset,” contextual behavioral science asserts that the validity, meaning, and function of that statement are intimately tied to the individual’s learning history, verbal conditioning, and immediate environmental contingencies.

Integration with Gross’s Extended Process Model of Emotion Regulation

The instrument also interfaces directly with James Gross’s (2015) Extended Process Model of Emotion Regulation. Gross differentiates between the identification, selection, implementation, and monitoring of emotion regulatory strategies. Distress tolerance is centrally implicated in the valuation and selection phases: individuals must first identify whether an internal state is aversive enough to warrant regulation, evaluate whether that state is harmful or tolerable, and determine whether regulatory action is required. If a person conceptualizes all distress as pathological or hazardous, they will inevitably engage in immediate, often impulsive, down-regulatory efforts (e.g., substance consumption, behavioral escape), bypassing healthy emotional habituation.

Wittgensteinian Language Games and Prototype Theory

Epistemologically, the theoretical framework relies upon Ludwig Wittgenstein’s philosophy of language games and Eleanor Rosch’s Prototype Theory. Standard psychological tests operate under classical categorism, assuming that emotional terms possess strict, mutually agreed-upon necessary and sufficient conditions. In contrast, Lass et al. (2023) utilize prototype theory, recognizing that lay terms such as “upset,” “stress,” and “distress” occupy fuzzy semantic spaces defined by family resemblances. The theoretical rationale contends that failing to investigate how respondents navigate these semantic boundaries introduces profound systematic measurement error into quantitative psychometrics.

Validity

Because the Distress Tolerance Measure is primarily an exploratory, open-ended qualitative and mixed-methods survey, its validation diverges from traditional quantitative psychometric metrics such as Pearson correlation matrices or structural equation models. Instead, it was evaluated using rigorous principles of qualitative construct validity, semantic validity, and content validation (Nowell et al., 2017).

Empirical Evidence of Semantic Divergence (Construct Validity)

The primary validation evidence emerged from empirical narrative coding demonstrating that individuals do not treat “stress” and “distress” as equivalent constructs, directly challenging the construct validity of previous scales that conflate them:

• Qualitative Differentiation: In the validation sample (Lass et al., 2023), a decisive majority of participants explicitly indicated that “stress” and “distress” represented qualitatively distinct psychological phenomena (Item 8). Participants characterized “stress” as cognitive pressure, time demands, workload, and motivational arousal, whereas “distress” was conceptualized as an acute emotional crisis, existential despair, physical or somatic pain, or profound grief.
• Ecological Divergence: Qualitative coding revealed that the daily situations eliciting “stress” (e.g., academic deadlines, daily logistics) were markedly distinct from those eliciting “distress” (e.g., interpersonal betrayal, severe loss, identity dissolution). This proves high content validity for the open-ended format in teasing apart constructs that standardized Likert-scale questionnaires systematically blur together.

Ecological and Contextual Validity

Responses to Items 10 and 11 demonstrated robust ecological validity. When asked whether their capacity to tolerate distress remained stable across environments, participants overwhelmingly documented contextual variability. Tolerance was reported to diminish dramatically under conditions of physiological vulnerability (e.g., lack of sleep, hunger) and to shift depending on perceived social safety (e.g., tolerating distress stoically at work while exhibiting acute emotional breakdown at home). These empirical findings establish that the instrument effectively captures real-world contextual variance rather than abstract laboratory artifacts.

Reliability

In qualitative psychometrics, reliability is operationalized through the rigorous establishment of intercoder reliability (ICR), coding consistency, and methodological trustworthiness (Krippendorff, 2004). To ensure that the subjective responses to the Distress Tolerance Measure were classified with absolute scientific precision, Lass et al. (2023) implemented an exhaustive, multistage thematic coding methodology.

Coding Rigor and Thematic Framework

Textual responses were independently coded by trained clinical psychology raters according to the established reflexive thematic analysis recommendations of Braun and Clarke (2006) and the trustworthiness criteria outlined by Nowell et al. (2017). A comprehensive codebook was developed deductively and inductively, establishing precise operational definitions, inclusion rules, and exclusion benchmarks for each semantic category.

Intercoder Reliability Metric: Maxwell’s RE

Rather than relying solely on raw percentage agreement or standard Cohen’s kappa (which can become distorted when category frequencies are unbalanced), interrater agreement across all qualitative categories was calculated using Maxwell’s Random Error (RE) coefficient (Maxwell, 1977):

• Mean Intercoder Reliability: Across all coded categorical domains, the average value of Maxwell’s RE was 0.95 (SD = 0.05).
• Psychometric Interpretation: An RE value of 0.95 signifies near-perfect intercoder consistency, indicating that the thematic operationalizations developed for the Distress Tolerance Measure possess exceptional stability, reproducibility, and objectivity across independent evaluators.

Factor Analysis

Because the Distress Tolerance Measure is an exploratory, open-ended qualitative survey designed to elicit rich textual narratives rather than numerical Likert-scale ratings, no Exploratory Factor Analysis (EFA) or Confirmatory Factor Analysis (CFA) was conducted by the original authors (Lass et al., 2023). Classical factor analysis requires continuous or ordinal numeric covariance matrices, which cannot be computed directly from unquantified narrative paragraphs.

Thematic Structural Mapping as a Qualitative Analogue

In lieu of latent factor modeling, the authors performed hierarchical thematic structural mapping. This process functions as the qualitative analogue of latent variable identification, organizing textual responses into higher-order thematic clusters. Their thematic structural findings highlighted key conceptual dimensions:

• Affective Valence and Intensity: Differentiating low-level negative valence (“upset”) from high-arousal structural overload (“stress”) and catastrophic affective paralysis (“distress”).
• Locus of Demand: Classifying triggers into external environmental pressures (academic, occupational, financial) versus internal cognitive/somatic crises (existential rumination, physical agony).
• Functional Coping Orientations: Clustering responses into action-oriented problem solving, cognitive restructuring, social outreach, or passive/escapist avoidance.

The absence of traditional factor loadings reflects the authors’ deliberate psychometric critique: quantitative factor analyses of existing distress tolerance measures may yield mathematically tidy factor structures that nevertheless mask deep underlying semantic confusion among participants.

Instrument / Measurement Tool

The complete structural and administrative characteristics of the Distress Tolerance Measure are detailed below:

• Test Type: Qualitative Open-Ended Assessment / Mixed-Methods Survey Protocol.
• Format: Electronic administration (computer- or web-based survey platform) or written questionnaire.
• Number of Items: 11 core open-ended questions. Question 8 contains a conditional branching structure yielding four prospective sub-questions (8 N1, 8 N2, 8 N3 for negative respondents; 8 Y1 for affirmative respondents).
• Target Population: Adults (18 years of age and older). Validated primarily within university undergraduate and young adult populations in the United States.
• Language Available: English.
• Response Modality: Open-ended free-text entry. Respondents are specifically instructed to think carefully and write thorough, thoughtful answers consisting of approximately 2 to 4 complete sentences per item.
• Administration Time: Approximately 20 to 35 minutes, depending on typing speed and narrative depth.
• Scoring and Coding Guidelines:
  • Textual narratives are transcribed and categorized using qualitative thematic analysis (Braun & Clarke, 2006).
  • Codes are assigned across defined semantic nodes (e.g., conceptual definition of distress, specific behavioral coping categories, daily stressors, contextual modifiers).
  • Intercoder reliability must be audited across at least 20–25% of the sample narratives using Maxwell’s RE or equivalent reliability statistics to ensure coding fidelity.

Permissions & Fee and Test Year

The Distress Tolerance Measure was formally introduced to the scientific literature in 2023 by Alisson N. S. Lass, Jennifer C. Veilleux, Hilary L. DeShong, and E. Samuel Winer in their seminal article published in the Journal of Contextual Behavioral Science:

• Test Year: 2023.
• Access and Usage Rights: The instrument is non-commercial and is made available by the authors for non-profit academic research, scientific inquiry, and educational teaching purposes without royalty or user fees.
• Reproduction Guidelines: Researchers and clinicians utilizing the open-ended measure in formal studies or clinical protocols must appropriately cite the original validation publication (Lass et al., 2023).

References

The academic references underpinning the Distress Tolerance Measure and its theoretical framework are listed below in APA 7th edition format:

• Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
• Gross, J. J. (2015). Emotion regulation: Current status and future prospects. Psychological Inquiry, 26(1), 1–26. https://doi.org/10.1080/1047840X.2014.940781
• Hayes, S. C., Strosahl, K. D., & Wilson, K. G. (2004). Acceptance and Commitment Therapy: An experiential approach to behavior change. Guilford Press.
• Krippendorff, K. (2004). Reliability in content analysis: Some common misconceptions and recommendations. Human Communication Research, 30(3), 411–433. https://doi.org/10.1111/j.1468-2958.2004.tb00738.x
• Lass, A. N. S., Veilleux, J. C., DeShong, H. L., & Winer, E. S. (2023). What is distress tolerance? Presenting a need for conceptual clarification based on qualitative findings. Journal of Contextual Behavioral Science, 29, 23–32. https://doi.org/10.1016/j.jcbs.2023.05.003
• Leyro, T. M., Zvolensky, M. J., & Bernstein, A. (2010). Distress tolerance and psychopathological symptoms and disorders: A review of the empirical literature among adults. Psychological Bulletin, 136(4), 576–600. https://doi.org/10.1037/a0019712
• Maxwell, A. E. (1977). Coefficients of agreement between observers and their interpretation. British Journal of Psychiatry, 130(1), 79–83. https://doi.org/10.1192/bjp.130.1.79
• Nowell, L. S., Norris, J. M., White, D. E., & Moules, N. J. (2017). Thematic analysis: Striving to meet the trustworthiness criteria. International Journal of Qualitative Methods, 16(1), 1–13. https://doi.org/10.1177/1609406917733847
• Rosch, E. (1975). Cognitive representations of semantic categories. Journal of Experimental Psychology: General, 104(3), 192–233. https://doi.org/10.1016/0010-0285(75)90024-9
• Simons, J. S., & Gaher, R. M. (2005). The Distress Tolerance Scale: Development and validation of a self-report measure. Motivation and Emotion, 29(2), 83–102. https://doi.org/10.1007/s11031-005-7955-3
• Zvolensky, M. J., Vujanovic, A. A., Bernstein, A., & Leyro, T. (2010). Distress tolerance: Theory, measurement, and relations to psychopathology. Current Directions in Psychological Science, 19(6), 406–410. https://doi.org/10.1177/0963721410388642

Items of the Scale