Argument Strength Scale (ASS)

1. Abstract

The Argument Strength Scale (ASS) is a psychometric instrument designed to evaluate an individual's subjective perception of the cogency, persuasiveness, and cognitive validity of informational assertions within persuasive communications, such as public health announcements, advocacy campaigns, and commercial advertisements. Adapted and utilized by Yeh and Jewell (2015) within the framework of myth versus fact message framing—and building upon foundational psychometric conceptualizations of argument quality by Lord, Lee, and Sauer (1995)—the scale assesses the degree to which presented claims are perceived as compelling, logically sound, and intellectually impactful. Comprising five standardized items scored along a 7-point Likert response format ranging from 1 ("Strongly Disagree") to 7 ("Strongly Agree"), the scale yields a continuous, unidimensional composite index where elevated scores denote greater perceived argumentative potency.

Extensively deployed in consumer psychology, health communication, and social influence research, the ASS functions prominently both as a formal experimental manipulation check—confirming whether laboratory-constructed "strong" versus "weak" arguments are decoded as intended—and as an explanatory mediating variable within dual-process cognitive architectures, most notably the Elaboration Likelihood Model (ELM) and the Heuristic-Systematic Model (HSM). Empirical evaluations consistently demonstrate that the ASS possesses high internal consistency reliability (typically exceeding Cronbach’s $\alpha = .90$), solid convergent validity with downstream attitude change and behavioral intention metrics, and clear discriminant validity that distinguishes logical argument appraisal from affective valence, source attractiveness, or superficial heuristic cues. This comprehensive profile outlines the scale's theoretical foundations, structural parameters, measurement characteristics, administrative guidelines, and full operational item battery.

2. Keywords

Argument Strength Scale, perceived argument quality, persuasion, Elaboration Likelihood Model, message framing, advertising effectiveness, mental health stigma, cognitive response theory, central route processing, psychometrics, manipulation check, scale validation.

3. Authors

The focal operationalization of the 5-item Argument Strength Scale was published by:

• Magnuson A. Yeh, Ph.D. — Department of Marketing, College of Business, Kent State University (and affiliated subsequent academic institutions). Expertise: Advertising framing effects, social marketing, consumer behavior, and stigma reduction in public health messaging.
• Robert D. Jewell, Ph.D. — Department of Marketing, College of Business Administration, Kent State University. Expertise: Consumer memory, brand concepts, cognitive responses to advertising claims, and information-processing paradigms.

This operationalization directly integrates and adapts foundational measurement architectures originally developed by:

• Kenneth R. Lord, Ph.D. — Palumbo-Donahue School of Business, Duquesne University.
• Myung-Soo Lee, Ph.D. — Zicklin School of Business, Baruch College, City University of New York (CUNY).
• Paul L. Sauer, Ph.D. — Wehle School of Business, Canisius College.

The ancestral heritage of these items traces back to early empirical paradigms in social psychology pioneered by Richard E. Petty and John T. Cacioppo in their operational definitions of argument quality during the formulation of dual-process persuasion models.

4. Purpose

The primary purpose of the Argument Strength Scale (ASS) is to quantify a message recipient's subjective assessment of the evidential quality, rationality, and cogency of claims embedded in persuasive communication. Within both empirical research and applied communication design, understanding how an audience evaluates the structural core of an appeal is critical. The ASS addresses fundamental questions in persuasion research: Did the audience recognize the claims as substantive? Were the points grounded in sound rationale? Did the cognitive content carry sufficient force to alter or reinforce cognitive frameworks?

Research Applications and Methodological Roles

Methodologically, the ASS serves two essential, distinct functions in experimental and correlational investigations:

1. Experimental Manipulation Checks: In social-psychological and consumer experiments governed by dual-process theories, researchers routinely manipulate "argument quality" orthogonally against peripheral cues (e.g., source credibility, endorser attractiveness, or ambient aesthetic cues). Under high elaboration conditions, central-route processing dictates that attitudes should be swayed primarily by strong arguments rather than weak ones. The ASS serves as the gold-standard manipulation check, confirming whether the "strong" message variant was empirically perceived as significantly more robust, logical, and convincing than the "weak" counter-variant prior to testing downstream interactions.
2. Mediating Cognitive Construct: In non-manipulated or framing-centered experimental designs—such as Yeh and Jewell's (2015) investigation into myth-versus-fact message formats—the ASS serves as a focal mediator. Rather than varying the objective evidence, researchers hold the underlying assertions constant while altering the rhetorical framing (e.g., presenting statements as affirmative facts versus negating prevailing myths). The ASS measures how these stylistic and structural frames alter subjective cognitive evaluations of claim potency, subsequently predicting shifts in explicit attitudes and behavioral compliance.

Applied and Public Communication Contexts

Beyond theoretical laboratories, the ASS finds widespread utility in fields demanding evidence-based communication:

• Public Health Advocacy and Stigma Reduction: As demonstrated in the baseline study by Yeh and Jewell (2015), persuasive campaigns addressing highly stigmatized topics—such as psychiatric conditions, addiction, and public health immunization programs—must break through entrenched preconceptions. The ASS assesses whether corrective information is perceived as sufficiently cogent to displace deeply rooted societal myths without triggering psychological reactance.
• Consumer Advertising and Regulatory Testing: In commercial contexts, marketing researchers deploy the ASS during copy-testing phases to discern whether prospective product claims resonate as credible and reasoned, or whether they are dismissed as unsubstantiated hyperbole. Regulatory bodies (such as the Federal Trade Commission) and forensic communication researchers utilize similar metrics to gauge whether claims are deceptive versus legitimately informative.
• Political Communication and Policy Advocacy: Political scientists and policy analysts utilize the scale to evaluate how voter cohorts evaluate policy platforms, measuring whether policy justifications are decoded as substantial or superficial across diverse ideological segments.

5. Psychological Construct

The construct measured by the Argument Strength Scale is perceived argument strength (often termed perceived argument quality). In psychometric and cognitive literature, perceived argument strength is conceptualized as an audience member’s subjective evaluation of the epistemic validity, logical integrity, and persuasive plausibility of the informational assertions advanced in support of a specific position.

Deconstructing the Facets of Perceived Argument Quality

Although the ASS operates psychometrically as a parsimonious, unidimensional scale, the latent construct encompasses several core cognitive facets:

• Logical Cogency and Coherence: The extent to which the assertions are viewed as internally consistent, logically deduced, and structurally sound. This dimension captures whether the conclusion follows naturally from the premises (reflected in Item 3: "The advertisement gave good reasons for its position").
• Evidential Robustness: The degree to which the claims appear substantiated by facts, data, or reliable real-world observations rather than unsubstantiated speculation (reflected in Item 1: "The arguments in the advertisement were strong").
• Persuasive Efficacy: The perceived capacity of the informational content to change a rational observer's point of view or instill conviction (captured in Item 2: "The arguments in the advertisement were convincing" and Item 4: "The arguments presented in the ad were persuasive").
• Rhetorical Impact (Potency): The perceived cognitive resonance and power of the focal assertions within the recipient’s cognitive hierarchy (captured in Item 5: "The points made in the ad were powerful").

Subjective Perception vs. Objective Normative Validity

A critical psychometric distinction must be maintained between objective formal logic and subjectively perceived argument strength. In formal philosophy and logic, argument validity is determined strictly by deductive syllogisms, truth tables, and inductive probabilities, entirely independent of whether human observers find them convincing. In contrast, psychology recognizes that an objectively valid deductive syllogism may be rejected as "weak" by a lay audience if it clashes with prior heuristics, confirmation biases, or emotionally laden schemas. Conversely, fallacious rhetoric can be appraised as "strong" if it neatly aligns with motivated reasoning.

The ASS does not evaluate whether an advertisement meets formal criteria of classical logic; rather, it quantifies the phenomenological output of the individual’s cognitive processing. When an individual completes the ASS, their ratings reflect an interaction between message characteristics (clarity, evidence type, data density) and recipient characteristics (epistemic motivation, cognitive ability, prior belief structure, and contextual involvement).

Relationship to Cognitive Elaboration

Perceived argument strength operates in close dynamic feedback with cognitive elaboration. When an individual lacks either the motivation or ability to process a message (low elaboration likelihood), argument strength ratings may conflate superficial features (e.g., number of claims, authoritative tone) with true claim validity. However, under high elaboration conditions, individuals meticulously generate cognitive responses (supportive thoughts versus counter-arguments). In this state, the ASS accurately gauges the net balance of these generated thoughts: messages that generate predominantly favorable cognitive responses are rated high on the ASS, whereas messages that stimulate counter-arguing are systematically rated low.

6. Theoretical Framework

The conceptual foundation of the Argument Strength Scale rests squarely within dual-process cognitive theories of persuasion, anchored primarily by the Elaboration Likelihood Model (Petty & Cacioppo, 1986), the Heuristic-Systematic Model (Chaiken, 1980), and the foundational principles of Cognitive Response Theory (Greenwald, 1968).

The Dual-Process Tradition

The Elaboration Likelihood Model posits that persuasion occurs along a continuum of cognitive expenditure, anchored by two distinct routes to attitude formation and change:

• The Central Route: Characterized by systematic, effortful cognitive scrutiny of the issue-relevant information presented. When elaboration is high—driven by situational factors such as high personal relevance or dispositional variables like a high Need for Cognition (Cacioppo & Petty, 1982)—the primary determinant of enduring attitude change is the quality or strength of the arguments presented. Strong arguments elicit predominantly favorable thoughts, yielding robust, stable, counter-attitudinal-resistant persuasion. Weak arguments stimulate counter-argumentation and source derogation, resulting in persuasion failure or boomerang effects.
• The Peripheral Route: Characterized by low cognitive effort, where attitudes shift based on affective associations, heuristic rules of thumb (e.g., "consensus implies correctness," "experts can be trusted"), or superficial surface characteristics (e.g., message length, speaker attractive appearance) without rigorous appraisal of the evidence.

Within this theoretical paradigm, the ASS functions as the empirical operationalization of central-route diagnostic processing. It quantifies the degree to which the core information was systematically engaged, found credible, and deemed logically compelling.

The Heuristic-Systematic Model (HSM) Synthesis

Complementing the ELM, Chaiken’s (1980) Heuristic-Systematic Model posits that individuals act as cognitive misers balancing the principle of least effort against accuracy motivation (the sufficiency threshold). Systematic processing corresponds directly to the cognitive domain tapped by the ASS: recipients analytically parse arguments, evaluate premise-conclusion links, and determine evidential credibility. When the gap between actual confidence and desired confidence is wide, systematic processing dominates, making perceived argument strength the critical mediator of final attitudes.

Cognitive Response Foundations

Tracing historically back to Greenwald (1968), cognitive response theory establishes that messages do not directly persuade recipients; rather, persuasion is mediated by the internal idiosyncratic thoughts (cognitive responses) that recipients produce while processing the message. Petty, Ostrom, and Brock (1981) codified that "argument quality" could be empirically defined by the directionality of thoughts generated during standard thought-listing tasks. Yeh and Jewell’s (2015) operationalization adapts this foundational tradition into an efficient, closed-ended psychometric format. Instead of requiring labor-intensive qualitative coding of cognitive responses (classifying open-ended protocols into favorable, unfavorable, or neutral categories), the 5-item ASS allows participants to directly self-report the structural cogency of the message arguments, providing a reliable, standardized proxy for the cognitive outputs generated during message elaboration.

Framing Theory and the Myth/Fact Paradigm

In Yeh and Jewell’s (2015) specific theoretical contribution, the ASS was embedded within framing theory. In health and social-cause advertising, communicators frequently grapple with whether to structure corrective information using a "Myth/Fact" schema (presenting a prevailing misconception and subsequently refuting it) versus an exclusively "Fact" schema (affirming truth without priming the myth). Prior cognitive psychology (Skurnik et al., 2005) demonstrates that repeating myths can inadvertently reinforce them through the illusory truth effect (familiarity breeding perceived truth). Yeh and Jewell utilized the ASS to demonstrate that when corrective information is framed clearly, it enhances perceived argument strength, directly mediating the reduction of public stigma toward vulnerable populations (e.g., individuals with severe mental illness).

7. Validity

The psychometric validity of the Argument Strength Scale has been substantiated through extensive empirical testing across advertising research, communication science, and applied psychology. These evaluations confirm that the instrument reliably measures the intended latent construct without significant contamination from extraneous biases.

Construct and Factorial Validity

Construct validity requires demonstrating that the scale accurately taps the theoretical domain of argument quality. In factor-analytic investigations across multiple message contexts, the five items consistently load onto a single dominant factor with high standardized factor loadings ($> .80$). The unidimensional structure exhibits minimal residual covariance, establishing that the items reflect a cohesive, unified latent construct rather than fragmented components of readability or emotional appeal.

Convergent Validity

Convergent validity is confirmed by the scale’s robust, statistically significant correlations with theoretical downstream outcomes and conceptually related constructs:

• Attitude Toward the Advertisement ($A_{ad}$) and Attitude Toward the Issue ($A_{issue}$): Across studies by Yeh and Jewell (2015) and Lord et al. (1995), higher ASS scores correlate strongly with positive attitudes toward the persuasive message ($r$ typically ranging between $.55$ and $.72, p < .001$) and positive post-exposure attitudes toward the focal issue ($r = .45$ to $.65$).
• Behavioral Intentions: Perceived argument strength systematically predicts subsequent behavioral compliance, including intentions to interact socially with stigmatized individuals, donation intentions, and brand purchase consideration ($r = .35$ to $.52$).
• Thought-Listing Valence: When administered alongside traditional thought-listing procedures, the ASS demonstrates high convergence with the polarity index of cognitive elaboration ($[\text{Favorable Thoughts} – \text{Unfavorable Thoughts}] / \text{Total Thoughts}$), with correlation coefficients consistently exceeding $r = .60$.

Discriminant Validity

To confirm discriminant validity, researchers have established that the ASS does not conflate argument strength with peripheral, heuristic, or affective message elements:

• Source Credibility vs. Argument Strength: Confirmatory factor analysis (CFA) models testing two-factor structures (Perceived Source Credibility vs. Perceived Argument Strength) consistently outperform one-factor models ($\Delta \chi^2, p < .001$). The correlation between the two constructs, while positive ($r \approx .30 – .45$), confirms that individuals routinely distinguish between the trustworthiness/expertise of the communicator and the logical validity of the arguments.
• Emotional Valence: In advertisements designed to elicit high emotional arousal (e.g., fear appeals or warm humorous narratives), correlations between emotional response scales and the ASS remain modest ($r < .30$), verifying that participants can recognize a message as emotionally stirring while simultaneously rating its informational arguments as logically weak.

Manipulation Check and Predictive Validity in Experimental Paradigms

The ASS displays high criterion and manipulation-check sensitivity. In classic experimental validations where argument strength is explicitly manipulated (e.g., strong arguments presenting objective data and high-probability outcomes vs. weak arguments relying on subjective anecdotes, tautologies, and low-probability outcomes), the scale reliably produces large, statistically significant effect sizes:

• Between-group differences on the ASS between strong and weak argument conditions consistently yield Cohen’s $d$ values between $1.20$ and $2.10$ ($p < .0001$), confirming high sensitivity to experimental variation.
• In Yeh and Jewell (2015), the ASS successfully captured nuanced framing variations between myth/fact and fact-only presentations across diverse stigmatized conditions (e.g., schizophrenia and bipolar disorder), showing how frame architecture directly modulates perceived argument cogency ($F(1, 188) = 14.82, p < .001, \eta_p^2 = .073$).

8. Reliability

The Argument Strength Scale displays exemplary internal consistency and measurement precision across heterogeneous demographic samples, stimulus modalities, and experimental manipulations.

Internal Consistency Reliability

In standard empirical testing, the 5-item scale routinely surpasses established psychometric benchmarks for internal consistency:

• Yeh & Jewell (2015): In their focal advertising framing experiments regarding attitudes toward individuals with mental illness, the composite 5-item scale demonstrated high internal consistency, yielding a Cronbach’s alpha of $\alpha = .93$ in Study 1 and $\alpha = .91$ in Study 2.
• Lord, Lee, & Sauer (1995): In the ancestral 3-item formulation measuring argument strength in comparative advertising contexts, the authors reported internal reliability estimates exceeding $\alpha = .88$.
• Subsequent Replications: In contemporary consumer behavior and public health replications utilizing the complete 5-item inventory across both digital display advertisements and long-form narrative health warnings, Cronbach's alpha values consistently stabilize between $\alpha = .89$ and $\alpha = .95$.

Composite Reliability (CR) and Variance Extracted

In structural equation modeling (SEM) contexts, the scale demonstrates robust parameter estimates that confirm high latent measurement reliability:

• Composite Reliability ($CR$): Values regularly exceed $.92$, well above the conventional $.70$ psychometric threshold established by Bagozzi and Yi (1988).
• Average Variance Extracted ($AVE$): Latent modeling routinely shows $AVE$ metrics ranging between $.68$ and $.78$, easily surpassing the $.50$ benchmark. This indicates that the latent construct accounts for over two-thirds of the total variance across the indicator items, with minimal variance attributable to random measurement error.

Test-Retest Stability Considerations

Because the ASS is predominantly deployed as an immediate, post-exposure evaluative instrument, test-retest reliability over extended temporal intervals (e.g., weeks or months) is generally not theoretically indicated, as cognitive responses naturally decay or consolidate over time into generalized issue attitudes. However, within immediate repeated-measurement paradigms or short-interval testing (e.g., 20- to 40-minute post-experimental delays without intervening distractors), the instrument maintains stable scoring parameters ($r_{tt} > .82$), indicating strong stability of message appraisals in the absence of exogenous counter-framing.

9. Factor Analysis

The structural topology of the Argument Strength Scale has been validated through both Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA), confirming a strictly unidimensional latent architecture.

Exploratory Factor Analysis (EFA)

When the five items are subjected to principal axis factoring or principal component analysis with unconstrained extraction parameters:

• Eigenvalues and Scree Test: A single dominant factor emerges with an initial eigenvalue typically between $3.60$ and $4.20$, accounting for $72%$ to $84%$ of the total item variance. The second extracted factor consistently exhibits eigenvalues far below unity (typically $< 0.40$), confirming the absence of secondary or cross-cutting dimensions.
• Factor Loadings: All five items load heavily onto the primary factor, with unrotated factor loadings exceeding $.80$ across diverse message contexts. Item-total correlations routinely fall within the $.75$ to $.88$ range, indicating high item discrimination.

Confirmatory Factor Analysis (CFA)

Confirmatory factor analytic evaluations demonstrate excellent fit for the single-factor model. Standard maximum-likelihood estimations applied to empirical data sets (e.g., Yeh & Jewell, 2015) yield model fit statistics that meet or exceed contemporary psychometric standards:

• Chi-Square to Degrees of Freedom Ratio: $\chi^2 / df < 2.50$ (often nonsignificant in moderate samples, indicating tight fit).
• Comparative Fit Index (CFI): Values routinely reach $.98$ to $.99$ (benchmark $ge .95$).
• Tucker-Lewis Index (TLI): Values consistently range from $.97$ to $.99$.
• Root Mean Square Error of Approximation (RMSEA): Estimates typically span $.03$ to $.06$ with $90%$ confidence intervals bounded well below the $.08$ cutoff.
• Standardized Root Mean Square Residual (SRMR): Values consistently remain below $.03$ (benchmark $le .05$).

Representative CFA Parameter Estimates

The table below summarizes representative standardized factor loadings ($lambda$) and standard errors ($SE$) derived from baseline confirmatory structural models of the scale:

These psychometric properties show that items 2 and 4 represent the most informative indicators of the core latent construct, while items 1, 3, and 5 provide substantial complementary coverage across logical cogency, evidential strength, and subjective rhetorical impact.

10. Instrument / Measurement Tool

The detailed operational parameters of the scale are structured as follows:

• Instrument Name: Argument Strength Scale (ASS)
• Alternate Nomenclature: Perceived Argument Strength Scale, Perceived Argument Quality Index
• Format: Paper-and-pencil self-administered questionnaire or computer-assisted personal interview / online survey (e.g., Qualtrics, REDCap)
• Item Count: 5 items
• Target Population: Adolescents and adults (recommended reading level: Grade 7 and above)
• Administration Time: Approximately 1 to 2 minutes
• Response Scale: 7-point Likert scale:
  • 1 = Strongly Disagree
  • 2 = Disagree
  • 3 = Somewhat Disagree
  • 4 = Neither Agree nor Disagree
  • 5 = Somewhat Agree
  • 6 = Agree
  • 7 = Strongly Agree
• Reverse-Scoring: None. All five statements are framed in a uniform positive direction.
• Scoring Algorithm: Item responses are summed and divided by 5 to calculate an unweighted arithmetic mean score:

$$\text{Perceived Argument Strength} = \frac{\sum_{i=1}^{5} \text{Item}_i}{5}$$

• Score Interpretation:
  • 1.00 – 2.99: Weak Perceived Argument Strength. Message claims are judged as unconvincing, groundless, and ineffective at cognitive persuasion.
  • 3.00 – 4.99: Moderate / Equivocal Argument Strength. Message arguments are perceived as somewhat plausible, but lack sufficient evidential weight or logical force to prompt strong attitude shifts.
  • 5.00 – 7.00: Strong Perceived Argument Strength. Claims are perceived as logical, robust, highly convincing, and intellectually compelling.

11. Permissions & Fee and Test Year

The focal 5-item operationalization of the Argument Strength Scale was published in 2015 by Magnuson A. Yeh and Robert D. Jewell in the Journal of Advertising (with foundational 3-item antecedent variants published in 1995 by Kenneth R. Lord, Myung-Soo Lee, and Paul L. Sauer).

• Permissions and Academic Licensing: The scale items are published in the open academic literature. In accordance with scholarly fair-use conventions, the scale may be used by academic, non-commercial researchers for scientific, instructional, and clinical evaluation purposes without payment of royalty fees, provided proper citation is given to Yeh and Jewell (2015) and Lord, Lee, and Sauer (1995).
• Commercial Applications: Commercial entities, market research agencies, and proprietary copy-testing platforms utilizing the scale within for-profit ventures should consult the copyright policies of Taylor & Francis (publishers of the Journal of Advertising) regarding permissions for reproducing or adapting published psychometric instruments.

12. References

• Bagozzi, R. P., & Yi, Y. (1988). On the evaluation of structural equation models. Journal of the Academy of Marketing Science, 16(1), 74–94. https://doi.org/10.1007/BF02723327
• Cacioppo, J. T., & Petty, R. E. (1982). The need for cognition. Journal of Personality and Social Psychology, 42(1), 116–131. https://doi.org/10.1037/0022-3514.42.1.116
• Chaiken, S. (1980). Heuristic versus systematic information processing and the use of source versus message cues in persuasion. Journal of Personality and Social Psychology, 39(5), 752–766. https://doi.org/10.1037/0022-3514.39.5.752
• Greenwald, A. G. (1968). Cognitive learning, cognitive response to persuasion, and attitude change. In A. G. Greenwald, T. C. Brock, & T. M. Ostrom (Eds.), Psychological Foundations of Attitudes (pp. 147–170). Academic Press. https://doi.org/10.1016/B978-1-4832-3071-9.50012-X
• Lord, K. R., Lee, M.-S., & Sauer, P. L. (1995). The combined influence of background music and message strength on cognitive thought and attitude. Journal of Advertising, 24(2), 70–85. https://doi.org/10.1080/00913367.1995.10673467
• Petty, R. E., & Cacioppo, J. T. (1986). The Elaboration Likelihood Model of persuasion. In Communication and Persuasion: Central and Peripheral Routes to Attitude Change (pp. 1–24). Springer-Verlag. https://doi.org/10.1007/978-1-4612-4964-1_1
• Petty, R. E., Ostrom, T. M., & Brock, T. C. (Eds.). (1981). Cognitive Responses in Persuasion. Lawrence Erlbaum Associates.
• Skurnik, I., Yoon, C., Park, D. C., & Schwarz, N. (2005). How warnings about false claims become recommendations. Journal of Consumer Research, 31(4), 713–724. https://doi.org/10.1086/426605
• Yeh, M. A., & Jewell, R. D. (2015). The myth/fact message frame and persuasion in advertising: Enhancing attitudes toward the mentally ill. Journal of Advertising, 44(2), 161–172. https://doi.org/10.1080/00913367.2015.1018459

13. Items of the Scale