Ad Relevance Scale (ARS)

1. Abstract

The Ad Relevance Scale (ARS), initially operationalized by Smith, MacKenzie, Yang, Buchholz, and Darley (2007) under the designation ad-to-consumer relevance and subsequently refined within advertising research as meaningfulness (Lehnert, Till, & Ospina, 2014), is a concise, tri-item psychometric instrument designed to measure the degree to which an audience perceives a promotional message as personally meaningful, applicable, and contextually appropriate. In contemporary marketing psychology and consumer research, creativity is conceptualized not merely as novelty or artistic deviation, but as a dual-factor construct requiring both divergence (novelty, originality, elaboration) and relevance (meaningfulness, appropriateness, utility). Without perceived relevance, divergent stimuli often produce cognitive confusion, negative brand attribution, or sheer distraction. The ARS isolates the subjective connection forged between the advertisement’s narrative or thematic proposition and the consumer’s individual goals, values, and situational needs. Administered using a standard 7-point Likert scale ranging from 1 (Strongly Disagree) to 7 (Strongly Agree), the instrument demonstrates exceptional internal consistency (Cronbach’s alpha typically exceeding .88 to .93), robust convergent validity with measures of brand attitude ($A_{brand}$) and message elaboration, and distinct discriminant validity separating it from formal divergence measures. This article provides a comprehensive psychometric profile of the ARS, detailing its theoretical foundations in cognitive appraisal and schema theory, empirical factor structure, operational characteristics, and utility across both experimental psychology and applied consumer research.

2. Keywords

Ad Relevance Scale, ad-to-consumer relevance, advertising creativity, meaningfulness, message processing, consumer psychology, divergence-relevance model, scale validation, psychometrics, marketing communication.

3. Authors

The primary scale was developed and psychometrically validated by a research team led by Robert E. Smith:

• Robert E. Smith — Professor Emeritus of Marketing, Kelley School of Business, Indiana University Bloomington. Renowned for foundational research on consumer behavioral decision theory, advertising effects, and structural models of marketing creativity.
• Scott B. MacKenzie — Neal Gilliatt Chair and Professor Emeritus of Marketing, Kelley School of Business, Indiana University Bloomington. Highly recognized for structural equation modeling, psychometric measurement error, and attitude-toward-the-ad ($A_{ad}$) paradigms.
• Xiaojing Yang — Professor of Marketing, Darla Moore School of Business, University of South Carolina. Specializes in consumer creativity, information processing, and visual marketing.
• Laura M. Buchholz — Executive Director / Vice President of Brand Strategy and Market Insights, with deep expertise in applying psychometric models to commercial communication.
• William K. Darley — Professor of Marketing, School of Business Administration, University of Toledo. Expert in cross-cultural consumer psychology and advertising message response.

Significant secondary theoretical validation and psychometric extension were contributed by Kevin Lehnert (Indiana University of Pennsylvania), Brian D. Till (Marquette University), and Mariano Ospina (2014), who solidified the role of consumer-perceived meaningfulness within modern integrated marketing frameworks.

4. Purpose

The fundamental purpose of the Ad Relevance Scale (ARS) is to capture the audience-centric dimension of advertising creativity. For decades, consumer researchers and creative practitioners debated the structural definition of effective advertising. Early perspectives often overemphasized divergence—the structural or stylistic departure from normative, predictable promotional templates—under the assumption that bizarre, unconventional, or artistically sophisticated executions drive impact. However, experimental findings consistently demonstrated that divergent executions lacking psychological relevance alienate consumers, dilute brand associations, and fail to evoke target behaviors.

The ARS fulfills three essential research and applied functions:

• Diagnostic Validation in Advertising Testing: In pre-testing copy and developmental campaign screening, the ARS acts as a safeguard against “creative vanity”—campaign executions that win industry creative awards due to aesthetic or narrative novelty but fail to communicate personal value, applicability, or contextual relevance to prospective buyers.
• Disentangling Dual-Factor Creativity: Psychological research (Runco & Jaeger, 2012; Smith et al., 2007) posits that creativity requires both originality (divergence) and appropriateness (relevance). The ARS provides an unconfounded, parsimonious instrument to quantify the second pillar independently from novelty, allowing researchers to explore non-linear interactions, mediation models, and conditional processes between novelty and message uptake.
• Evaluating Motivational Processing: Grounded in the Elaboration Likelihood Model (ELM), the ARS measures a cognitive prerequisite for central-route processing. When consumers assess an advertisement as relevant, meaningful, and appropriate to them, their intrinsic motivation to devote working memory to deciphering message claims increases, directly influencing enduring schema integration and brand memory.

5. Psychological Construct

The psychological construct assessed by the ARS is ad-to-consumer relevance, defined as the degree to which an individual perceives an advertising execution as having personal significance, utility, contextual alignment, and communicative worth. In the broader conceptualization established by Smith et al. (2007), advertising relevance encompasses two distinct operational facets: ad-to-brand relevance (the extent to which execution elements link logically to the sponsor brand) and ad-to-consumer relevance (the extent to which execution elements link to the consumer’s life space). The ARS operationalizes the latter.

Ad-to-consumer relevance manifests through three core psychological markers:

Meaningfulness

Meaningfulness refers to the perceived depth and semantic richness of the execution. When an advertisement is meaningful, it is not dismissed as empty noise or trivial commercial clutter. Instead, the consumer perceives the narrative, proposition, or affective imagery as resonant with their existing self-schemas, life goals, cultural background, or personal dilemmas. A meaningful ad induces reflective cognition: the viewer recognizes that the message contains thematic content worthy of interpretation and mental rehearsal.

Relevance

Relevance represents perceived instrumental and subjective relatedness. Drawing from Sperber and Wilson’s Relevance Theory, cognitive inputs are relevant to an individual when they yield positive cognitive effects—such as updating beliefs, answering an active question, or addressing a felt need—with minimal unnecessary cognitive effort. In the context of the ARS, an ad is relevant when the consumer perceives that “this message speaks to people like me,” addressing problem states, aspirations, or contexts that belong to the respondent’s actual or aspirational reality.

Appropriateness

Appropriateness reflects perceived contextual fit, norm congruency, and social suitability. Even if an ad captures attention, it may fail if consumers view it as offensive, tone-deaf, unsuited to the product category, or jarringly inconsistent with situational expectations. Appropriateness captures the evaluative judgment that the promotional execution is fitting, sensible, and socio-cognitively acceptable given the consumer’s normative standards and situational context.

6. Theoretical Framework

The Ad Relevance Scale is deeply anchored in classic psychological, cognitive, and communicative theories:

The Dual-Criterion Definition of Creativity

In standard psychometric and cognitive definitions of creativity (Runco & Jaeger, 2012; Amabile, 1983), an artifact, idea, or response cannot be deemed creative solely on the basis of being unique or bizarre. If divergence occurs without utility or appropriateness, the result is characterized in psychological diagnostics as eccentric, aberrant, or psychotic rather than creative. Smith et al. (2007) systematically applied this framework to advertising by demonstrating that creative ads represent an optimal intersection: divergence provides the orienting reflex, curiosity, and perceptual pop, while relevance provides the grounding mechanism that converts fleeting sensory arousal into meaningful brand appraisal.

The Elaboration Likelihood Model and Cognitive Processing

According to the Elaboration Likelihood Model (Petty & Cacioppo, 1986), high-involvement message elaboration requires both the ability and the motivation to process information. Ad relevance serves as a primary antecedent of processing motivation. When an individual appraises an incoming stimulus as possessing high self-relevance, attentional resources are dynamically reallocated from ambient monitoring to focused focal-point processing. In contrast, advertisements characterized by high divergence but low relevance trigger high initial perceptual arousal that rapidly terminates in frustration or cognitive discounting, because the consumer cannot establish a functional bridge between the unusual creative imagery and their personal reality.

Schema Incongruity and Resolution Paradigms

Mandler’s (1982) schema congruity theory posits that moderate schema incongruity stimulates cognitive arousal and cognitive elaboration. When an ad is novel (divergent), it introduces schema incongruity. For this incongruity to generate positive affect and evaluative resolution, the viewer must discover a cognitive “rule” or contextual rationale that resolves the surprise. Ad-to-consumer relevance serves as this cognitive resolution mechanism: the consumer realizes that the initial structural surprise conveys an authentic, meaningful insight about their life, product use, or emotional experience.

7. Validity

The psychometric validity of the Ad Relevance Scale has been corroborated across numerous rigorous empirical investigations:

Construct and Convergent Validity

In the foundational validation study by Smith et al. (2007), involving structural equation modeling (SEM) across extensive consumer samples evaluating diverse television commercials, the three items exhibited extraordinarily high factor loadings on the latent ad-to-consumer relevance construct ($lambda ge .87$). The average variance extracted (AVE) routinely exceeds .75, substantially eclipsing the classic Fornell and Larcker (1981) benchmark of .50. This confirms that the variance captured by the construct is genuinely attributable to the underlying latent dimension of relevance rather than measurement artifact.

Discriminant Validity

Discriminant validity between the ARS and the multidimensional Ad Divergence Scale (which captures originality, flexibility, synthesis, elaboration, and artistic value) is cleanly demonstrated across studies. While divergence and relevance often correlate moderately in highly successful campaigns ($r pprox .25 ext{ to }.45$), multi-trait multi-method (MTMM) analyses and confirmatory factor analysis (CFA) nested model comparisons show that forcing divergence and relevance into a single-factor solution produces catastrophic degradation in model fit ($Deltachi^2, p < .001$). Furthermore, the ARS successfully discriminates from brand-to-consumer relevance and generic attitude toward the ad ($A_{ad}$), confirming that it measures a distinct cognitive appraisal rather than global affective liking.

Nomological and Predictive Validity

The scale demonstrates exceptional predictive utility across diverse consumer outcome metrics:

• Cognitive Elaboration: High scores on the ARS significantly predict the volume and depth of cognitive responses (thought-listing protocols), confirming theoretical predictions derived from the ELM.
• Attitude Formation: In structural path models, ad relevance exhibits strong direct paths to both attitude toward the ad ($A_{ad}$; $\eta pprox .40 ext{ to }.60$) and brand attitudes ($A_b$), while frequently moderating the path between creative divergence and purchase intent (Lehnert et al., 2014).
• Behavioral Intentions: When consumers rate an ad high on meaningfulness, relevance, and appropriateness, positive shifts in immediate purchase intentions and product recommendations are observed consistently across both fast-moving consumer goods (FMCG) and complex service categories.

8. Reliability

The Ad Relevance Scale displays consistently superior reliability statistics across diverse research settings, product categories, and media formats (print, television, digital video, and social advertising):

• Internal Consistency: In the initial validation by Smith et al. (2007), the composite reliability (CR) for the latent construct was reported at .91, with Cronbach’s alpha ($lpha$) exceeding .90 across separate developmental and validation samples. Subsequent replications (e.g., Lehnert, Till, & Ospina, 2014; Till, Baack, & Waterman, 2011) have reported internal consistency coefficients ranging between .88 and .94.
• Average Variance Extracted (AVE): The AVE across validation datasets consistently ranges from .74 to .83, indicating that over 74% of the operational variance in the indicators is accounted for by the latent ad relevance construct.
• Test-Retest Stability: While the ARS is designed as a stimulus-response instrument (meaning scores naturally vary across different creative treatments), short-interval test-retest administration of the same stimulus in controlled experimental laboratory conditions exhibits strong stability coefficients ($r_{tt} > .82$), demonstrating that individual differences in consumer appraisal are captured reliably without high transient measurement error.

9. Factor Analysis

Structural validation of the ARS has been thoroughly documented via both Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA):

Confirmatory Factor Analytic Results

In structural equation modeling runs evaluating the dimensional structure of advertising creativity, the tri-item ARS loads cleanly onto a single, robust first-order factor. Standardized factor loadings across published investigations consistently demonstrate exceptional magnitude:

• “The ad was meaningful to me” — Standardized loading $\lambda = .88 ext{ to }.93$
• “The ad was relevant to me” — Standardized loading $\lambda = .91 ext{ to }.95$
• “The ad was appropriate to me” — Standardized loading $\lambda = .84 ext{ to }.89$

Model Fit Indices

When specified within full measurement models comprising both divergence dimensions and relevance constructs, model fit indices routinely surpass all conventional psychometric criteria established by Hu and Bentler (1999):

• Comparative Fit Index (CFI) $ge .98$
• Tucker-Lewis Index (TLI) $ge .97$
• Root Mean Square Error of Approximation (RMSEA) $le .045$ (with 90% confidence intervals spanning .000 to .062)
• Standardized Root Mean Square Residual (SRMR) $le .025$
• Normed Chi-Square ($\chi^2 / df$) consistently between $1.2$ and $2.1$

Attempts to model the ARS as a multi-dimensional construct uniformly fail due to extreme inter-item correlation and multicollinearity among the three items, conclusively establishing that ad-to-consumer relevance operates as a strictly unidimensional cognitive judgment.

10. Instrument / Measurement Tool

• Instrument Name: Ad Relevance Scale (ARS) / Ad-to-Consumer Relevance Measure
• Target Construct: Perceived personal relevance, meaningfulness, and contextual appropriateness of an advertising execution
• Test Format: Self-administered questionnaire (paper-and-pencil or computerized/online survey platform)
• Number of Items: 3 items
• Item Phrasing: Fully standardized, positively worded self-report statements
• Response Scale: 7-point Likert scale (1 = Strongly Disagree to 7 = Strongly Agree)
• Administration Time: Under 1 minute (ideal for high-throughput multi-cell experimental designs and post-exposure copy tests)
• Scoring Procedure: Because all items are positively keyed, no reverse scoring is required. The global Ad Relevance score is computed by calculating the arithmetic mean of the three completed items:

$$\text{Ad Relevance Score} = \frac{\text{Item 1} + \text{Item 2} + \text{Item 3}}{3}$$

Composite scores range from 1.0 to 7.0, where higher values reflect superior levels of perceived personal meaningfulness and relevance.

11. Permissions & Fee and Test Year

• Year of Publication: 2007 (formalized in Marketing Science; refined in 2014 in the Journal of Advertising)
• Original Authors / Copyright Holders: Robert E. Smith, Scott B. MacKenzie, Xiaojing Yang, Laura M. Buchholz, and William K. Darley / INFORMS (Institute for Operations Research and the Management Sciences)
• Licensing and Fee Structure: The scale items were published directly within academic literature for scientific and educational use. No fee is required for non-commercial academic research, pedagogical evaluation, or university dissertations, provided appropriate academic citation is maintained. Commercial market testing organizations and proprietary software platforms utilizing the scale should respect publication copyrights and consult relevant journal reproduction policies.

12. References

• Amabile, T. M. (1983). The social psychology of creativity: A componential conceptualization. Journal of Personality and Social Psychology, 45(2), 357–376. https://doi.org/10.1037/0022-3514.45.2.357
• Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104
• Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
• Lehnert, K., Till, B. D., & Ospina, M. (2014). Advertising creativity: The role of divergence versus meaningfulness. Journal of Advertising, 43(3), 274–285. https://doi.org/10.1080/00913367.2014.935895
• Mandler, G. (1982). The structure of value: Accounting for taste. In M. S. Clark & S. T. Fiske (Eds.), Affect and Cognition: The 17th Annual Carnegie Symposium on Cognition (pp. 3–36). Lawrence Erlbaum Associates.
• Petty, R. E., & Cacioppo, J. T. (1986). The Elaboration Likelihood Model of persuasion. Advances in Experimental Social Psychology, 19, 123–205. https://doi.org/10.1016/S0065-2601(08)60214-2
• Runco, M. A., & Jaeger, G. J. (2012). The standard definition of creativity. Creativity Research Journal, 24(1), 92–96. https://doi.org/10.1080/10400419.2012.650092
• Smith, R. E., MacKenzie, S. B., Yang, X., Buchholz, L. M., & Darley, W. K. (2007). Modeling the determinants and effects of creativity in advertising. Marketing Science, 26(6), 819–833. https://doi.org/10.1287/mksc.1070.0272
• Smith, R. E., Chen, J., & Yang, X. (2008). The impact of advertising creativity on cognitive processing: A look with brain scans. Journal of Advertising Research, 48(4), 519–532. https://doi.org/10.2501/S0021849908080517
• Till, B. D., Baack, D., & Waterman, B. (2011). Strategic advertising creativity: An empirical look at consumer response to creative advertisements. Journal of Current Issues & Research in Advertising, 32(2), 29–45. https://doi.org/10.1080/10641734.2011.10505300

13. Items of the Scale