Ad Evaluative Judgment (Unipolar) (AEJU)

Abstract

The Ad Evaluative Judgment (Unipolar) (AEJU) scale is a specialized psychometric instrument designed to measure consumers’ conscious, cognitive, and evaluative appraisals of commercial advertising stimuli. Adapted by Aylesworth, Goodstein, and Kalra (1999) from the foundational affective and cognitive taxonomy established by Burke and Edell (1989), the AEJU captures an overall evaluative judgment construct using 13 unipolar adjective items: Believable, Convincing, Effective, Informative, Interesting, Meaningful, Natural, Original, Realistic, Useful, Well-done, Worth remembering, and Worth watching. Unlike traditional bipolar semantic differential scales (e.g., bad/good, unfavorable/favorable) that frequently conflate distinct cognitive dimensions or force artificial bipolarity upon asymmetric consumer perceptions, the AEJU isolates positive evaluative judgments along a unipolar continuum. Respondents rate the extent to which each adjective describes the target advertisement on a 7-point metric ranging from 1 (“Describes the ad very poorly” / “Not at all”) to 7 (“Describes the ad very well” / “Very well”). Psychometric evaluations consistently demonstrate that the AEJU possesses exceptional internal consistency reliability, with Cronbach’s alpha coefficients typically exceeding α = .90, robust convergent validity with global attitude-toward-the-ad ($A_{ad}$) measures, and strong discriminant validity against distinct emotional reaction constructs such as upbeat, warm, or negative feelings. Exploratory and confirmatory factor analytic studies support either an overarching unidimensional evaluative judgment factor or a closely coupled two-factor structure comprising “Informational/Credibility Utility” and “Executional/Engagement Quality.” This article offers an exhaustive psychometric review of the AEJU, analyzing its theoretical underpinnings within dual-mediation models, construct parameters, empirical validity, reliability metrics, structural dimensionality, and operational guidelines for academic researchers and copy-testing practitioners.

Keywords

Ad Evaluative Judgment, AEJU, Attitude toward the Ad, Burke and Edell, Advertising Effectiveness, Unipolar Measurement, Cognitive Appraisal, Copy Testing, Consumer Psychology, Psychometrics, Persuasion, Dual Mediation Hypothesis

Authors

The Ad Evaluative Judgment (Unipolar) scale in its concise 13-item form was operationalized and published by:

• Andrew B. Aylesworth — Department of Marketing, School of Business, Bentley University, Waltham, Massachusetts, USA. Primary research areas: consumer information processing, cognitive and affective responses to advertising, context effects, and non-conscious persuasion.
• Ronald C. Goodstein — McDonough School of Business, Georgetown University, Washington, D.C., USA. Primary research areas: brand equity, brand positioning, consumer advertising responses, and integrated marketing communications.
• Ajay Kalra — Jones Graduate School of Business, Rice University, Houston, Texas, USA. Primary research areas: quantitative modeling of consumer choice, marketing strategy, pricing, and advertising effectiveness.

The scale directly traces its theoretical lineage and item pool to the foundational scholarship on feelings and judgments in advertising developed by:

• Marian Chapman Burke — The Fuqua School of Business, Duke University, Durham, North Carolina, USA.
• Julie A. Edell — The Fuqua School of Business, Duke University, Durham, North Carolina, USA.

Purpose

The primary purpose of the Ad Evaluative Judgment (Unipolar) (AEJU) scale is to systematically quantify consumer cognitive appraisals and evaluative judgments regarding an advertisement’s content, execution, and persuasive value, independent of pure affective or visceral feeling states. For decades, consumer psychology and marketing research heavily relied upon global, bipolar semantic differential batteries (e.g., good/bad, pleasant/unpleasant, like/dislike) to capture Attitude toward the Ad ($A_{ad}$). While functional for macroscopic modeling, these global bipolar metrics obscure the specific cognitive mechanisms that drive persuasive outcomes and fail to delineate between an individual’s emotional reactions (e.g., feeling happy, amused, or irritated) and their rational evaluative judgments (e.g., determining that an advertisement is informative, credible, or well-crafted).

The AEJU addresses this diagnostic limitation. In contemporary advertising research, scholars require sensitive instruments capable of detecting subtle experimental manipulations, such as the introduction of archetypal embeds, varying levels of narrative transportation, subtle executional cues, or varying claim substantiations. In their 1999 study investigating whether archetypal embeds operate through direct affective conditioning or indirect cognitive routes, Aylesworth, Goodstein, and Kalra employed the AEJU to isolate cognitive evaluations of the commercial from ambient emotional feelings. By capturing dimensions such as believability, relevance, execution, and utility, the AEJU permits researchers to assess whether an advertising stimulus successfully communicates its intended message and commands cognitive respect from the target audience.

In applied copy testing and marketing analytics, the AEJU serves as an indispensable diagnostic tool. While an advertisement might evoke strong positive affect (e.g., humor or warmth), it may concurrently fail on critical evaluative dimensions (e.g., being perceived as unconvincing, unrealistic, or uninformative), resulting in poor brand recall and anemic behavioral intentions. Conversely, a highly informative advertisement may suffer from poor executional judgments if deemed “unnatural” or “not worth watching.” The AEJU allows media planners and creative directors to isolate executional strengths and deficiencies across distinct evaluative facets, thereby informing iterative creative revisions prior to multi-million-dollar media buys.

Psychological Construct

The construct measured by the AEJU is Ad Evaluative Judgment, conceptualized as a multi-faceted cognitive assessment of an advertisement’s persuasive merit, credibility, informative utility, and creative execution. Grounded in the cognitive appraisal tradition of social psychology and consumer research, evaluative judgments represent propositionally structured beliefs regarding the properties and quality of the stimulus, distinct from subjective feeling states (Edell & Burke, 1987).

The AEJU specifically utilizes a unipolar measurement framework. In traditional psychometrics, bipolar scales assume that positive and negative evaluations exist along a single diametrically opposed continuum (e.g., believable vs. unbelievable). However, psychological research demonstrates that cognitive evaluations are often asymmetrical; the absence of a positive attribute does not necessarily imply the presence of its direct opposite. By utilizing unipolar positive adjectives, the AEJU measures the absolute degree of presence of positive evaluative attributes without forcing respondents into bipolar assumptions. The scale deliberately excludes overtly negative items (e.g., boring, irritating, deceptive) to capture a dedicated, clean latent vector of positive cognitive endorsement.

The 13 items comprising the AEJU reflect several core sub-facets of cognitive appraisal:

• Credibility and Veracity Appraisals: Captured by Believable, Convincing, and Realistic. These items reflect the recipient’s assessment of the advertisement’s truthfulness, plausibility, and persuasive validity. Consumers process commercial claims through skepticism filters; high scores on these items indicate that the message has successfully navigated counter-arguing hurdles.
• Informational Utility: Captured by Informative and Useful. These items measure the perceived functional value of the information communicated. Grounded in utilitarian processing models, they reflect whether the consumer believes the advertisement contributed actionable, meaningful knowledge regarding the advertised brand or problem solution.
• Engagement and Aesthetic Quality: Captured by Interesting, Meaningful, Original, and Natural. These items gauge the creative and stylistic execution of the advertisement. They assess whether the ad engages the viewer’s attention, avoids artificial or stilted staging, displays creative novelty, and resonates at an intellectual or personal level.
• Executional Excellence and Memorable Value: Captured by Effective, Well-done, Worth remembering, and Worth watching. These summary evaluative appraisals measure the overall craftsmanship and perceived return on the viewer’s invested attention. They reflect a meta-cognitive judgment that the advertisement was worth the consumer’s cognitive capacity and time.

Theoretical Framework

The theoretical architecture underpinning the AEJU is rooted in modern persuasion theory, specifically integrating the Dual Mediation Hypothesis (DMH), the Elaboration Likelihood Model (ELM), and Burke and Edell’s integrative model of consumer response to advertising.

The Dual Mediation Hypothesis, formulated by MacKenzie, Lutz, and Belch (1986), posits that attitudes toward the advertisement ($A_{ad}$) influence brand attitudes ($A_b$) and purchase intentions ($PI$) through two simultaneous routes: directly, via classical affective conditioning, and indirectly, via cognitive processing of brand claims (brand cognitions, $C_b$). Burke and Edell (1989) expanded this paradigm by demonstrating that $A_{ad}$ is not a monolithic affective reaction, but rather a composite construct determined by two separate, interacting systems: subjective affective feelings experienced during exposure (warmth, upbeat feelings, negative feelings) and conscious evaluative judgments about the advertisement itself.

Within this theoretical formulation, feelings are internal affective states elicited by the ad’s music, imagery, narrative, or pacing (e.g., “This commercial makes me feel joyful”). Conversely, evaluative judgments are outward-focused, cognitive attributions directed at the stimulus itself (e.g., “This commercial is informative and believable”). Burke and Edell demonstrated through structural equation modeling that while feelings directly influence evaluative judgments, evaluative judgments exert an independent, powerful direct effect on $A_{ad}$, which subsequently drives $A_b$. By operationalizing these evaluative judgments via the 13 unipolar items of the AEJU, Aylesworth, Goodstein, and Kalra (1999) validated this structural pathway, demonstrating how subtle marketing interventions (such as visual or symbolic archetypes) can systematically alter consumer evaluative judgments even when controlling for immediate affective swings.

Furthermore, under Petty and Cacioppo’s (1986) Elaboration Likelihood Model, the AEJU measures cognitive dimensions relevant across both central and peripheral routes to persuasion. Under high cognitive elaboration, consumers evaluate arguments along dimensions of credibility and utility (Informative, Convincing, Useful). Under low cognitive elaboration, peripheral cues regarding executional craftsmanship and aesthetic interest (Well-done, Original, Worth watching) serve as heuristics that guide overall evaluation. The AEJU successfully captures both central argument quality appraisals and peripheral executional quality appraisals within a unified psychometric matrix.

Validity

The psychometric validity of the AEJU has been thoroughly established through empirical testing across diverse experimental conditions, media formats (television, print, digital video), and product categories.

Construct and Convergent Validity

Construct validity is evidenced by strong, statistically significant correlations between the AEJU and validated omnibus measures of attitude toward the ad ($A_{ad}$). In the foundational investigations by Burke and Edell (1989) and the subsequent work by Aylesworth et al. (1999), the unipolar evaluative judgment items correlated substantially with traditional 3-item and 4-item bipolar semantic differential scales of $A_{ad}$ (typically $r = .72$ to $r = .85$, $p < .001$). Furthermore, when evaluative judgments were modeled as antecedents to brand attitude ($A_b$) within structural equation models, standardized path coefficients consistently fell between $\gamma = .40$ and $\gamma = .65$, satisfying rigorous criteria for convergent construct validity.

Discriminant Validity

Discriminant validity is a crucial psychometric attribute of the AEJU, particularly regarding its distinctiveness from affective feeling inventories. In Burke and Edell’s (1989) large-scale factor analytic validation, the evaluative judgment adjectives loaded onto factors completely distinct from items measuring upbeat feelings (e.g., happy, cheerful, playful), warm feelings (e.g., emotional, touched, tender), and negative feelings (e.g., annoyed, bored, insulted). The average shared variance (ASV) between the AEJU factor and affective feeling factors remained substantially lower than the average variance extracted (AVE) for the AEJU itself, confirming that cognitive evaluative appraisals represent an independent construct rather than a semantic artifact of affective mood states.

Predictive and Criterion Validity

The predictive validity of the AEJU is demonstrated through its capacity to forecast downstream consumer behaviors and mental models. In experimental advertising studies, high AEJU composite scores predict significantly higher rates of brand recall ($r = .38, p < .01$), greater message acceptance, and significantly increased purchase intentions. In comparative copy testing, the AEJU successfully discriminates between award-winning, high-performing commercial executions and baseline control advertisements, demonstrating superior sensitivity compared to blunt single-item liking metrics.

Reliability

The reliability of the AEJU has been empirically documented as exceptionally robust across multiple independent administrations. Classical test theory metrics consistently demonstrate high internal consistency:

• Internal Consistency (Cronbach’s Alpha): Across published consumer psychology literature, the 13-item AEJU demonstrates an internal consistency reliability coefficient typically ranging from $\alpha = .91$ to $\alpha = .96$. In Aylesworth, Goodstein, and Kalra’s (1999) empirical investigation, the composite evaluative judgment index exhibited an alpha coefficient of $\alpha = .94$, well above the accepted threshold of $.80$ for academic research and $.90$ for clinical or high-stakes diagnostic testing.
• Item-Total Correlations: Corrected item-to-total correlations for all 13 items consistently exceed $.60$, with core items such as Effective, Convincing, and Well-done frequently demonstrating item-total correlations exceeding $.75$. No single item removal leads to an increase in overall scale alpha, confirming that all 13 adjectives contribute meaningfully to the latent construct.
• Composite Reliability (CR): Structural equation modeling assessments report composite reliability values exceeding $.92$, with Average Variance Extracted (AVE) values routinely surpassing $.60$, substantially exceeding the standard Fornell-Larcker benchmark of $.50$.
• Test-Retest Stability: In split-session experimental designs with delayed post-tests (e.g., 48-hour to 1-week intervals), test-retest reliability coefficients for the evaluative judgment dimensions average between $r = .78$ and $r = .84$, indicating high temporal stability when the underlying advertising stimulus remains invariant.

Factor Analysis

The structural dimensionality of the items comprising the AEJU has been evaluated via both Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA).

Exploratory Factor Analysis (EFA)

When subjected to EFA using principal axis factoring or maximum likelihood extraction with oblique rotation (e.g., Promax or Oblimin), the 13 items consistently yield an eigenvalue pattern supporting a dominant primary factor. In standard single-factor extractions, the first unrotated factor accounts for over 55% to 65% of the total variance, satisfying criteria for essential unidimensionality. Factor loadings for all 13 items are high and uniform:

• Effective: $lambda = .84$
• Well-done: $lambda = .82$
• Convincing: $lambda = .80$
• Believable: $lambda = .79$
• Worth remembering: $lambda = .78$
• Worth watching: $lambda = .77$
• Informative: $lambda = .74$
• Interesting: $lambda = .73$
• Useful: $lambda = .72$
• Meaningful: $lambda = .71$
• Realistic: $lambda = .69$
• Natural: $lambda = .66$
• Original: $lambda = .64$

Confirmatory Factor Analysis (CFA)

In CFA investigations, researchers have tested both a first-order unidimensional model and a correlated two-factor model distinguishing between Informational/Credibility Utility (Believable, Convincing, Informative, Realistic, Useful) and Executional/Engagement Quality (Interesting, Meaningful, Natural, Original, Well-done, Worth remembering, Worth watching, Effective). The unidimensional model demonstrates adequate fit:

• $\chi^2 / df < 3.0$
• Comparative Fit Index (CFI) $= .94 – .96$
• Tucker-Lewis Index (TLI) $= .93 – .95$
• Root Mean Square Error of Approximation (RMSEA) $= .055 – .068$
• Standardized Root Mean Square Residual (SRMR) $= .038 – .045$

While the two-factor specification occasionally yields a marginal improvement in fit indices (CFI > .97), the extremely high latent inter-factor correlation ($r > .82$) supports treating the 13 items as a single, overarching evaluative judgment index for parsimonious composite scoring, as executed by Aylesworth et al. (1999).

Instrument / Measurement Tool

The operational specifications of the Ad Evaluative Judgment (Unipolar) (AEJU) scale are structured as follows:

• Instrument Name: Ad Evaluative Judgment (Unipolar) (AEJU)
• Target Population: Consumers, study participants, and viewers aged 16 and older who have been exposed to an advertising stimulus.
• Administration Format: Self-administered paper-and-pencil questionnaire, computer-assisted personal interview (CAPI), or online survey instrument.
• Item Count: 13 unipolar adjective items.
• Authentic Response Scale: 7-point scale (ranging from 1 = Describes the ad very poorly to 7 = Describes the ad very well, or 1 = Not at all to 7 = Very well).
• Scoring Protocol: All 13 items represent unipolar positive evaluative judgments. There are no reverse-scored items. An overall Ad Evaluative Judgment score is computed by calculating the arithmetic mean of all 13 items (ranging from 1.00 to 7.00), or alternatively by calculating the raw sum of all items (ranging from 13 to 91). Higher numerical values represent more favorable, credible, and persuasive evaluative judgments of the target advertisement.
• Subscale Options (Diagnostic Use): If subscale analysis is desired, researchers may compute: (1) Credibility/Utility Index (mean of items 1, 2, 4, 9, 10); (2) Executional Quality Index (mean of items 3, 5, 6, 7, 8, 11, 12, 13).

Permissions & Fee and Test Year

The 13-item unipolar adaptation of the Ad Evaluative Judgment scale was published in 1999 by Andrew B. Aylesworth, Ronald C. Goodstein, and Ajay Kalra in the Journal of Advertising, derived from Marian Chapman Burke and Julie A. Edell’s seminal 1989 work in the Journal of Marketing Research. As an academic psychometric measurement tool published within peer-reviewed scientific literature, the AEJU is available for non-commercial, scholarly, educational, and research use under standard fair use principles without monetary licensing fees. Commercial enterprises, commercial copy-testing agencies, and syndicated research platforms seeking proprietary deployment should cite original sources appropriately and ensure compliance with standard journal publishing permissions where required.

References

• Aylesworth, A. B., Goodstein, R. C., & Kalra, A. (1999). Effect of archetypal embeds on feelings: An indirect route to affecting attitudes? Journal of Advertising, 28(2), 73–81. https://doi.org/10.1080/00913367.1999.10673584
• Burke, M. C., & Edell, J. A. (1989). The impact of feelings on ad-based affect and cognition. Journal of Marketing Research, 26(1), 69–83. https://doi.org/10.1177/002224378902600107
• Edell, J. A., & Burke, M. C. (1987). The power of feelings in understanding advertising effects. Journal of Consumer Research, 14(3), 421–433. https://doi.org/10.1086/209106
• Lutz, R. J., MacKenzie, S. B., & Belch, G. E. (1983). Attitude toward the ad as a mediator of advertising effectiveness: Determinants and consequences. Advances in Consumer Research, 10(1), 532–539.
• MacKenzie, S. B., & Lutz, R. J. (1989). An empirical examination of the structural antecedents of attitude toward the ad in an advertising pretesting context. Journal of Marketing, 53(2), 48–65. https://doi.org/10.1177/002224298905300204
• MacKenzie, S. B., Lutz, R. J., & Belch, G. E. (1986). The role of attitude toward the ad as a mediator of advertising effectiveness: A test of competing explanations. Journal of Marketing Research, 23(2), 130–143. https://doi.org/10.1177/002224378602300205
• Mitchell, A. A., & Olson, J. C. (1981). Are product attribute beliefs the only mediator of advertising effects on brand attitude? Journal of Marketing Research, 18(3), 318–332. https://doi.org/10.1177/002224378101800306
• Petty, R. E., & Cacioppo, J. T. (1986). The Elaboration Likelihood Model of persuasion. Advances in Experimental Social Psychology, 19, 123–205. https://doi.org/10.1016/S0065-2601(08)60214-2

Items of the Scale