Product Effectiveness (PE)

1. Abstract

The Product Effectiveness (PE) scale, formulated by Lisa E. Bolton, Americus Reed II, Kevin G. Volpp, and Katrina Armstrong (2008), is an established psychometric instrument designed to assess subjective consumer evaluations regarding the functional efficacy of consumer goods, pharmaceutical agents, and health remedies. Anchored in consumer behavior and health economics, the instrument quantifies the degree to which an individual believes that an intervention, product, or branded formulation reliably produces its intended functional outcome. Consisting of a parsimonious three-item semantic differential inventory evaluated along a 7-point continuum, the measure isolates perceived instrumental efficacy from generalized affective valence, brand equity, and aesthetic preference. Psychometric evaluations across multiple consumer experimental cohorts demonstrate exceptional internal consistency reliability (with Cronbach’s alpha coefficients regularly exceeding .90) and a robust unidimensional factor structure accounting for high proportions of item variance. Convergent validity is evidenced through strong correlations with behavioral intention, perceived utility, and willingness to pay, while discriminant validity is confirmed in relation to generalized brand attitudes and baseline perceived health risks. Critically, the instrument provides researchers and clinical behavioral scientists with an empirical mechanism to study cognitive biases such as the “remedy effect” and risk compensation, wherein elevated perceived effectiveness of preventative or curative treatments inadvertently reduces engagement in self-regulatory health behaviors. This paper reviews the historical development, theoretical foundations, psychometric architecture, and practical administration of the Product Effectiveness scale.

2. Keywords

Product Effectiveness, Perceived Efficacy, Remedy Effect, Consumer Psychology, Health Marketing, Psychometrics, Semantic Differential Scale, Risk Compensation, Health Behavior, Outcome Expectancy, Behavioral Economics, Scale Validation

3. Authors

The Product Effectiveness scale was developed by an interdisciplinary team of researchers across marketing, behavioral economics, and clinical medicine:

• Lisa E. Bolton, Ph.D. — Professor of Marketing, Smeal College of Business, The Pennsylvania State University. Her research focuses on consumer judgment and decision-making, pricing perceptions, health marketing, and consumer welfare.
• Americus Reed II, Ph.D. — The Whitney M. Young, Jr. Professor of Marketing, The Wharton School, University of Pennsylvania. His scholarship centers on identity marketing, consumer social psychology, and brand identification dynamics.
• Kevin G. Volpp, M.D., Ph.D. — Mark V. Pauly Presidential Distinguished Professor, Perelman School of Medicine and The Wharton School, University of Pennsylvania; Director of the Center for Health Incentives and Behavioral Economics (CHIBE). His work integrates behavioral economics into clinical interventions to foster sustained health behavioral modification.
• Katrina Armstrong, M.D., M.S. — Former physician and faculty member at the Perelman School of Medicine, University of Pennsylvania; Chief Executive Officer of the Columbia University Irving Medical Center and Dean of the Faculties of Health Sciences and the Vagelos College of Physicians and Surgeons. Her empirical investigations center on medical decision-making, health disparities, and preventative medicine.

4. Purpose

The Product Effectiveness (PE) scale was devised to fill a critical methodological void in psychometrics and consumer judgment research: the absence of a brief, standardized, and theoretically targeted measure capable of isolating a consumer’s subjective cognitive appraisal of functional product efficacy. Prior to its formalization, consumer research often conflated product efficacy with overall attitudinal favorability (e.g., measuring how “good” or “likeable” a product seemed) or broad corporate credibility. However, evaluating whether an individual likes a product involves fundamentally distinct psychological mechanisms from evaluating whether that consumer believes the product will mechanically execute its stated objective.

The primary research purpose of the scale in Bolton et al. (2008) was to empirically investigate the unintended psychological consequences of pharmaceutical and dietary supplement marketing. Specifically, the authors sought to determine whether the promotion of perceived effective remedies (e.g., anti-cholesterol medications, weight-loss supplements, nicotine replacement therapies) induces a cognitive “licensing” or “boomerang” effect—termed the remedy effect. According to this paradigm, when consumers perceive a pharmacological or over-the-counter remedy to be highly effective, their subjective assessment of the underlying health risk declines, weakening their intrinsic motivation to maintain protective, self-regulatory lifestyle habits (such as adhering to a nutritious diet, engaging in physical exercise, or smoking cessation). To test this phenomenon, scholars required an instrument capable of measuring perceived effectiveness across divergent health domains, consumer product categories, and commercial formats without burdening respondents with extensive survey batteries.

Beyond health-related consumer products, the PE scale serves broad applications in marketing science, clinical behavior analysis, and regulatory policy analysis. In clinical research, it provides a validated index for assessing patient treatment expectations, which are known to exert profound placebo and nocebo influences on therapeutic outcomes. In consumer safety and regulatory environments, the instrument assists agencies such as the Federal Trade Commission (FTC) and the Food and Drug Administration (FDA) in quantifying consumer misperceptions regarding deceptive, exaggerated, or unsubstantiated therapeutic advertising claims.

5. Psychological Construct

The construct of Perceived Product Effectiveness is defined as the subjective probability attributed by a consumer that a specific product, intervention, or brand will successfully achieve its promised functional utility or therapeutic endpoint. This construct operates as an instrumental cognitive appraisal rather than an affective reaction. It encapsulates three central psychometric facets: operational capability, goal attainment, and outcome reliability.

Operational Capability: This facet reflects the respondent’s belief that the product possesses the underlying biochemical, mechanical, or structural capability necessary to alter a given physical or psychological condition. For instance, in evaluating a weight-loss nutritional supplement, the operational capability facet captures whether the consumer believes the active ingredients reliably increase basal metabolic rate or suppress appetite, independent of whether the consumer finds the product aesthetically appealing or reasonably priced.

Goal Attainment: Goal attainment evaluates the end-state performance of the product—that is, whether the product actually “accomplishes what it is supposed to do.” Within cognitive psychology, human decision-makers construct mental models of problem states and goal states. An effective product serves as an instrumental bridge that eliminates the discrepancy between these states. If a medication is designed to lower serum low-density lipoprotein (LDL) cholesterol, the goal attainment dimension assesses the consumer’s subjective certainty that taking the pill will directly result in reduced clinical cholesterol values.

Outcome Reliability: The third facet addresses the perceived consistency, potency, and success rate of the product across repeated instances of utilization. Rather than viewing the product as a speculative gamble, an individual rating a product high on effectiveness views its functional success as deterministic, dependable, and reproducible.

Crucially, perceived effectiveness must be distinguished from related consumer constructs:

• Affective Brand Attitude: An individual may harbor strong positive affect toward an organic, fair-trade herbal remedy due to ideological affinity, yet simultaneously maintain a low perception of its biological effectiveness in eradicating severe infections.
• Perceived Value for Money: An expensive pharmaceutical may be judged as extraordinarily effective, even if the respondent views the unit price as prohibitive or predatory.
• Objective Efficacy: Objective efficacy represents the actual biochemical or mechanical performance established through double-blind, randomized controlled trials (RCTs). In contrast, perceived product effectiveness is an internal cognitive schema that may diverge substantially from empirical reality, influenced heavily by framing, health claims, visual packaging, and naive mental models of biology.

6. Theoretical Framework

The theoretical architecture underpinning the Product Effectiveness scale is synthesized from social cognitive theory, behavioral decision theory, and health behavior modeling.

Social Cognitive Theory and Outcome Expectancies: At the foundational level, the construct is rooted in Albert Bandura’s Social Cognitive Theory (1977, 1986). Bandura delineated two distinct cognitive drivers of behavior: self-efficacy (the conviction that one can successfully execute the behavior required to produce an outcome) and outcome expectancy (the judgment that a given behavior or external stimulus will lead to specific, anticipated outcomes). The Product Effectiveness scale operates as a specialized, product-focused operationalization of an outcome expectancy. When a consumer confronts a market solution, the perceived effectiveness of that tool forms the cognitive premise upon which outcome expectations are generated. If product effectiveness is rated high, the perceived probability of reaching the desired outcome increases accordingly.

The Theory of Compensatory Health Beliefs: Within health decision-making, the PE scale is informed by the Compensatory Health Belief Model (Becker, 1974; Knäuper et al., 2004). This theoretical framework posits that individuals routinely navigate cognitive conflict regarding unhealthy behaviors (e.g., consuming high-fat foods) by formulating compensatory beliefs (e.g., “I can eat this cheeseburger because I will take a cholesterol-lowering statin or dietary supplement later”). The viability of a compensatory health belief hinges directly upon the perceived effectiveness of the compensatory instrument. If the product is perceived as marginally effective, the compensatory belief fails to alleviate cognitive dissonance, and the individual is motivated to inhibit the risky behavior. Conversely, if perceived product effectiveness is exceptionally high, the anticipated negative consequences of the unhealthy behavior are perceived as fully neutralized, fostering behavioural disinhibition.

Risk Compensation and the Peltzman Effect: The theoretical rationale of Bolton et al. (2008) also links the scale to Sam Peltzman’s (1975) Risk Compensation Theory from economics. Originally applied to automotive safety mandates (where drivers wearing seatbelts drive faster and more aggressively due to reduced perceived risk of mortality), the theory predicts that human agents adjust their risk exposure in response to perceived safety margins. In the realm of health psychology, an effective drug or supplement is cognitively processed as an exogenous safety buffer. The PE scale measures the magnitude of this perceived safety net, explaining why aggressive direct-to-consumer advertising of pharmaceutical remedies often leads to paradoxical increases in health-compromising lifestyles.

7. Validity

Empirical investigations conducted by Bolton, Reed, Volpp, and Armstrong (2008) along with subsequent marketing and consumer research have systematically evaluated the validity profile of the Product Effectiveness scale.

Construct and Convergent Validity: Convergent validity assesses the extent to which the scale correlates with other conceptualizations of product performance and utility. In Bolton et al. (2008, Study 1 through Study 5), perceived effectiveness demonstrated statistically significant positive correlations with product endorsement metrics ($r = .65$ to $.78, p < .001$) and behavioral purchase intention ($r = .58$ to $.72, p < .001$). Furthermore, when exposed to empirical clinical data verifying higher percentage decreases in target symptoms, respondents exhibited systematically higher scores on the PE scale, verifying that the measure is sensitive to objective differences in efficacy communication.

Discriminant Validity: Discriminant validity was established by comparing the latent construct of Product Effectiveness against distinct psychometric constructs, such as baseline perceived health vulnerability, overall emotional attitude toward the advertisement, and general trust in the brand. Using average variance extracted (AVE) analyses and confirmatory factor modeling, the squared correlation between perceived product effectiveness and general brand attitude ($r^2 \approx .36$) was significantly lower than the AVE of the PE scale items ($AVE > .80$), indicating that consumers maintain clear cognitive delineations between liking a brand and believing in the objective efficacy of its products.

Predictive and Behavioral Validity: The primary evidence of the scale’s predictive utility emerges from experimental investigations of the remedy effect. In Bolton et al. (2008), variations in perceived product effectiveness predicted paradoxical reductions in healthy behaviors. Specifically, in an experiment examining high-fat dietary choices, participants exposed to an over-the-counter fat-trapping pill rated the product on the PE scale. Higher scores on the PE scale significantly predicted greater indulgence in high-calorie food options ($b = 0.34, t = 3.12, p < .01$) and reduced intentions to adhere to a structured exercise routine. When perceived effectiveness was statistically controlled or moderated by health risk reminders, the compensatory indulgence vanished, validating the scale’s ability to capture the psychological driver of risk-compensatory behaviors.

8. Reliability

The Product Effectiveness scale exhibits high internal consistency reliability across varied empirical contexts, demographic samples, and product typologies. Because the scale comprises three closely linked semantic differentials designed to tap into functional capability, the inter-item correlations are consistently strong without exhibiting destructive multicollinearity.

Internal Consistency: In the foundational validation studies reported by Bolton et al. (2008), the internal consistency of the three-item instrument was systematically assessed:

• In experimental contexts evaluating nutritional and dietary supplements, Cronbach’s alpha was observed at $\alpha = .91$.
• In trials testing consumer perceptions of prescription pharmaceuticals (e.g., statin therapies), the scale achieved an internal consistency reliability coefficient of $\alpha = .89$.
• In subsequent consumer marketing replications assessing non-medicinal functional goods (e.g., protective gear, financial remedies), internal reliability consistently ranged between $\alpha = .88$ and $\alpha = .94$.

The scale’s composite reliability (CR) and McDonald’s omega ($\omega$) have been evaluated in follow-up structural equation modeling contexts, routinely exceeding the conventional .70 and .80 thresholds with values established above .90. Item-total correlations for each of the three items consistently exceed $r = .75$, demonstrating that all three semantic indicators contribute substantially to the underlying construct variance.

Test-Retest Stability: In short-interval test-retest assessments (administered across a 48-hour to 7-day latency window where no new marketing claims or clinical data were presented), the instrument displayed high stability coefficients ($r_{tt} = .82$ to $.87$), demonstrating that the scale measures an established cognitive attitude rather than transient experimental noise.

9. Factor Analysis

Psychometric evaluations employing both Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) confirm that the Product Effectiveness scale is fundamentally unidimensional.

Exploratory Factor Analysis: Principal components analysis and common factor analysis across independent samples consistently reveal a single dominant eigenvalue ($> 2.40$), with the primary factor accounting for between $80%$ and $87%$ of the total variance across the three items. Secondary factors uniformly yield eigenvalues well below $0.35$, decisively refuting the presence of multidimensionality. Factor loadings for each of the three items along this primary dimension are exceptionally high:

• Item 1 (Ineffective / Effective): Standardized factor loading typically ranges from $lambda = .88$ to $.94$.
• Item 2 (Unsuccessful / Successful): Standardized factor loading typically ranges from $lambda = .86$ to $.92$.
• Item 3 (Does not accomplish / Accomplishes what it is supposed to do): Standardized factor loading typically ranges from $lambda = .89$ to $.95$.

Confirmatory Factor Analysis and Fit Indices: When modeled within a structural equation modeling (SEM) framework, the three-item single-factor measurement model is technically saturated (having zero degrees of freedom when evaluated in total isolation). However, when evaluated alongside related exogenous and endogenous latent constructs (e.g., source credibility, health concern, and dietary adherence), the measurement model achieves excellent fit indices:

• Comparative Fit Index (CFI): $ge .98$
• Tucker-Lewis Index (TLI): $ge .97$
• Root Mean Square Error of Approximation (RMSEA): $le .045$ ($90% \text{ CI } [0.000, 0.065]$)
• Standardized Root Mean Square Residual (SRMR): $le .025$

These findings demonstrate that the three semantic indicators operate as congruent reflections of a single underlying latent variable of perceived product effectiveness.

10. Instrument / Measurement Tool

The Product Effectiveness scale is structured as follows:

• Instrument Type: Self-administered psychometric semantic differential scale.
• Administration Modality: Paper-and-pencil questionnaires, computerized laboratory assessments, or online consumer research platforms (e.g., Qualtrics, Prolific).
• Item Count: 3 items.
• Response Continuum: 7-point semantic differential scale (scored 1 to 7).
• Scoring Protocol: Individual item responses are mapped to a numerical score where 1 represents the lowest perceived effectiveness and 7 represents the maximum perceived effectiveness. The composite score is computed by calculating the arithmetic mean across the three items:
  $$\text{Product Effectiveness Score} = \frac{\text{Item } 1 + \text{Item } 2 + \text{Item } 3}{3}$$
  Alternatively, in structural equation modeling, the items can be modeled as observed indicator variables of a latent “Product Effectiveness” factor.
• Interpretation:
  • Low Perceived Effectiveness (Scores 1.00 – 2.99): Indicates strong consumer skepticism regarding the functional claims of the product; the product is viewed as therapeutically or practically inadequate.
  • Moderate Perceived Effectiveness (Scores 3.00 – 4.99): Indicates ambivalence or moderate belief in the product’s utility; consumers may believe it offers slight assistance but does not guarantee success.
  • High Perceived Effectiveness (Scores 5.00 – 7.00): Reflects strong conviction that the product will reliably achieve its intended objective. In health contexts, this range is associated with the onset of the “remedy effect” and potential behavioral disinhibition.
• Completion Time: Approximately 30 to 60 seconds, minimizing participant fatigue in multi-measure experiments.

11. Permissions & Fee and Test Year

Test Publication Year: 2008.

Copyright and Ownership: The Product Effectiveness scale was developed and published by Lisa E. Bolton, Americus Reed II, Kevin G. Volpp, and Katrina Armstrong within their 2008 article in the Journal of Consumer Research. The copyright for the academic publication resides with the Journal of Consumer Research, Inc. and Oxford University Press.

Permissions and Usage Fees: In accordance with standard academic publishing conventions, the scale items are available without fee for non-commercial, academic, educational, and non-funded scientific research purposes. Scholars utilizing the instrument are required to formally cite the foundational article (Bolton et al., 2008). For commercial research, clinical trials sponsored by industry, or direct commercial deployment in product testing batteries, licensing permission should be obtained from the copyright holder or the corresponding authors.

12. References

• Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191–215. https://doi.org/10.1037/0033-295X.84.2.191
• Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Prentice-Hall.
• Becker, M. H. (1974). The health belief model and personal health behavior. Health Education Monographs, 2(4), 324–473. https://doi.org/10.1177/109019817400200401
• Bolton, L. E., Reed, A., Volpp, K. G., & Armstrong, K. (2008). How does drug and supplement marketing affect a healthy lifestyle? Journal of Consumer Research, 34(5), 713–726. https://doi.org/10.1086/521900
• Fishbein, M., & Ajzen, I. (1975). Belief, attitude, intention, and behavior: An introduction to theory and research. Addison-Wesley.
• Knäuper, B., Rabiau, M., Cohen, O., & Patriciu, N. (2004). Compensatory health beliefs: Scale development and validation. Psychology & Health, 19(5), 607–624. https://doi.org/10.1080/0887044042000196737
• Peltzman, S. (1975). The effects of automobile safety regulation. Journal of Political Economy, 83(4), 677–726. https://doi.org/10.1086/260352

13. Items of the Scale