Reviewer Credibility

1. Abstract

The Reviewer Credibility (RC) scale is a psychometric measurement instrument designed to capture consumer assessments of an online review writer’s trustworthiness, honesty, and altruistic motivation. Originating in empirical consumer behavior and digital marketing research conducted by Grewal and Stephen (2019), the scale evaluates the extent to which prospective buyers perceive an unknown peer reviewer as authentic and genuinely intent on providing helpful, objective guidance rather than being driven by ulterior motives, financial incentives, or superficial impressions. The instrument comprises six self-report items evaluated on multi-point Likert or semantic differential response formats. Operationally deployed in experimental investigations surrounding electronic word-of-mouth (eWOM) and device-specific signaling (such as “mobile” review disclosures), the scale quantifies whether platform-level cues influence perceived credibility and downstream purchase intentions.

Psychometrically, the Reviewer Credibility scale demonstrates high internal consistency across empirical replications, consistently yielding Cronbach’s alpha coefficients exceeding the standard threshold of .85, and frequently reaching values between .90 and .94 in consumer evaluation contexts. Exploratory and confirmatory factor analyses confirm a robust unidimensional structure, indicating that authenticity, perceived expertise, benevolent intention, and perceived honesty load onto a coherent latent construct. Construct validity is demonstrated through positive correlations with consumer purchase intention, information adoption, and message persuasiveness, as well as distinct divergence from general platform trust and product brand attitude. The instrument provides researchers with a concise, theoretically grounded tool to examine the psychological mechanisms through which digital interface characteristics influence source evaluations in computer-mediated communication.

2. Keywords

Reviewer Credibility, source credibility, electronic word-of-mouth, eWOM, consumer trust, perceived honesty, mobile reviews, purchase intentions, digital marketing, psychometrics

3. Authors

The Reviewer Credibility scale was developed and operationalized by:

• Lauren Grewal, Ph.D. — Associate Professor of Marketing, Tuck School of Business at Dartmouth College (previously at the Robins School of Business, University of Richmond). Her research investigates consumer behavior in digital environments, consumer-technology interactions, and electronic word-of-mouth dynamics.
• Andrew T. Stephen, Ph.D. — L’Oréal Professor of Marketing and Associate Dean of Research at Saïd Business School, University of Oxford. His work focuses on social media marketing, consumer psychology in digital interfaces, and computational marketing analytics.

Correspondence regarding the original experimental application of this instrument can be directed through institutional academic portals at the Tuck School of Business at Dartmouth College or the Saïd Business School at the University of Oxford.

4. Purpose

The primary purpose of the Reviewer Credibility scale is to measure how individual consumers perceive the personal reliability, moral authenticity, and motivational integrity of a reviewer who produces user-generated content (UGC). In the modern digital economy, prospective buyers are inundated with thousands of peer reviews on platforms such as TripAdvisor, Yelp, Amazon, and Google Maps. Because the authors of these reviews are anonymous or pseudonymous strangers, consumers must rely on peripheral, contextual, and heuristic cues to assess whether the information provided represents genuine product experiences or fabricated appraisals sponsored by merchants or deceptive actors.

From a theoretical standpoint, the scale addresses the long-standing need to isolate source evaluations from content evaluations in consumer research. Prior instruments frequently conflated message persuasiveness (e.g., how convincing an argument is) with source characteristics (e.g., whether the reviewer possesses integrity and goodwill). Grewal and Stephen (2019) conceptualized the Reviewer Credibility instrument to specifically identify how technological and contextual cues—such as a visual badge indicating that a review was “Posted via Mobile”—alter consumer attributions regarding the writer’s cognitive effort, spontaneity, and authenticity.

In experimental and field research settings, the scale serves as a critical mediating variable. Researchers employ it to examine how subtle changes in review presentation (e.g., text length, typographical errors, emotional tone, verified purchase indicators, and author profile details) affect the recipient’s confidence in the reviewer’s message. Clinically and socially, while not designed for psychiatric diagnosis, the tool provides foundational insights for behavioral scientists studying digital deception, algorithmic mediation, epistemic vigilance, and online interpersonal trust formation.

5. Psychological Construct

The Reviewer Credibility scale assesses a unidimensional, high-order construct grounded in the classic dimensions of source credibility—specifically adapted for computer-mediated, asynchronous consumer interactions. While classic communication models identify multiple distinct facets of source credibility, in the context of peer reviews, these facets operate in an integrated perceptual gestalt characterized by three core theoretical nuances:

Perceived Honesty and Truthfulness

This dimension reflects the degree to which a consumer perceives the reviewer as a genuine, non-deceptive reporter of their authentic consumption experience. When evaluating anonymous online text, consumers actively assess whether the author is fabricating details, exaggerating minor occurrences, or serving as a paid promotional agent. Honesty in this context implies that the narrative corresponds accurately to the reviewer’s lived experience without intentional distortion.

Perceived Trustworthiness and Reliability

Trustworthiness captures the degree of cognitive confidence a reader places in the reviewer’s character and dependability. It addresses whether the reader feels safe relying on the reviewer’s advice to make high-stakes or financially impactful consumption decisions (such as booking an expensive hotel stay or purchasing complex electronics). Trustworthiness mitigates perceived financial, physical, and social risks inherent in purchasing unfamiliar offerings.

Altruistic Motivation and Benevolence

A crucial differentiator of this scale is its explicit measurement of perceived reviewer motives. Drawing from attribution theory, the construct evaluates whether the consumer attributes the reviewer’s behavior to an intrinsic desire to assist the peer community (prosocial, altruistic motivation) or to self-serving incentives (e.g., seeking platform badges, venting hostility, or receiving merchant kickbacks). Reviewers perceived as genuinely motivated to help others attain higher credibility scores.

6. Theoretical Framework

The Reviewer Credibility scale is theoretically grounded in the convergence of two foundational paradigms in social psychology and communication theory: the Source Credibility Model pioneered by Carl Hovland and colleagues, and Attribution Theory advanced by Fritz Heider and Harold Kelley.

The Source Credibility Model

Hovland, Janis, and Kelley (1953) posited that the effectiveness of persuasive communication depends heavily on the perceived expertise and trustworthiness of the communicator. Expertise pertains to the communicator’s perceived ability to make valid assertions, whereas trustworthiness concerns their perceived willingness to communicate these assertions without bias. In online retail and hospitality environments, peer reviewers typically do not hold institutional credentials or formal authority. Therefore, consumer evaluation shifts heavily toward perceived trustworthiness, moral integrity, and authenticity. The Reviewer Credibility scale adapts Hovland’s paradigm to decentralized digital networks where communicative cues are stripped of physical, non-verbal, and paralinguistic markers.

Attribution Theory and Cue Utilization

According to Kelley’s (1973) attribution framework, individuals act as intuitive psychologists, seeking to explain the causes behind observed behaviors. When reading an online review, a consumer attempts to determine whether the review was generated due to the product’s actual quality (an external entity attribution) or due to idiosyncratic biases, emotional volatility, or ulterior motives of the writer (an internal person attribution). Furthermore, Cue Utilization Theory suggests that when diagnostic intrinsic attributes of a product are unavailable prior to purchase, consumers rely on extrinsic signals—such as reviewer badges, mobile posting tags, or linguistic markers—as heuristics to infer the credibility of the review author.

7. Validity

Empirical evidence supporting the construct, convergent, predictive, and discriminant validity of the Reviewer Credibility scale has been established across multiple rigorous behavioral experiments.

Convergent Validity

Grewal and Stephen (2019) demonstrated strong convergent validity across studies evaluating online hotel reviews. The scale items demonstrate uniform factor loadings well above the conventional .70 criterion on their primary latent factor. Average Variance Extracted (AVE) routinely exceeds .65, indicating that the items share substantial common variance in capturing the target credibility construct.

Discriminant Validity

Discriminant validity has been demonstrated by contrasting reviewer credibility against related but conceptually separate constructs, including:

• Overall Brand Attitude: Evaluated to ensure that consumers differentiate between their evaluation of the hotel/product and their evaluation of the individual who authored the review.
• Platform Trust: Differentiating the trustworthiness of the underlying intermediary (e.g., TripAdvisor) from the credibility attributed to a specific user on that platform.
• Review Helpfulness: Showing that a review can be perceived as honest and credible even if it is brief or lacks specific utility for a particular individual’s decision needs.

Predictive and Nomological Validity

The scale demonstrates exceptional nomological and predictive validity. In experimental designs manipulating mobile vs. non-mobile posting indicators (Grewal & Stephen, 2019, Study 2b and Study 3), reviewer credibility successfully mediated the relationship between the mobile cue and consumer purchase intentions. Higher scores on the Reviewer Credibility scale directly predict elevated willingness to buy, higher perceived product quality, and greater intention to share the review with other consumers.

8. Reliability

The Reviewer Credibility scale exhibits robust internal consistency across independent laboratory and online panel samples (e.g., Amazon Mechanical Turk, Prolific, undergraduate behavioral labs). Across empirical evaluations in published literature:

• Cronbach’s Alpha ($lpha$): Reported values systematically range between .90 and .94, substantially exceeding the widely accepted psychometric threshold of .70 or .80 for basic and applied research.
• Composite Reliability ($CR$): In structural equation modeling and confirmatory factor analysis specifications, composite reliability coefficients regularly exceed .92.
• Inter-Item Correlations: Item-to-total correlations for all six items generally remain above .65, demonstrating that each item contributes meaningfully to the shared variance without introducing excessive item redundancy.

9. Factor Analysis

Psychometric evaluations employing Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) substantiate the unidimensional structure of the Reviewer Credibility scale.

Exploratory Factor Analysis (EFA)

Principal Axis Factoring and Principal Component Analysis using unrotated and oblique extraction methods show that all six items load onto a single dominant factor with an eigenvalue significantly greater than 1.0 (typically explaining over 70% of the total variance). Scree plots display a distinct inflection point after the first factor, confirming the absence of secondary dimensional splinters.

Confirmatory Factor Analysis (CFA)

CFA models specifying a single latent Reviewer Credibility factor demonstrate excellent model fit indices across consumer samples:

• Comparative Fit Index (CFI): Typically > .97
• Tucker-Lewis Index (TLI): Typically > .96
• Root Mean Square Error of Approximation (RMSEA): < .06 (with 90% confidence intervals spanning .03 to .08)
• Standardized Root Mean Square Residual (SRMR): < .03

Standardized factor loadings across all six indicators range from .78 to .92, confirming that each indicator functions as a robust measurement parameter for the underlying construct.

10. Instrument / Measurement Tool

The operational specifications of the Reviewer Credibility measurement tool are structured as follows:

• Instrument Type: Self-administered psychological / consumer perception questionnaire.
• Administration Format: Digital computer-assisted survey (e.g., Qualtrics, Gorilla, Confirmit) or paper-and-pencil instrument.
• Target Population: Adult consumers (18+), online shoppers, digital platform users, and participants in behavioral decision-making experiments.
• Item Count: 6 items.
• Response Scale: Typically administered using a 7-point Likert response format (ranging from 1 = Strongly Disagree to 7 = Strongly Agree) or equivalent 7-point semantic differential scales.
• Scoring Procedure:
  • All items are framed in a uniform positive conceptual direction (unless a researcher chooses to insert an exploratory reverse-scored attention-check item).
  • An overall Reviewer Credibility score is computed by calculating the unweighted arithmetic mean across all six items.
  • Higher mean values (closer to 7.0) indicate higher levels of perceived reviewer credibility, honesty, and trustworthy motivation.
• Administration Time: Approximately 1 to 2 minutes to complete.

11. Permissions & Fee and Test Year

The Reviewer Credibility scale was introduced to the literature in 2019 through the landmark empirical publication by Lauren Grewal and Andrew T. Stephen in the Journal of Marketing Research. As an academic measurement tool published within peer-reviewed scholarly literature, it is widely accessible for non-commercial academic research, empirical replication, and educational use without payment of licensing fees, provided that appropriate scholarly attribution is cited. Researchers intending to incorporate the scale into commercial market research, proprietary platform algorithms, or commercial consumer intelligence products should consult the authors and the American Marketing Association regarding copyright permissions.

12. References

The following academic sources provide foundational theory, methodological design, and empirical validation relevant to this measurement instrument:

• Grewal, L., & Stephen, A. T. (2019). In mobile we trust: The effects of mobile versus nonmobile reviews on consumer purchase intentions. Journal of Marketing Research, 56(5), 791–808. https://doi.org/10.1177/0022243719859318
• Heider, F. (1958). The psychology of interpersonal relations. John Wiley & Sons. https://doi.org/10.1037/10628-000
• Hovland, C. I., Janis, I. L., & Kelley, H. H. (1953). Communication and persuasion: Psychological studies of opinion change. Yale University Press.
• Kelley, H. H. (1973). The processes of causal attribution. American Psychologist, 28(2), 107–128. https://doi.org/10.1037/0003-066X.28.2.107
• Ohanian, R. (1990). Construction and validation of a scale to measure celebrity endorsers’ perceived expertise, trustworthiness, and attractiveness. Journal of Advertising, 19(3), 39–52. https://doi.org/10.1080/00913367.1990.10673191

13. Items of the Scale