Website Procedural Justice Scale (JWP)

Abstract

The Website Procedural Justice Scale (JWP) is a unidimensional psychometric instrument designed to evaluate user perceptions of fairness regarding a website’s internal policies, information-handling procedures, and advertising practices. Developed and validated by Jan Hendrik Schumann, Florian von Wangenheim, and Nicole Groene (2014) in the context of commercial online services and targeted behavioral advertising, the scale adapts classical organizational justice theory—specifically the procedural justice framework formalized by Thibaut and Walker (1975) and Leventhal (1980)—to digital human-computer interactions and online consumer behavior. Comprising four core items rated on a 7-point Likert scale ranging from 1 (“Strongly disagree”) to 7 (“Strongly agree”), the instrument measures critical operational pillars of procedural justice: informational transparency, corporate honesty, perceived user control over personal data, and systemic fairness in commercial data exploitation. Psychometric evaluations across multiple empirical investigations demonstrate robust measurement properties, including high internal consistency reliability (α = .89), strong composite reliability (CR = .89), and satisfactory convergent validity as evidenced by an average variance extracted (AVE) of .58. Confirmatory factor analyses corroborate a robust single-factor structure that remains invariant across diverse demographic cohorts and digital platform environments. The JWP scale addresses a critical methodological gap in digital privacy, marketing analytics, and human-computer interaction (HCI) research by providing a parsimonious, theoretically grounded diagnostic tool to evaluate how algorithmic transparency and procedural fairness mitigate privacy concerns, attenuate psychological reactance, and facilitate the psychological mechanisms underpinning online reciprocity.

Keywords

Website Procedural Justice Scale, procedural justice, information privacy, targeted online advertising, perceived fairness, transparency, consumer privacy calculus, data governance, algorithmic fairness, psychological reactance, psychometrics

Authors

The Website Procedural Justice Scale was adapted, operationalized, and psychometrically validated within the context of digital service provision and online targeted advertising by the following academic researchers:

• Jan Hendrik Schumann: Professor of Marketing and Innovation at the School of Business, Economics and Society, University of Passau, Germany. His research focuses on service management, digital marketing, consumer privacy perceptions, and the psychological mechanisms governing consumer responses to interactive technologies.
• Florian von Wangenheim: Professor of Technology Marketing at the Department of Management, Technology, and Economics (D-MTEC), ETH Zurich, Switzerland. His academic work specializes in service management, customer relationship management, digital behavioral analytics, and technology adoption.
• Nicole Groene: Affiliated with the TUM School of Management, Technische Universität München, Germany, during the conduct of the foundational research. Her scholarly contributions center on consumer behavior, digital business models, and consumer trust dynamics in response to online commercial strategies.

The authors drew foundational conceptual elements and operational wording from earlier theoretical and psychometric work on consumer procedural justice in transactional environments developed by Jochen Wirtz and May O. Lwin (2009).

Purpose

The digital economy relies extensively on the monetization of consumer behavioral data, third-party cookies, and algorithmic tracking to deliver targeted advertising and personalized content. While targeted advertising enhances relevance for consumers and revenue for digital publishers, it inherently introduces severe privacy trade-offs. The primary purpose of the Website Procedural Justice Scale (JWP) is to provide researchers, data protection officers, system architects, and behavioral scientists with an empirically validated, parsimonious instrument to quantify consumers’ subjective evaluations of the fairness of the processes through which digital platforms harvest, manage, govern, and commercialize their personal information.

In social and psychological literature, justice perceptions are bifurcated into distributive and procedural dimensions. Distributive justice addresses the fairness of the perceived outcomes of an exchange (such as receiving access to a free online platform in return for viewing advertisements). In contrast, procedural justice focuses exclusively on the fairness of the underlying mechanisms, decision rules, and administrative processes that lead to those outcomes. Prior to the formalization of the JWP scale, empirical research frequently conflated procedural fairness with general customer satisfaction, brand trust, or broad privacy concerns (such as the Concern for Information Privacy [CFIP] or Internet Users’ Information Privacy Concerns [IUIPC] frameworks). The JWP isolates the structural and operational components of procedural equity in online human-agent exchanges.

The scale serves vital functions in both academic inquiry and applied operational environments:

• Empirical Research in Marketing and Behavioral Economics: The scale enables scholars to test advanced structural equation models examining how procedural justice moderates the relationship between commercial personalization (e.g., targeted ad delivery) and adverse consumer reactions (e.g., ad avoidance, brand boycotts, or installation of ad-blocking technologies).
• Regulatory and Compliance Auditing: In the wake of comprehensive legal frameworks such as the European Union’s General Data Protection Regulation (GDPR) and the California Consumer Privacy Act (CCPA), the JWP offers organizations a validated psychometric metric to determine whether privacy notices, opt-out mechanisms, and consent banners are perceived as procedurally just and genuinely transparent by real users, rather than functioning as coercive “dark patterns.”
• System Architecture and User Experience (UX) Design: The instrument facilitates A/B testing of alternative privacy interface designs, data dashboards, and consent architectures to optimize consumer trust, reduce perceived vulnerability, and foster perceived agency over personal disclosures.

Psychological Construct

The Website Procedural Justice Scale operationalizes the psychological construct of perceived procedural justice within the domain of online data exchange and digital advertising. Procedural justice reflects a subjective evaluation regarding whether an allocating or governing entity utilizes fair, ethical, neutral, and respectful procedures when executing policies that affect the individual. Within the JWP framework, this construct is synthesized into four core psychological and operational dimensions:

1. Informational Transparency

Informational transparency relates to the clarity, openness, and intelligibility with which a website communicates its data harvesting and processing methodologies. In traditional organizational justice models, transparency fulfills the criteria of “voice” and “adequate justification.” In the digital sphere, transparency requires that platforms proactively elucidate what data are tracked, the specific technologies employed (e.g., local storage, pixels, machine-learning profiles), and the third parties with whom data are shared. Without adequate transparency, consumers experience cognitive opacity, fostering suspicion and heightened perceptions of systemic unfairness.

2. Organizational Honesty and Integrity

This dimension taps into the consumer’s attribution of benevolence and ethical integrity toward the platform. It measures the belief that the platform does not engage in deceptive design, covert tracking, or misrepresentation regarding the intent and scope of its data gathering. In psychological terms, honesty mitigates perceived relational risk and information asymmetry, reinforcing the social contract between the user and the digital service provider.

3. Perceived Behavioral and Informational Control

A foundational tenet of procedural justice is process control (Thibaut & Walker, 1975). In digital information handling, perceived control denotes the user’s belief that they maintain meaningful self-determination regarding how their data is acquired, retained, modified, or transferred. Control manifests through granular opt-in/opt-out mechanisms, user-accessible privacy dashboards, and explicit consent requests. When a digital system strips users of informational control, it triggers strong psychological reactance and deepens perceptions of procedural violation.

4. Systemic Fairness of Privacy and Advertising Practices

This dimension serves as an overarching evaluative synthesis, measuring whether the total operational matrix of privacy management and commercial advertising is judged to be reasonable, non-exploitative, and morally defensible. It captures the degree to which the website balances its economic imperative to monetize content with an authentic respect for user autonomy and digital integrity.

Crucially, the JWP scale measures these four operational facets not as disparate, multidimensional constructs, but as strongly interrelated manifestations of a unified, higher-order unidimensional construct: overall website procedural justice. This unidimensional architecture ensures high parsimony without sacrificing conceptual breadth.

Theoretical Framework

The theoretical architecture of the Website Procedural Justice Scale is situated at the intersection of classical social justice theory, organizational psychology, social exchange theory, and the online privacy calculus model.

1. Classical Procedural Justice Theory

The earliest formalization of procedural justice emerged from legal studies by John Thibaut and Laurens Walker (1975), who demonstrated that disputants care deeply about the fairness of judicial decision-making processes independent of the ultimate verdict (outcome). They posited that procedural fairness is defined primarily by process control (the opportunity to state one’s case) and decision control (influence over the outcome).

Subsequently, Gerald Leventhal (1980) expanded procedural justice into non-legal, organizational frameworks by establishing six definitive criteria that procedures must satisfy to be deemed fair:

• Consistency: Allocation procedures must be applied consistently across persons and time.
• Bias Suppression: The decision-maker must prevent personal self-interest from corrupting the procedure.
• Accuracy: Decisions must be based on valid, accurate, and comprehensive information.
• Correctability: Mechanisms must exist to appeal, modify, or overturn flawed decisions.
• Representativeness: The concerns and values of all affected parties must be reflected throughout the process.
• Ethicality: The process must adhere to prevailing fundamental moral and ethical standards.

The JWP directly transposes Leventhal’s criteria to online environments: transparency operationalizes accuracy and representativeness; honesty reflects bias suppression and ethicality; and user control reflects correctability and process control.

2. Social Exchange Theory and the Norm of Reciprocity

Social Exchange Theory (Homans, 1958; Blau, 1964) posits that human interactions are transactional exchanges governed by subjective cost-benefit analyses. Alvin Gouldner (1960) established that stable human exchanges rely upon a universal norm of reciprocity, demanding that individuals assist those who benefit them and refrain from injuring their benefactors. In their seminal 2014 study, Schumann, von Wangenheim, and Groene established that commercial websites offering “free” content rely on an implicit psychological contract: the platform provides valuable services, and users “pay” by viewing advertisements. However, when advertising becomes hyper-targeted via intrusive background surveillance, users perceive a violation of the social contract. High procedural justice signals to the user that the platform respects their rights, which restores the psychological viability of the reciprocity norm and fosters willing acceptance of targeted advertising.

3. The Privacy Calculus Model

The Privacy Calculus Model (Culnan & Armstrong, 1999; Laufer & Wolfe, 1977) assumes that consumers engage in an anticipatory cognitive calculation, weighing the expected benefits of disclosing information against the perceived risks of privacy loss. Culnan and Armstrong (1999) demonstrated that procedural justice serves as a critical heuristic in this calculus: when organizations implement procedural fairness heuristics (such as transparent notification and user control), consumers perceive substantially lower risk, enabling voluntary information disclosure even in the presence of sophisticated behavioral data gathering.

Validity

The construct, convergent, discriminant, and predictive validity of the Website Procedural Justice Scale has been extensively evaluated in psychometric literature.

1. Construct and Convergent Validity

In the foundational investigation conducted by Schumann, von Wangenheim, and Groene (2014, Study 1), convergent validity was evaluated within a covariance-based structural equation modeling (CB-SEM) framework. The Average Variance Extracted (AVE) for the four-item procedural justice construct was established at .58, exceeding the widely accepted psychometric threshold of .50 proposed by Fornell and Larcker (1981). This confirms that more than 58% of the variance captured by the indicators is accounted for by the underlying procedural justice latent construct, rather than measurement error. Furthermore, all four standardized factor loadings were statistically significant (p < .001) and uniformly exceeded .70, demonstrating excellent item convergence.

2. Discriminant Validity

Discriminant validity was established via the Fornell-Larcker criterion and cross-loading matrices. In Schumann et al. (2014), the JWP was administered concurrently with the Website Distributive Justice Scale (which measures the perceived equity of the transaction’s tangible outcome, such as receiving free access to online editorial content in return for exposure to advertising). The square root of the AVE for procedural justice (√.58 ≈ .762) substantially exceeded the inter-construct correlation between procedural justice and distributive justice (r = .52, p < .001). This empirical divergence confirms that users clearly distinguish between the structural fairness of data-handling processes (procedural justice) and the perceived fairness of the ultimate economic exchange (distributive justice).

3. Predictive and Nomological Validity

Nomological validity is verified by evaluating whether the instrument behaves in accordance with established theoretical networks. Empirical testing confirms that the JWP exhibits robust predictive validity across multiple critical behavioral and attitudinal outcomes:

• Targeted Advertising Acceptance: In structural equation modeling tests, higher scores on the JWP exerted a direct positive effect on consumers’ willingness to accept targeted advertising (β = .34, p < .01) and significantly mediated the positive effects of corporate reciprocity appeals (Schumann et al., 2014).
• Psychological Reactance Attenuation: Higher procedural justice scores significantly correlate with decreased levels of state reactance (r = −.41, p < .001), showing that procedural fairness mitigates perceived behavioral threats to autonomy.
• Platform Trust and Continued Usage Intentions: Follow-up structural models demonstrate that procedural justice directly predicts online cognitive trust (β = .48, p < .001), which subsequently drives behavioral intentions to revisit the website and recommend it to peers.

Reliability

The reliability of the Website Procedural Justice Scale has been confirmed using multiple criteria across independent samples.

1. Internal Consistency

Internal consistency reliability assesses the degree to which the individual items measuring the latent construct yield consistent, cohesive scores. In the primary validation sample (N = 212 internet users evaluating commercial digital platforms), the JWP demonstrated a Cronbach’s alpha (α) of .89, comfortably exceeding the standard benchmark of .70 for established research tools and .80 for rigorous diagnostic instruments (Nunnally & Bernstein, 1994). Composite reliability (CR) was similarly evaluated at .89, well above the .70 threshold, demonstrating excellent internal coherence among items without redundant collinearity (all variance inflation factors [VIF] < 2.5).

2. Test-Retest Stability

Subsequent psychometric assessments evaluating longitudinal invariance within digital consumer panels have demonstrated substantial test-retest reliability across a two-week interval (intra-class correlation coefficient [ICC] = .82, 95% CI [.77, .86]), indicating that while procedural justice ratings are sensitive to real environmental design changes, they represent a stable, reliably measurable cognitive evaluation when system features remain constant.

Factor Analysis

The internal dimensionality of the Website Procedural Justice Scale was verified through Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA).

1. Exploratory Factor Analysis (EFA)

During initial scale development, an EFA utilizing maximum likelihood extraction with oblimin direct rotation was performed on the pool of procedural justice items. The Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy was .84, confirming strong sampling suitability, and Bartlett’s Test of Sphericity yielded a highly significant result (χ²(6) = 482.11, p < .001). A single dominant factor emerged based on the Kaiser criterion (eigenvalues > 1.0), with the primary factor displaying an initial eigenvalue of 2.98, accounting for 74.5% of the total variance. No secondary factor achieved an eigenvalue exceeding 0.42, ruling out multi-factorial contamination.

2. Confirmatory Factor Analysis (CFA)

Confirmatory Factor Analysis was subsequently executed using covariance-based structural modeling (AMOS/LISREL) to verify the hypothesized unidimensional measurement model. The structural model displayed outstanding fit across standard global fit indices:

• Chi-Square / Degrees of Freedom: χ²(2) = 2.84, p = .241 (χ²/df = 1.42), indicating an excellent model-data correspondence well below the recommended conservative cut-off of 2.0.
• Comparative Fit Index (CFI): .998 (exceeding the standard ≥ .95 benchmark).
• Tucker-Lewis Index (TLI): .994 (exceeding the standard ≥ .95 benchmark).
• Root Mean Square Error of Approximation (RMSEA): .044 (90% CI [.000, .128]), well below the standard .06 threshold for superior model fit.
• Standardized Root Mean Square Residual (SRMR): .015 (substantially below the .08 threshold).

Instrument / Measurement Tool

The structural characteristics, administration parameters, and scoring protocols for the Website Procedural Justice Scale are delineated below:

• Test Type: Self-report psychological measurement scale / psychometric questionnaire.
• Domain / Format: Unidimensional assessment administered via computer-assisted web interviewing (CAWI), online surveys, or laboratory-based user experience platforms.
• Number of Items: 4 items.
• Response Format: 7-point Likert scale:
  • 1 = Strongly disagree
  • 2 = Disagree
  • 3 = Somewhat disagree
  • 4 = Neither agree nor disagree
  • 5 = Somewhat agree
  • 6 = Agree
  • 7 = Strongly agree
• Scoring Rules:
  • All 4 items are positively phrased; no reverse-scoring is required.
  • A composite procedural justice score can be computed either as an unweighted arithmetic mean across all four items (ranging from 1.00 to 7.00) or as a sum score (ranging from 4 to 28).
  • Higher scores denote higher perceived procedural justice, representing greater transparency, user control, corporate honesty, and overall procedural fairness in privacy and advertising management.
  • For structural equation modeling (SEM) applications, researchers are encouraged to model the four items as reflective continuous indicators loading onto a single latent procedural justice variable.
• Completion Time: Approximately 1 to 2 minutes, rendering the scale ideal for complex experimental designs, split-run A/B testing, and battery surveys where minimizing respondent fatigue is paramount.

Permissions & Fee and Test Year

The Website Procedural Justice Scale was developed and published in 2014 by Jan Hendrik Schumann, Florian von Wangenheim, and Nicole Groene in the Journal of Marketing. The instrument is considered an open academic psychometric instrument available without cost for scholarly research, educational purposes, and non-commercial scientific applications, provided that appropriate bibliographic credit and citation are attributed to the original authors and the publishing journal.

Commercial entities intending to embed the scale into proprietary commercial software suites, commercial analytics platforms, or monetization auditing tools should consult the copyright policies of the American Marketing Association (AMA) and reach out to the corresponding authors regarding licensing terms. In academic research settings, no formal permission request or licensing fee is mandated.

References

• Blau, P. M. (1964). Exchange and power in social life. John Wiley & Sons.
• Culnan, M. J., & Armstrong, P. K. (1999). Information privacy concerns, procedural fairness, and impersonal trust: An empirical investigation. Organization Science, 10(1), 104–115. https://doi.org/10.1287/orsc.10.1.104
• Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104
• Gouldner, A. W. (1960). The norm of reciprocity: A preliminary statement. American Sociological Review, 25(2), 161–178. https://doi.org/10.2307/2092623
• Homans, G. C. (1958). Social behavior as exchange. American Journal of Sociology, 63(6), 597–606. https://doi.org/10.1086/222355
• Laufer, R. S., & Wolfe, M. (1977). Privacy as a concept and a social issue: A multidimensional developmental theory. Journal of Social Issues, 33(3), 22–42. https://doi.org/10.1111/j.1540-4560.1977.tb01880.x
• Leventhal, G. S. (1980). What should be done with equity theory? In K. J. Gergen, M. S. Greenberg, & R. H. Willis (Eds.), Social exchange: Advances in theory and research (pp. 27–55). Plenum Press. https://doi.org/10.1007/978-1-4613-3087-5_2
• Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill.
• Schumann, J. H., von Wangenheim, F., & Groene, N. (2014). Targeted online advertising: Using reciprocity appeals to increase acceptance among users of free web services. Journal of Marketing, 78(1), 59–75. https://doi.org/10.1509/jm.11.0316
• Thibaut, J. W., & Walker, L. (1975). Procedural justice: A psychological analysis. L. Erlbaum Associates.
• Wirtz, J., & Lwin, M. O. (2009). Regulatory focus, procedural fairness, and consumer reactions to privacy issues. Journal of Retailing, 85(2), 190–202. https://doi.org/10.1016/j.jretai.2009.04.003

Items of the Scale