Abstract
The Procedural Justice in Performance Appraisal scale, developed by James H. Dulebohn and Gerald R. Ferris (1999), is an established psychometric instrument designed to evaluate employee perceptions regarding the fairness, objectivity, and structural integrity of performance evaluation procedures. Within industrial and organizational psychology, performance appraisal serves as a foundational human resource mechanism that directly influences compensation, promotion, professional development, and retention. However, the perceived legitimacy and utility of appraisals depend substantially on whether subordinates view the evaluation process as procedurally equitable. The instrument comprises six carefully formulated items divided across two distinct response formats: four items assessing structural and interpersonal procedural elements (e.g., job-relevant criteria, freedom from personal bias, respect, and protection of employee rights) utilizing a 4-point Likert agreement scale, and two items capturing global assessments of supervisor fairness and effort utilizing a 4-point intensity scale. Psychometric validation conducted by Dulebohn and Ferris demonstrated strong internal consistency, yielding a Cronbach’s alpha of .86. Confirmatory factor analyses demonstrated that procedural justice in appraisal settings is empirically distinct from related social-exchange constructs, including leader-member exchange (LMX), employee voice opportunity, and decision control. The scale exhibits robust criterion-related and construct validity, correlating significantly with upward influence tactics, supervisory ratings, and organizational citizenship behaviors. This paper presents an extensive academic overview of the instrument, delineating its theoretical foundation, psychometric properties, structural composition, scoring protocols, and research applications.
Keywords
Procedural justice, performance appraisal, organizational justice, performance evaluation, Dulebohn and Ferris, employee voice, psychometrics, leader-member exchange, performance management, appraisal fairness
Authors
The scale was developed and validated by James H. Dulebohn and Gerald R. Ferris in their foundational 1999 study published in the Academy of Management Journal.
- James H. Dulebohn, Ph.D.: Professor Emeritus of Human Resource Management and Organizational Behavior in the School of Human Resources and Labor Relations at Michigan State University. Dr. Dulebohn has published extensively on organizational justice, compensation systems, leader-member exchange, human resource information systems, and organizational politics.
- Gerald R. Ferris, Ph.D.: Renowned scholar and Francis Eppes Professor Emeritus of Management and Psychology at Florida State University. Dr. Ferris is widely recognized for his theoretical and empirical work on social influence processes in organizations, political skill, performance evaluation, and human resource management theory.
Purpose
Performance appraisal represents one of the most critical, yet frequently contested, administrative and developmental practices in modern organizations. While traditional evaluation research focused predominantly on rating accuracy, psychometric errors (such as halo, central tendency, and leniency effects), and cognitive processing of raters, contemporary human resource management emphasizes the social and psychological context within which ratings occur. The primary purpose of the Procedural Justice in Performance Appraisal measure is to quantify the degree to which employees perceive that the administrative procedures, evaluative standards, and supervisory behaviors governing their formal performance review are equitable, objective, and ethically sound.
From an applied perspective, negative employee perceptions of appraisal procedures are linked to adverse outcomes, including workplace cynicism, reduced affective commitment, turnover intentions, decreased motivation, and litigation risk. Conversely, when employees perceive the appraisal framework as procedurally just, they are significantly more receptive to constructive feedback, more likely to accept unfavorable ratings, and more inclined to engage in discretionary organizational citizenship behaviors (OCBs). The instrument provides organizational researchers and human resource practitioners with an empirically validated diagnostic tool to identify structural flaws in performance management systems, assess managerial compliance with fair evaluation protocols, and investigate how procedural justice interacts with managerial influence tactics and interpersonal dynamics.
Psychological Construct
The psychological construct assessed by this instrument is situated within the broader domain of organizational justice, specifically operationalized within the high-stakes context of formal employee evaluations. While distributive justice focuses exclusively on the fairness of tangible outcomes (such as merit pay increases, promotions, or numerical score allocations), procedural justice concerns the perceived fairness of the rules, mechanisms, and decision-making processes through which those outcomes are determined.
In the framework established by Dulebohn and Ferris (1999), procedural justice in performance appraisal encompasses several core psychological dimensions:
- Accuracy and Job-Relevance of Information: Reflects the extent to which the appraiser systematically grounds the evaluation in authentic, core job dimensions rather than peripheral tasks or irrelevant criteria. When supervisors assess employees based on well-defined duties, employees experience greater psychological safety and perceived validity.
- Suppression of Personal Bias and Subjectivity: Measures the degree to which the evaluation is perceived as objective and insulated from supervisor favoritism, idiosyncratic personal opinions, or non-work-related animus.
- Ethicality and Consideration for Employee Rights: Assesses whether the supervisory authority conducts the appraisal interview and delivers evaluative outcomes in a manner that respects employee dignity, fundamental employment rights, and professional standing. Although this dimension shares conceptual boundaries with interactional justice, Dulebohn and Ferris conceptualize ethical interpersonal treatment as an indispensable component of structural procedural fairness within appraisal administration.
- Global Motivational Fairness and Good-Faith Effort: Captures the employee’s overarching perception of whether the evaluating supervisor actively and genuinely endeavored to achieve a fair and equitable outcome.
Theoretical Framework
The instrument is grounded in foundational social-psychological and organizational justice theories developed over the past five decades.
Leventhal’s Procedural Justice Rules
A central foundation of the scale is Gerald Leventhal’s (1980) allocation preference theory, which posits that individuals evaluate the procedural fairness of allocation systems against six universal criteria: consistency across persons and time, bias suppression, accuracy of information, correctability (the presence of appeal mechanisms), representativeness (voice and inclusion of affected parties), and ethicality (adherence to fundamental moral standards). Dulebohn and Ferris’s items directly translate Leventhal’s accuracy, bias suppression, and ethicality rules into observable appraisal practices.
Thibaut and Walker’s Control Model
Earlier procedural justice theory by John Thibaut and Laurens Walker (1975) distinguished between process control (the opportunity to present evidence and arguments, known as “voice”) and decision control (actual control over the eventual outcome). In performance management, complete decision control rarely rests with the subordinate. Consequently, procedural justice mechanisms—specifically ensuring that the rater reviews comprehensive performance data and considers employee input—serve as essential cognitive safeguards, substituting for lack of outcome control and preserving systemic legitimacy.
Social Exchange and Fairness Heuristic Theory
According to social exchange theory (Blau, 1964) and fairness heuristic theory (Lind, 2001), individuals frequently experience uncertainty regarding their relationship with organizational authorities. Performance appraisals represent moments of profound relational vulnerability. Employees utilize procedural fairness as a cognitive heuristic to gauge whether their organization respects their status, protects their long-term security, and values their contributions. When supervisors execute appraisals with high procedural integrity, it fosters psychological reciprocity, leading to heightened organizational trust and performance.
Validity
The psychometric validity of the Procedural Justice in Performance Appraisal scale was rigorously demonstrated in Dulebohn and Ferris’s (1999) field investigation involving 142 employee-supervisor dyads across multiple departments of a comprehensive public university.
Construct and Discriminant Validity
Using confirmatory factor analysis (CFA), Dulebohn and Ferris established the empirical independence of the procedural justice scale from adjacent organizational constructs. Specifically, nested model comparisons demonstrated that procedural justice is psychometrically distinct from:
- Employee Voice Opportunity (the degree to which subordinates have avenues to challenge or discuss appraisal criteria);
- Decision Control (the subordinate’s perceived ability to affect the final rating outcome);
- Leader-Member Exchange (LMX) (the overall relational quality and mutual trust between leader and follower).
The distinctness from LMX is particularly crucial, demonstrating that employees can cognitively separate their personal rapport with a manager from whether the formal appraisal process adhered to objective procedural standards.
Convergent and Criterion-Related Validity
The scale exhibited predictable, theoretically grounded correlations with both independent and dependent variables:
- Decision Control and Voice: Perceptions of procedural justice correlated positively and significantly with employee voice opportunities and perceived decision control, confirming that participatory mechanisms reinforce procedural fairness.
- Supervisor-Focused Influence Tactics: Procedural justice evaluations correlated positively with supervisor-focused upward influence tactics (e.g., ingratiation, expressing praise for supervisor accomplishments). Subordinates who utilized impression management directed toward building relational rapport with their supervisors perceived subsequent appraisal procedures to be fairer.
- Job-Focused Influence Tactics: Conversely, procedural justice correlated negatively with job-focused influence tactics (e.g., self-promotion, exaggerating work volume or asserting that one works harder than others). Employees relying heavily on aggressive self-promotional tactics reported significantly lower procedural fairness perceptions.
- Performance Appraisals Received: Procedural justice correlated positively with actual performance ratings assigned by supervisors, validating that higher received ratings coincide with higher procedural justice perceptions, while remaining an empirically separate construct from distributive outcomes.
Reliability
The internal consistency of the six-item Procedural Justice in Performance Appraisal measure is well established. In the initial empirical validation by Dulebohn and Ferris (1999), the instrument achieved a Cronbach’s alpha coefficient of .86, well above the conventional .70 psychometric threshold recommended for research instruments and approaching the .90 benchmark suggested for applied diagnostic applications.
Subsequent organizational research evaluating justice across appraisal contexts has routinely demonstrated alpha coefficients ranging from .84 to .89 across diverse occupational cohorts, including corporate knowledge workers, public sector administrative staff, and healthcare professionals. The combination of structural procedural items and overall subjective fairness evaluations maintains high inter-item covariance while avoiding redundant question wording, resulting in a low standard error of measurement (SEM) across performance levels.
Factor Analysis
Dulebohn and Ferris (1999) performed confirmatory factor analysis utilizing maximum likelihood estimation to test the structural integrity of the six items. The measurement model demonstrated that all six items loaded significantly on a single primary procedural justice factor, with standardized factor loadings typically exceeding .65, reflecting strong construct saturation.
To substantiate structural divergence, Dulebohn and Ferris compared a hypothesized multi-factor model—differentiating procedural justice, employee voice, decision control, and leader-member exchange—against alternative, constrained nested models (such as single-factor models combining all justice and social exchange constructs). The hypothesized four-factor model yielded superior goodness-of-fit indices (demonstrated by a non-significant chi-square difference test relative to less restrictive models, high Comparative Fit Index [CFI], Goodness-of-Fit Index [GFI] exceeding .90, and low Root Mean Square Error of Approximation [RMSEA]). These findings confirm that while interpersonal dynamics and process influence intersect during appraisal reviews, employees process procedural justice as a coherent, unitary psychometric construct.
Instrument / Measurement Tool
- Instrument Name: Procedural Justice in Performance Appraisal Scale
- Authors: James H. Dulebohn and Gerald R. Ferris (1999)
- Target Population: Employed adults undergoing formal supervisor-led performance evaluations
- Number of Items: 6 items
- Administration Format: Self-report questionnaire (paper-and-pencil or digital survey platform)
- Completion Time: Approximately 2 to 3 minutes
- Structure & Response Scales:
- Items 1 through 4: Evaluated using a 4-point Likert scale (1 = Strongly disagree, 2 = Disagree, 3 = Agree, 4 = Strongly agree). These items focus on job relevance, objectivity, interpersonal consideration, and rights preservation.
- Items 5 and 6: Evaluated using a 4-point intensity scale (1 = Not at all, 2 = To a slight extent, 3 = To a moderate extent, 4 = Very much). These items measure supervisory effort toward fairness and overall perceived fairness of treatment.
- Scoring Protocol: All items are positively keyed. Individual item responses are summed and divided by the total number of items (6) to compute an overall mean procedural justice score ranging from 1.00 to 4.00, where higher scores reflect greater perceived procedural justice in performance evaluations.
Permissions & Fee and Test Year
The scale was published in 1999 in the Academy of Management Journal (Vol. 42, No. 3). The copyright is held by the Academy of Management. The scale items are reproduced in published scientific literature (Table 3, p. 295). For non-profit academic research, university coursework, and independent non-commercial scholarly inquiries, the instrument is generally accessible under fair-use principles, provided appropriate academic citation is maintained. Commercial use, inclusion in fee-for-service consulting packages, or large-scale corporate implementation requires formal permissions and potential licensing fees arranged through the Copyright Clearance Center (CCC) or the Academy of Management directly.
References
- Bies, R. J., & Moag, J. S. (1986). Interactional justice: Communication criteria of fairness. In R. J. Lewicki, B. H. Sheppard, & M. H. Bazerman (Eds.), Research on Negotiation in Organizations (Vol. 1, pp. 43-55). JAI Press.
- Blau, P. M. (1964). Exchange and power in social life. John Wiley & Sons.
- Colquitt, J. A. (2001). On the dimensionality of organizational justice: A construct validation of a measure. Journal of Applied Psychology, 86(3), 386-400. https://doi.org/10.1037/0021-9010.86.3.386
- Dulebohn, J. H., & Ferris, G. R. (1999). The role of influence tactics in perceptions of performance evaluations’ fairness. Academy of Management Journal, 42(3), 288-303. https://doi.org/10.5465/256918
- Folger, R., & Cropanzano, R. (1998). Organizational justice and human resource management. SAGE Publications. https://doi.org/10.4135/9781452231525
- Leventhal, G. S. (1980). What should be done with equity theory? New approaches to the study of fairness in social relationships. In K. J. Gergen, M. S. Greenberg, & R. H. Willis (Eds.), Social exchange: Advances in theory and research (pp. 27-55). Plenum Press. https://doi.org/10.1007/978-1-4613-3087-5_2
- Lind, E. A. (2001). Fairness heuristic theory: Justice judgments as relational heuristics. In J. Brockner & R. Cropanzano (Eds.), Advances in organizational justice (pp. 56-88). Stanford University Press.
- Thibaut, J. W., & Walker, L. (1975). Procedural justice: A psychological analysis. L. Erlbaum Associates.