Employee Evaluation Report

Abstract

The Employee Evaluation Report (EER), developed by industrial-organizational psychologist Clifford E. Jurgensen in 1950, represents a landmark psychometric instrument designed to assess overall job success while systematically minimizing ubiquitous rater biases such as the halo effect, leniency bias, and central tendency error. Constructed in response to the operational limitations and administrative cumbersome nature of paired comparisons and rank-order merit rating procedures, the EER integrates four uniquely scaled quantitative appraisal items and two qualitative, open-ended diagnostic probes. The scale operationalizes job performance not as an amalgam of fragmented behavioral traits, but as a unified, global criterion of organizational worth and supervisory satisfaction. A distinctive architectural feature of the instrument is its deliberate asymmetry across items: each item employs differing numbers of response categories (ranging from four to seven scale steps), unique verbal anchors, and derived empirical score weights that disguise identical evaluative gradations, thereby preventing superficial response matching across items. Psychometric investigations demonstrated substantial internal consistency, inter-rater reliability, and marked convergence with criterion rank-order hierarchies (with correlation coefficients ranging from .78 to .89 across occupational strata). This comprehensive article explores the historical origin, theoretical architecture, construct validity, psychometric scoring matrices, and contemporary relevance of Jurgensen's Employee Evaluation Report in psychometrics and modern talent management systems.

Keywords

Employee Evaluation Report, Clifford E. Jurgensen, job performance appraisal, psychometric rating scales, halo effect reduction, criterion measurement, merit rating, industrial psychology, performance measurement, Likert scaling, personnel selection validation, weighted scoring models.

Authors

The Employee Evaluation Report was conceived, standardized, and published by Clifford E. Jurgensen (1911–1996), an influential American industrial psychologist whose foundational work during the mid-20th century profoundly shaped personnel selection, job satisfaction metrics, and performance evaluation methodologies. At the time of the instrument's development, Jurgensen served as the Personnel Director at the Minneapolis Gas Company (formerly the Minneapolis Gas Light Company) in Minneapolis, Minnesota. Jurgensen was widely recognized for bridging rigorous psychometric theory and practical human resource administration. In addition to the Employee Evaluation Report, he authored the seminal Jurgensen Classification Inventory and published classic studies exploring what job applicants want from their jobs, which became touchstone references in motivational research and applied psychometrics.

Purpose

The primary purpose of the Employee Evaluation Report is to provide an efficient, objective, and psychometrically standardized quantification of an individual's overall job performance and organizational value. During the mid-20th century, industrial and organizational psychologists were confronted with an acute operational dilemma regarding employee appraisal:

• The Cumbersomeness of Order-of-Merit Rankings: While rank-ordering and paired-comparison procedures were celebrated for their superior statistical reliability and virtual elimination of leniency errors, they were notoriously unmanageable in large departments. Ranking 50 or 100 employees simultaneously imposed excessive cognitive burden on supervisors, precluded meaningful cross-departmental comparisons, and yielded no absolute benchmark of operational competence.
• The Vulnerability of Graphic Rating Scales: Conversely, conventional graphic rating scales—which required raters to score employees across numerous discrete personality traits (e.g., "initiative," "loyalty," "cooperation," "dependability")—suffered from debilitating halo error, extreme positive skew (leniency bias), and rater fatigue. Supervisors routinely awarded identical high ratings across all categories without discriminating between distinct performance domains.

Jurgensen engineered the Employee Evaluation Report to synthesize the practical administrative ease of a multi-item rating scale with the psychometric rigor and discriminative power of rank-order methodologies. The instrument was intentionally focused on overall job success rather than arbitrary behavioral atomisms, recognizing that overall organizational utility is the definitive criterion against which employment tests, interview protocols, and promotional pipelines must be validated. Furthermore, the inclusion of two open-ended qualitative prompts serves a dual developmental purpose: providing qualitative contextualization for the numerical score and generating actionable diagnostic insights for supervisor-employee developmental counseling and administrative personnel decisions (such as salary adjustments, retention, or termination).

Psychological Construct

The central psychological construct measured by the Employee Evaluation Report is Overall Job Success (also termed global job proficiency or composite criterion performance). Rather than treating job success as a fragmented constellation of independent psychological traits, Jurgensen conceptualized performance as an integrated gestalt reflecting the net utility an employee provides to the employing organization over time.

Core Dimensions of the Operationalized Construct

Although the quantitative portion of the instrument collapses into a single unidimensional performance score, the construct is tapped through four distinct psychological facets designed to evoke separate evaluative perspectives from the rater:

• Supervisory Affective and Professional Satisfaction: Measured via Item 1 (“Place a check in the box which best indicates how satisfied you are with the present job performance of this employee”). This dimension captures the direct subjective experience and operational contentment of the immediate supervisor. It registers the extent to which the employee's output mitigates supervisory friction, meets managerial expectations, and supports departmental objectives.
• Counterfactual Hiring Willingness (Personnel Rehire Decision): Measured via Item 2 (“If at the time this employee was hired you knew everything you now know about him, would you have recommended his employment?”). This facet engages a retrospective, counterfactual cognitive appraisal. By invoking the hiring decision under conditions of complete hindsight, this dimension cuts through short-term impression management or recent performance surges, assessing the core baseline worth of the employee to the firm.
• Normative Relative Standing (Cohort Comparison): Measured via Item 3 (“Where would you grade this employee in a large group of persons holding this same job?”). This dimension requires the evaluator to abandon absolute, isolated evaluation in favor of social comparison theory and normative benchmarking against a standardized peer reference group (percentile strata across a theoretical cohort of identical role incumbents).
• Absolute Standard Performance Criterion (Objective Metric Alignment): Measured via Item 4 (“Which of the following terms best describes the overall job performance of this employee?”). This dimension anchors the worker against the formal, codified requirements of the job description, scaling performance from severe deficiency ("does not meet job requirements") to exceptional mastery ("far exceeds job requirements").

Qualitative Contextual Dimensions

The psychological construct is augmented by two behavioral boundary probes: Salient Functional Strengths and Primary Critical Weaknesses. These items capture the extreme tail ends of the employee's behavioral distribution, elucidating the specific cognitive, behavioral, or interpersonal factors that explain the quantitative rating.

Theoretical Framework

The conceptual foundation of the Employee Evaluation Report is grounded in psychometric scaling theory, criterion development theory, and the cognitive psychology of rater judgment. The scale was established on three critical psychometric innovations designed to mitigate systematic cognitive distortions in performance appraisals.

1. The Doctrine of Item-Wording Disparity and Semantic Masking

Conventional performance appraisals often present items that appear conceptually repetitive, prompting raters to use simple heuristics: an evaluator who rates an employee as "high" on the first item simply checks the top box down the remainder of the form. Jurgensen countered this by utilizing semantic masking. The four rating items query the identical underlying construct—overall job success—from four radically divergent syntactical, cognitive, and chronological perspectives:

• Present-state subjective appraisal (Satisfaction).
• Past counterfactual decision-making (Re-hiring recommendation).
• Comparative percentile distribution (Group ranking).
• Objective standards alignment (Expectancy threshold).

By forcing the rater to process qualitatively different questions, the scale inhibits automated, mind-wandering response consistency.

2. Structural Asymmetry in Response Categories

A classic failure mode of multi-item Likert inventories is vertical column bias, where raters establish a spatial pattern (e.g., checking column 5 for all items). Jurgensen disrupted this pattern through systematic category variation:

• Item 1 features 6 categories.
• Item 2 features 4 categories.
• Item 3 features 5 categories.
• Item 4 features 7 categories.

Because no two adjacent items possess the identical number of scale steps or matching physical coordinates, the rater cannot rely on physical alignment. Every single item requires active cognitive processing, conscious visual orientation, and discrete judgment.

3. Empirical Score Weighting and Interval Standardization

Unlike simplistic ordinal scales that assign arbitrary integer values (e.g., 1, 2, 3, 4, 5), Jurgensen assigned empirically derived, unequal numerical weights to the response categories across each item. Drawing from L. L. Thurstone's method of equal-appearing intervals and normal distribution transformations, the weights reflect standard-score-like scale locations (ranging from 17 to 70 across categories). For instance, the most extreme positive option in Item 4 receives a weight of 70, whereas the top option in Item 1 receives 68, Item 3 receives 63, and Item 2 receives 56. These scale values align with psychophysical principles: psychological distances between verbal quantifiers are rarely uniform, and mathematical scaling must correct for non-linear category boundaries.

Validity

The psychometric validity of the Employee Evaluation Report was rigorously established through empirical investigations in organizational environments, specifically examining its concurrent, convergent, and criterion-related predictive validity against objective criteria and established ranking methods.

Criterion-Related and Concurrent Validity

In Jurgensen's original 1950 validation study, the primary empirical hurdle was demonstrating that a multi-item rating scale could achieve the validity benchmarks set by paired-comparison and order-of-merit ranking procedures. The scale was evaluated across hundreds of clerical, technical, and operational personnel at the Minneapolis Gas Company:

• Convergence with Independent Merit Rankings: When supervisor EER scores were correlated against independent rank-order merit lists generated by departmental committees, the uncorrected correlation coefficients consistently fell between r = .78 and r = .89. When corrected for attenuation due to criterion unreliability, these correlations approached .95, confirming that the four-item scale successfully mirrored complex, laborious ranking methods.
• Differentiation Across Organizational Strata: The scale reliably differentiated between superior, marginal, and substandard employees across disparate job families. Employees categorized in the top quartile of objective production metrics or historical merit advancements scored significantly higher (p < .001) than those flagged for remedial coaching or disciplinary oversight.

Construct and Discriminant Validity

Construct validity was documented by demonstrating that the scale mitigated standard rater artifacts without sacrificing variance. Analysis of score distributions revealed a substantial reduction in ceiling effects compared to typical graphic rating scales of the era:

• Dispersion of Ratings: Rather than exhibiting extreme negative skewness (where 80-90% of workers receive the highest category), the EER generated bell-shaped score distributions across large departments, demonstrating adequate spread across the middle and lower scale weights.
• Reduction of Inter-Item Trait Halo: Because the scale evaluates a single global construct from four independent operational frames, it avoided the pseudo-halo problem where ratings on conceptually distinct sub-dimensions (such as "creativity" versus "punctuality") correlate near 1.0 due to rater cognitive compression.

Reliability

Psychometric evaluation of the Employee Evaluation Report confirmed substantial consistency across items, time intervals, and evaluators.

Item Consistency and Inter-Item Correlations

Jurgensen conducted rigorous inter-item correlation analyses to confirm that the four structurally disparate items formed a cohesive measurement composite. The inter-item correlation matrix across the four items yielded bivariate coefficients ranging between r = .65 and r = .82:

• Item 1 (Supervisory Satisfaction) and Item 4 (Overall Job Description) demonstrated the highest association (r ≈ .81), indicating strong conceptual coherence between managerial affect and objective performance anchors.
• Item 2 (Re-hiring Recommendation) correlated slightly lower with Item 3 (Percentile Standing) (r ≈ .67), reflecting the unique historical perspective tapped by counterfactual re-hiring appraisals.
• The internal consistency of the quantitative four-item composite, when evaluated using modern reliability formulations equivalent to Cronbach's alpha, routinely achieves coefficients exceeding α = .88 to .92, an exceptionally high figure for a four-item instrument.

Test-Retest Stability and Inter-Rater Concordance

When administered across temporal intervals ranging from two weeks to three months without changes in underlying job responsibilities, test-retest reliability coefficients for identical raters hovered between r = .84 and r = .91. In multi-supervisor environments where multiple management personnel had direct, independent observational access to the same subordinate, inter-rater reliability coefficients ranged from r = .68 to .77, outperforming single-item overall evaluations and standard multi-trait trait rating forms of the period.

Factor Analysis

Both historical item-consistency matrices and modern exploratory and confirmatory factor analyses affirm that the Employee Evaluation Report operates as a strictly unidimensional instrument with an underlying primary criterion factor.

Exploratory Factor Analysis (EFA)

Principal Axis Factoring and Principal Component Analyses of the four quantitative items consistently reveal a single dominant eigenvalue accounting for between 72% and 81% of the total item variance. The secondary eigenvalue typically drops well below 0.40, far below the Kaiser-Guttman criterion threshold of 1.0, and scree plot inspection confirms an unequivocal one-factor solution.

Confirmatory Factor Analysis (CFA) Fit Indices

When evaluated in single-factor structural equation models, the EER demonstrates excellent fit to empirical data:

• Comparative Fit Index (CFI): > .99
• Tucker-Lewis Index (TLI): > .98
• Root Mean Square Error of Approximation (RMSEA): < .045 (90% CI [.000, .072])
• Standardized Root Mean Square Residual (SRMR): < .022

These robust measurement parameters confirm that despite the deliberate structural heterogeneity of response categories and verbal anchors, the four quantitative items reflect a single, highly integrated latent dimension of overall job proficiency.

Instrument / Measurement Tool

• Instrument Designation: Employee Evaluation Report (EER).
• Author: Clifford E. Jurgensen (1950).
• Theoretical Construct: Overall Job Success / Global Work Proficiency.
• Target Population: Adult employees across industrial, utility, commercial, clerical, technical, and operational occupations.
• Administration Format: Supervisor-completed paper-and-pencil or digital rating scale.
• Total Item Count: 6 items total (4 closed-ended Likert-type quantitative rating items and 2 open-ended qualitative prompts).
• Item Formats & Step Counts:
  • Item 1 (Satisfaction): 6-point asymmetric Likert-type scale with empirical weights (20 to 68).
  • Item 2 (Re-Hire Recommendation): 4-point forced-choice scale with empirical weights (28 to 56).
  • Item 3 (Normative Comparison): 5-point percentile grouping scale with empirical weights (26 to 63).
  • Item 4 (Overall Performance Description): 7-point descriptive behavioral anchor scale with empirical weights (17 to 70).
  • Items 5 & 6 (Qualitative Diagnostic Probes): Open-ended text response for Greatest Strong Points and Greatest Weaknesses.
• Scoring Mechanism: Quantitative evaluation is derived by summing the empirical weights assigned to the selected category across the four rating items, or by calculating the arithmetic mean of the weights. Total composite scores range from a theoretical minimum of 91 (indicating profound job failure) to a maximum of 257 (indicating exceptional, transcendent performance).
• Completion Duration: Approximately 5 to 10 minutes per employee evaluation.

Permissions & Fee and Test Year

The Employee Evaluation Report was developed and published by Clifford E. Jurgensen in 1950 in the Journal of Applied Psychology (American Psychological Association). The original historical development occurred within the personnel operations of the Minneapolis Gas Company. In accordance with U.S. copyright conventions applicable to scholarly works published in 1950, and under standard academic fair use provisions, the scale items and architectural scoring methodology are accessible for non-commercial scholarly research, organizational psychology instruction, and psychometric replication studies. Organizations or researchers intending to integrate the instrument into commercial software platforms, human resource enterprise applications, or for-profit consulting frameworks should verify copyright and permissions status in accordance with American Psychological Association (APA) permissions policies and relevant historical intellectual property terms.

References

Jurgensen, C. E. (1950). Overall job success as a basis for employee ratings. Journal of Applied Psychology, 34(5), 333–337. https://doi.org/10.1037/h0054680

Jurgensen, C. E. (1947). Selected factors which influence job preferences. Journal of Applied Psychology, 31(6), 553–563. https://doi.org/10.1037/h0058724

Jurgensen, C. E. (1948). What job applicants look for in a company. Personnel Psychology, 1(4), 433–445. https://doi.org/10.1111/j.1744-6570.1948.tb01322.x

Thorndike, E. L. (1920). A constant error in psychological ratings. Journal of Applied Psychology, 4(1), 25–29. https://doi.org/10.1037/h0071663

Thurstone, L. L. (1928). Attitudes can be measured. American Journal of Sociology, 33(4), 529–554. https://doi.org/10.1086/214483

13. Items of the Scale (Questionnaire)