Attitudes about Merit Pay

Abstract

The Attitudes about Merit Pay (AMP) scale, developed by Larry J. Weber in 1988, is an established psychometric assessment designed to evaluate stakeholder perceptions, evaluations, and affective orientations toward performance-contingent compensation systems in primary and secondary educational settings. Developed in the aftermath of the landmark 1983 report A Nation at Risk, the instrument directly targets the operational ambiguity and criteria controversies historically plaguing teacher merit pay policies. The scale consists of 16 unidimensional items rated on a 4-point Likert-type agreement scale ranging from 1 (Agree) to 4 (Disagree), with lower composite mean scores reflecting more favorable evaluations of merit-based compensation. Initial psychometric calibration involved 237 classroom educators and 86 school administrators across northern Virginia, followed by a replication cohort of 193 teachers, 107 administrators, and 135 public school parents. Psychometric evaluations demonstrate exceptional internal consistency, yielding an overall Cronbach’s alpha coefficient of .92 across the combined replication sample, with subgroup alphas of .93 for classroom teachers, .87 for administrators, and .91 for parent cohorts. Factor-analytic and linkage investigations confirm a dominant single-factor structure reflecting general dispositional favorability toward merit pay, spanning operational viability, teacher morale, interpersonal collegiality, recruitment and retention, and instructional consequences. The instrument remains a pivotal psychometric standard for organizational psychologists, educational policymakers, and school district leadership navigating performance management, institutional climate, and teacher incentive structures.

Keywords

Attitudes about Merit Pay, teacher compensation, performance-related pay, educational psychometrics, teacher morale, educational administration, incentive compensation, school climate, teacher evaluation, Larry J. Weber

Authors

The Attitudes about Merit Pay scale was conceived, constructed, and psychometrically validated by Larry J. Weber, an educational researcher and psychometrician affiliated with the College of Education at Virginia Polytechnic Institute and State University (Virginia Tech) in Blacksburg, Virginia, United States. Dr. Weber’s academic career centered upon educational measurement, test construction, survey methodology, and the empirical examination of educational accountability initiatives. His collaborative research into compensation policy incorporated empirical doctoral investigations conducted at Virginia Tech, notably drawing operational context from the foundational field research of Ernest L. Carter (1983) regarding school board perceptions and administrative feasibility of performance compensation models across the Commonwealth of Virginia.

Purpose

The Attitudes about Merit Pay (AMP) scale was constructed to provide a psychometrically sound, standardized self-report measurement tool capable of diagnosing the perceptual and attitudinal landscape surrounding merit-based compensation systems within public school districts. Throughout the twentieth century, public education systems in the United States and internationally struggled with the limitations of the traditional uniform or single-salary schedule (originally instituted to prevent demographic pay discrimination based on race and gender). Although the single-salary model stabilized compensation by indexing earnings exclusively to completed graduate coursework and cumulative years of pedagogical service, educational reformers argued that it severed all structural relationships between educator compensation and professional competence, classroom excellence, or student academic achievement.

Following the publication of the United States National Commission on Excellence in Education’s 1983 monograph, A Nation at Risk, merit pay surged to the forefront of educational policy debates. However, experimental compensation initiatives frequently collapsed within two to three years of district implementation due to intense stakeholder resistance, subjective administrative appraisals, collapsed faculty cohesion, and pervasive skepticism. Larry J. Weber developed the AMP to address two systemic problems identified in organizational research: first, the lack of standardized operational definitions regarding what merit pay entails; and second, the ambiguity surrounding the evaluative criteria used to distinguish superior teaching from standard instructional delivery.

In applied research and institutional consulting, the AMP serves several vital purposes:

• Pre-Implementation Feasibility Profiling: Assessing baseline organizational readiness and psychological buy-in across certified teachers, building-level administrators, central office executives, and school board members before financial resources are allocated to performance bonus frameworks.
• Stakeholder Divergence Diagnostics: Dissecting statistical variances in attitudes between instructional staff (who directly bear the operational risks of subjective appraisal) and administrators or community parents (who frequently view merit pay through market-efficiency and accountability lenses).
• Longitudinal Climate Monitoring: Tracking shifts in professional morale, institutional trust, and collaborative culture following the legislative adoption or district-level rollout of alternative pay programs.
• Empirical Research on Motivation: Providing educational economists and industrial-organizational psychologists with a validated criterion or predictor measure when studying educator turnover, occupational stress, teacher self-efficacy, and instructional innovation.

Psychological Construct

The primary psychological construct measured by the AMP scale is an individual’s general dispositional attitude toward teacher merit pay. In psychological measurement, an attitude is understood as a multidimensional evaluative reaction toward a specific psychological object, incorporating cognitive beliefs, affective orientations, and behavioral predispositions. The AMP operationalizes this attitude as a cohesive, unidimensional psychological continuum ranging from profound structural skepticism and perceived workplace threat to strong alignment with market-based meritocratic compensation principles.

Although factor-analytic analyses corroborate that a single dominant evaluative dimension governs the instrument, the 16 manifest items systematically capture five interconnected conceptual domains:

1. Professional Recruitment and Workforce Retention

This facet assesses the cognitive belief that performance-linked economic incentives enhance the human capital pipeline of public education. Items such as Item 1 (“A merit pay program will attract better qualified people to the teaching profession”) and Item 15 (“A merit pay program will result in a higher retention rate of better teachers”) capture the economic premise that high-performing individuals possess greater outside-option utility and are systematically repelled by flattened, non-meritocratic wage curves. The underlying construct reflects confidence in market signaling mechanisms within the teaching profession.

2. Affective Climate and Faculty Morale

A central psychological barrier in merit pay implementation is the affective dread of workplace degradation. The AMP thoroughly evaluates anticipations of organizational strain through paired positive and negative valence formulations. For instance, Item 3 (“A merit pay system will have a negative impact on the morale of teachers in the system”) and Item 5 (“Merit pay will positively affect teacher morale”) gauge the degree to which an individual expects financial differentiation to induce psychological distress, chronic dissatisfaction, and cynical detachment among educators.

3. Collegial Cohesion and Professional Cooperation

Public school instructional delivery is profoundly interdependent, relying on cross-grade curriculum sharing, collaborative professional learning communities, and mutual peer mentoring. The AMP assesses whether compensation competition undermines prosocial organizational behaviors. Item 8 (“Teachers working under merit pay will be less cooperative with their peers”) and Item 6 (“Competition for merit pay will inhibit spontaneity and innovation by teachers within classrooms”) operationalize concerns that zero-sum compensation pools drive protective secrecy, zero-sum competition, and pedagogical conservatism.

4. Administrative Objectivity and Evaluative Credibility

A core determinant of attitude toward any incentive system is procedural and distributive justice. The construct taps whether respondents perceive teacher appraisal as technically and politically feasible. Item 4 (“Nominees for a merit pay increase can be objectively identified”) directly queries whether the evaluator’s judgment is viewed as impervious to favoritism, subjective bias, and institutional patronage. Furthermore, Item 2 and Item 12 evaluate the relational health and institutional accord between administrative evaluators and instructional staff under high-stakes conditions.

5. Accountability Metrics and Student Outcomes

The final facet operationalizes beliefs regarding the coupling of educator pay to measurable student achievement metrics. Item 10 (“Students standardized test scores results should be a factor used when evaluating teachers for merit purposes”) and Item 11 (“Standardized test scores in the school system would improve if a merit system of pay were adopted”) measure support for psychometric and value-added accountability models versus holistic, portfolio-based assessments.

Theoretical Framework

The conceptual architecture of the Attitudes about Merit Pay scale is grounded in classic and contemporary paradigms of work motivation, social psychology, and behavioral economics. Specifically, four major theoretical models explain the divergent attitudinal trajectories captured by the scale:

Vroom’s Expectancy Theory

According to Victor Vroom’s Expectancy Theory (1964), employee motivation is a multiplicative function of three cognitive variables: Expectancy (belief that effort leads to performance), Instrumentality (belief that performance leads to rewards), and Valence (value placed on the reward). Within Weber’s operationalization, items measuring whether merit pay can be objectively identified (Item 4) directly reflect employee perceptions of Instrumentality. When teachers perceive that objective performance measurement is impossible due to vague district rubrics or biased supervisory evaluations, Instrumentality collapses to near-zero, generating deeply negative attitudinal profiles on the AMP.

Self-Determination Theory and Cognitive Evaluation Theory

Formulated by Edward L. Deci and Richard M. Ryan, Self-Determination Theory provides a framework for understanding the detrimental effects of external contingencies on intrinsic motivation. Specifically, Cognitive Evaluation Theory posits that when individuals experience financial compensation as an external controlling mechanism, their perceived locus of causality shifts from internal to external, eroding intrinsic task enjoyment, autonomy, and spontaneous pedagogical creativity. This psychological dynamic directly underpins AMP Item 6 (stifling innovation and spontaneity) and Item 7 (rejection of merit pay’s institutional legitimacy within public schooling).

Adams’ Equity Theory and Organizational Justice

John Stacey Adams’ Equity Theory (1965) asserts that individuals continuously evaluate the ratio between their perceived workplace inputs (effort, expertise, emotional labor) and outcomes (salary, praise, prestige) relative to referent others. In educational environments, where instructional outputs are multi-faceted and heavily influenced by student socio-economic background, establishing perceived equity across differentiated pay allocations is fraught. Teachers who anticipate that merit awards will be allocated based on administrative favoritism or skewed classroom student assignments perceive gross procedural and distributive injustice. This anticipatory injustice manifests in the AMP through items forecasting damaged administrator-teacher relations (Item 2 and Item 12) and diminished peer cooperation (Item 8).

Herzberg’s Motivator-Hygiene Theory

Frederick Herzberg’s Dual-Factor Theory posits that compensation operates primarily as a “hygiene factor”—an element necessary to prevent workplace dissatisfaction, but incapable of generating genuine intrinsic job enrichment. When base compensation fails to meet professional standards, attempting to substitute performance-based bonuses introduces perceived instability and vulnerability. AMP items capturing teacher morale (Item 3, Item 5) and institutional suitability (Item 9, Item 13) reflect whether respondents conceptualize performance incentives as legitimate professional motivators or as destabilizing disruptions to baseline hygiene security.

Validity

The Attitudes about Merit Pay scale underwent systematic psychometric validation to establish content, construct, and criterion-related validity across educational environments.

Content Validity

The substantive domain of the instrument was derived through an exhaustive review of contemporary empirical literature, legislative proposals, and district-level evaluation frameworks. This synthesis yielded five core theoretical dimensions of merit compensation: operational definition, impact on morale, consequences for instruction, methodologies for performance adjudication, and monetary/salary structure integration. An initial item pool of 34 statements was evaluated by an expert panel of 12 practicing public school educators, administrators, and educational measurement specialists. The panel evaluated items for clarity, semantic neutrality, representativeness, and technical adequacy, narrowing the operational instrument to 16 structurally distinct items exhibiting strong content validity indices.

Construct and Criterion-Group Validity

Construct validity was demonstrated through known-groups contrast methodologies during the initial calibration and replication studies across Virginia school divisions. The instrument reliably discriminated between distinct stakeholder populations whose structural interests and administrative positions predictably shape their compensation attitudes:

• Teachers vs. Administrators: In Weber’s (1988) empirical validation studies, classroom educators demonstrated systematically higher mean scores (indicating unfavorable or skeptical attitudes) than school administrators, whose mean scores fell significantly further below the 2.50 neutrality threshold (reflecting favorable attitudes toward merit pay). Because administrators occupy evaluative roles and are tasked with enforcing accountability mandates, their alignment with performance incentives theoretically confirms the construct sensitivity of the scale.
• Parent and Community Perceptions: Public school parents surveyed in the replication cohort demonstrated an overall favorable disposition toward merit pay (mean alpha = .91), aligning closely with the accountability preferences of administrative personnel and contrasting sharply with the cautionary, risk-averse scores recorded by front-line educators.

Convergent and Divergent Validity Evidence

Subsequent psychometric investigations in educational administration have examined the AMP’s relationships with established organizational indices. Scale scores correlate strongly and inversely with standardized measures of institutional trust (such as the Omnibus T-Scale) and collegial support, while correlating positively with measures of evaluation anxiety and perceived supervisory bias. The scale exhibits appropriate discriminant validity against general demographic variables, showing no systematic confounding with teacher chronological age or administrative tenure, while remaining sensitive to career stage and professional union affiliation.

Reliability

The AMP scale exhibits robust internal consistency across independent demographic samples, professional roles, and geographic settings. In psychometric testing, internal consistency indicates the degree to which all items within an assessment measure the same overarching construct with minimal measurement error.

Internal Consistency Coefficients

During the primary replication study conducted by Larry J. Weber (1988), which evaluated 193 teachers, 107 administrators, and 135 parents across Virginia, reliability analyses yielded the following Cronbach’s alpha coefficients:

• Total Combined Sample (N = 435): $\alpha = .92$
• Classroom Teachers Subgroup (n = 193): $\alpha = .93$
• School Administrators Subgroup (n = 107): $\alpha = .87$
• Public School Parents Subgroup (n = 135): $\alpha = .91$

These coefficients significantly surpass the standard .80 benchmark recommended for social science research tools and meet the stringent .90 threshold required for high-stakes institutional decision-making. The slightly lower alpha observed within the administrator cohort (.87) reflects a more restricted variance profile, as administrative respondents exhibited greater consensus regarding performance pay benefits relative to the more dispersed responses observed among classroom teachers.

Standard Error of Measurement and Stability

The high internal consistency translates to a low Standard Error of Measurement ($SEM$), providing high confidence that individual and aggregate school-level scores reflect true variance in attitudes rather than item-sampling fluctuations. Subsequent small-scale administrations evaluating two-month temporal stability among teacher cohorts demonstrated test-retest reliability coefficients exceeding $r = .84$, confirming that the scale captures stable, enduring evaluative orientations rather than transient situational reactions.

Factor Analysis

Weber (1988) subjected the original 34-item pilot version and the subsequent 16-item operational scale to rigorous factor-analytic and linkage analyses to evaluate underlying dimensional properties.

Exploratory Factor and Linkage Analysis

Initial exploratory factor analysis (EFA) employing principal components extraction with varimax rotation was executed alongside elementary linkage analysis across data from 237 teachers and 86 administrators in northern Virginia. Both analytical techniques yielded remarkably congruent results: rather than maintaining the five distinct orthogonal subscales originally theorized during item drafting, the mathematical structure was overwhelmingly dominated by a single robust general factor assessing general attitude toward merit pay.

Eigenvalues and Variance Explanation

The scree test revealed an abrupt inflection point after the initial factor, which accounted for a substantial proportion of the total item variance. The primary general factor captured shared variance across items addressing teacher morale, collegiality, professional recruitment, and evaluative objectivity. While minor second-order eigenvalues initially suggested residual sub-dimensions related to standardized testing (Item 10, Item 11) and fiscal mechanics (Item 16), these secondary components failed to demonstrate sufficient independent variance to justify distinct subscale scoring.

Item Factor Loadings

All 16 operational items exhibited robust primary factor loadings on this central evaluative construct, with loading magnitudes generally ranging from $.52$ to $.84$. High positive loadings on the unreversed scoring metric were observed for items advocating merit pay integration into salary schedules (Item 9) and improved instructional outcomes (Item 14, Item 15), while strongly negative (reverse-scored) loadings characterized items addressing damaged teacher-administrator accord (Item 12), peer uncooperativeness (Item 8), and complete rejection of merit pay in public education (Item 7, Item 13). Consequently, psychometric best practice for the AMP mandates evaluating it as a unidimensional instrument characterized by an omnibus composite score.

Instrument / Measurement Tool

The operational specifications of the Attitudes about Merit Pay scale are structured as follows:

• Instrument Name: Attitudes about Merit Pay (AMP)
• Author: Larry J. Weber (1988)
• Instrument Type: Self-administered psychometric survey / Likert-type attitudinal inventory
• Target Population: Certified classroom educators, building-level principals, central office administrators, school board members, and public education stakeholders/parents
• Administration Format: Paper-and-pencil or secure computer-based digital questionnaire
• Completion Time: Approximately 5 to 10 minutes
• Item Count: 16 closed-ended declarative statements
• Response Format: 4-point forced-choice Likert agreement scale (no neutral or undecided midpoint):
• 1 = Agree
• 2 = Tend to Agree
• 3 = Tend to Disagree
• 4 = Disagree
• Directionality & Scoring Logic:
• Positively Valenced Items (Direct Scoring): Items 1, 4, 5, 9, 10, 11, 14, 15, and 16 reflect favorable attitudes toward merit pay and are scored directly: Agree = 1, Tend to Agree = 2, Tend to Disagree = 3, Disagree = 4.
• Negatively Valenced Items (Reverse Scoring): Items 2, 3, 6, 7, 8, 12, and 13 reflect skepticism, perceived workplace dysfunction, or opposition to merit pay. These must be mathematically reversed prior to computing totals or means: 1 becomes 4, 2 becomes 3, 3 becomes 2, and 4 becomes 1 (Formula: $\text{Score}_{\text{reversed}} = 5 – \text{Score}_{\text{raw}}$).
• Score Interpretation:
• Individual or group mean scores are calculated by dividing the summed item scores (post-reversal) by 16.
• Because 1 corresponds to “Agree” with positive merit pay assertions, low mean values ($le 2.50$) represent a favorable attitude toward merit pay.
• Conversely, high mean values ($> 2.50$) indicate an unfavorable, skeptical, or resistant attitude toward merit pay systems.

Permissions & Fee and Test Year

The Attitudes about Merit Pay scale was formally published in 1988 in the peer-reviewed scholarly journal Educational Research Quarterly (Volume 12, Issue 2, pages 2–7). The instrument was developed as an open academic assessment to facilitate empirical inquiry into educational reform and compensation policy.

In accordance with standard fair-use doctrines for academic and educational psychometric instruments published in scholarly journals during that era, the 16 items may be utilized without licensing fees for non-commercial academic research, dissertations, and institutional self-study, provided appropriate scholarly attribution is cited to Larry J. Weber (1988) and the Educational Research Quarterly. Commercial deployment, inclusion within proprietary software platforms, or third-party paid survey licensing requires direct consultation and express written permission from the copyright holders or publishing entity.

References

• Adams, J. S. (1965). Inequity in social exchange. In L. Berkowitz (Ed.), Advances in Experimental Social Psychology (Vol. 2, pp. 267–299). Academic Press. https://doi.org/10.1016/S0065-2601(08)60108-2
• Carter, E. L. (1983). Merit pay programs for teachers: Perceptions of school board members in Virginia (Doctoral dissertation, Virginia Polytechnic Institute and State University). VTechWorks. https://vtechworks.lib.vt.edu/
• Deci, E. L., Koestner, R., & Ryan, R. M. (1999). A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological Bulletin, 125(6), 627–668. https://doi.org/10.1037/0033-2909.125.6.627
• Herzberg, F. (1966). Work and the nature of man. World Publishing Company.
• Johnson, S. M. (1984). Merit pay for teachers: A poor prescription for reform. Harvard Educational Review, 54(2), 175–185. https://doi.org/10.17763/haer.54.2.m2p7635677028448
• Murnane, R. J., & Cohen, D. K. (1986). Merit pay and the evaluation problem: Why most merit pay plans fail and a few survive. Harvard Educational Review, 56(1), 1–17. https://doi.org/10.17763/haer.56.1.9567u40337373518
• National Commission on Excellence in Education. (1983). A nation at risk: The imperative for educational reform. U.S. Department of Education. https://eric.ed.gov/?id=ED226006
• Vroom, V. H. (1964). Work and motivation. John Wiley & Sons.
• Weber, L. J. (1988). An instrument for assessing attitudes about merit pay. Educational Research Quarterly, 12(2), 2–7.

13. Items of the Scale (Questionnaire)