Faculty Beliefs about Grades Inventory

Abstract

The Faculty Beliefs about Grades Inventory (FBGI) is an influential psychometric measurement tool developed by Laura L. B. Barnes (1997) to evaluate postsecondary educators’ implicit philosophies, conceptual frameworks, and operational values regarding academic assessment and student evaluation. Composed of 24 self-report items rated on a 7-point Likert response format, the instrument quantitatively bifurcates faculty grading philosophies into two primary latent dimensions: Frame of Reference (13 items), which assesses the tension between norm-referenced (relative or comparative) and criterion-referenced (absolute or standards-based) grading schemas; and Gatekeeping (11 items), which measures the degree to which an instructor conceptualizes grading as an institutional sorting mechanism, a safeguard of academic standards against grade inflation, and a filter for educational rigor. Psychometric evaluations conducted across university faculty samples confirm robust internal consistency, yielding Cronbach’s alpha coefficients of .86 for the Frame of Reference subscale and .83 for the Gatekeeping subscale. Construct and factorial validity were demonstrated through exploratory factor analysis with oblique rotation, establishing a well-defined two-factor structure that accounts for meaningful educational assessment variation. The FBGI serves as an essential instrument in higher education research, institutional accreditation reviews, faculty development workshops, and psychometric investigations into pedagogical philosophy, grading discrepancies across academic disciplines, and instructional reform.

Keywords

Faculty Beliefs about Grades Inventory, academic grading, norm-referenced grading, criterion-referenced grading, gatekeeping, higher education assessment, psychometrics, grade inflation, instructional evaluation, educational measurement

Authors

The Faculty Beliefs about Grades Inventory was developed and validated by Laura L. B. Barnes (Ph.D.), Professor Emerita of Educational Psychology, Research, and Evaluation in the School of Educational Foundations, Leadership, and Aviation at Oklahoma State University. Dr. Barnes specializes in educational measurement, psychometrics, structural equation modeling, applied multivariate statistics, and the study of institutional climate and academic practices in postsecondary education.

Purpose

In postsecondary education, grades represent the primary institutional currency: they dictate academic standing, scholarship eligibility, admission into competitive graduate and professional programs, and career placement. Despite their monumental consequence, institutional research has long established that grading practices across university departments remain strikingly heterogeneous, idiosyncratic, and subjective. Individual faculty members exercise vast academic autonomy when designing evaluation policies, resulting in severe grade disparities that cannot be explained solely by differences in student aptitude or disciplinary difficulty.

The primary purpose of the Faculty Beliefs about Grades Inventory is to uncover, operationalize, and quantitatively measure the foundational cognitive beliefs and philosophies that dictate these idiosyncratic grading behaviors. While previous educational measurement research focused predominantly on historical grade distributions or external grading guidelines, the FBGI captures the psychological orientation of instructors toward the purpose, fairness, and structural validity of assigning marks. By examining faculty belief structures, the inventory serves several critical educational and research objectives:

• Diagnostic Research in Higher Education: The instrument facilitates empirical investigation into why grading distributions diverge drastically across colleges and academic divisions (e.g., humanities and education versus STEM fields such as engineering, mathematics, and natural sciences).
• Faculty Development and Pedagogical Reflection: Center for Teaching and Learning (CTL) administrators utilize the inventory as a self-reflective tool in professional development workshops, helping novice and veteran instructors examine their implicit biases, evaluate alignment between learning outcomes and grading rubrics, and reconcile assessment inconsistencies.
• Investigation of Academic Integrity and Grade Inflation: Researchers examine how gatekeeping ideologies mitigate or exacerbate documented shifts in grade averages over decades, investigating the psychological resistance to mastery-based grading models.
• Alignment with Learning Theories: Educational psychologists utilize the FBGI to analyze how faculty assessment philosophies interact with modern constructivist, competency-based, and student-centered instructional designs.

Psychological Construct

The Faculty Beliefs about Grades Inventory measures a multi-faceted cognitive and pedagogical construct encompassing the belief systems, epistemic commitments, and perceived professional mandates that higher education faculty maintain toward student grading. Barnes (1997) categorized these belief systems into two distinct, conceptually rich latent dimensions:

1. Frame of Reference (Subscale 1)

The Frame of Reference dimension measures an instructor’s reliance on social-comparative (norm-referenced) versus standards-based (criterion-referenced) criteria when assigning student grades. This subscale comprises 13 items tapping into the fundamental debate regarding what an academic mark truly signifies:

• Norm-Referenced Stance: Instructors endorsing a high norm-referenced frame of reference operate under the belief that human aptitude naturally falls into a standard distribution across any given cohort. For these instructors, a grade is inherently comparative; its primary function is to indicate where a student stands in relation to peers. High scorers believe that comparative mechanics, such as “grading on the curve,” represent the objective gold standard of fairness, ensuring that the highest performing student receives an “A” regardless of absolute raw performance, while cutoffs are dynamically determined based on sample dispersion.
• Criterion-Referenced Stance: In contrast, instructors endorsing an absolute frame of reference argue that an academic grade should reflect the degree to which an individual student has mastered predefined curricular competencies and course learning objectives, entirely divorced from peer rankings. They maintain that comparative rank-ordering is artificial, arbitrary, and counterproductive to genuine learning.

2. Gatekeeping (Subscale 2)

The Gatekeeping dimension comprises 11 items assessing the degree to which a faculty member views grading as an institutional filtering mechanism, a safeguard of professional standards, and an authoritative barrier preventing unearned credentialing. Faculty with high gatekeeping orientations display the following psychological traits:

• Defense of Institutional Rigor: High gatekeepers view the distribution of high grades (especially “As”) with profound suspicion, conceptualizing frequent top marks as symptomatic of diluted academic rigor, lowered pedagogical standards, or instructor leniency.
• Protection of Credential Value: These instructors believe that lenient grading distorts authentic feedback and directly degrades the market value and social prestige of a college degree.
• Rejection of Uniform High Mastery: Gatekeepers reject the theoretical possibility that every student in a class could legitimately earn an “A,” even under conditions of optimized, highly effective instruction. They view an exam where everyone scores highly not as evidence of exemplary teaching, but as proof that the examination was fatally flawed or simplistic.

Theoretical Framework

The theoretical architecture of the FBGI is rooted in foundational paradigms of educational assessment, cognitive measurement theory, and sociological perspectives on higher education sorting functions.

The Norm-Referenced vs. Criterion-Referenced Dichotomy

The theoretical bedrock of the Frame of Reference dimension traces back to Robert Glaser’s (1963) seminal distinction between norm-referenced measurement and criterion-referenced measurement. Glaser posited that assessment must either measure an individual’s performance in relative comparison to a reference group or assess an individual’s mastery against an absolute, non-comparative standard of criterion behavior. Decades later, psychometric scholars like Geisinger and Rabinowitz (1982) demonstrated that college faculty hold deeply entrenched personal epistemologies that align cleanly with Glaser’s theoretical divide. Instructors who intuitively embrace classical testing assumptions view cognitive abilities as normally distributed within any student population, making the Gaussian “bell curve” an inescapable natural law of academic evaluation. Conversely, theorists adhering to mastery learning paradigms, pioneered by Benjamin Bloom (1968), argue that with adequate time, feedback, and individualized instructional support, up to 90% of students can attain mastery of course objectives, rendering normal-curve distributions invalid in intentional instructional contexts.

Sociological Gatekeeping and Structural Functionalism

The Gatekeeping dimension is deeply informed by sociological theories of institutional sorting and credentialism. Sociologists of education, including Goldman (1985), conceptualize the postsecondary professor not merely as a facilitator of learning, but as a sworn gatekeeper for civil society, graduate faculties, and licensed professions (e.g., medicine, law, engineering). Milton, Pollio, and Eison (1986) in their influential treatise Making Sense of College Grades, documented that grading systems are perpetually torn between two conflicting institutional mandates: the developmental/learning paradigm (grades as supportive pedagogical feedback) and the evaluative/sorting paradigm (grades as administrative sorting mechanisms). Gatekeeping beliefs embody the sorting paradigm, asserting that if educators fail to rigorously differentiate between exceptional and mediocre students, the structural signaling integrity of academic degrees collapses.

Validity

During the development and subsequent cross-validation of the Faculty Beliefs about Grades Inventory, Barnes (1997) implemented rigorous procedures to establish content, construct, and concurrent validity.

Content Validity

Content validity was established through an extensive three-tiered methodological process. Initially, Barnes conducted an exhaustive review of psychometric assessment literature, historical analyses of grade inflation, and theoretical works on postsecondary evaluation. This was supplemented by in-depth qualitative interviews conducted with active college faculty across diverse academic departments and direct classroom observation. An initial 62-item experimental pool was evaluated by subject matter experts in educational measurement. Following pilot administration on 75 faculty members using alternate forms testing, item-total correlations and qualitative feedback were used to refine the pool down to 40 candidate items for large-scale field validation.

Construct and Factorial Validity

Construct validity was demonstrated via multivariate factor analysis on a randomized sample of 243 tenure-track undergraduate faculty members across two large midwestern universities. The extracted factor structure confirmed clear separation between comparative grading beliefs and institutional gatekeeping values. The factor correlation between Frame of Reference and Gatekeeping was modest to moderate, demonstrating that while the two concepts are correlated components of academic belief systems, they represent functionally divergent psychological constructs (i.e., discriminant validity between dimensions). Furthermore, construct validity has been supported in subsequent literature examining disciplinary variations, showing that faculty in STEM disciplines score significantly higher on both comparative norm-referenced framing and gatekeeping rigor than faculty in humanities or education disciplines.

Reliability

The internal consistency reliability of the Faculty Beliefs about Grades Inventory has been rigorously examined and consistently meets high psychometric standards for survey research:

• Frame of Reference Subscale: The 13 items comprising this subscale demonstrated a Cronbach’s alpha coefficient of α = .86 in the normative validation sample of 243 university faculty members (Barnes, 1997).
• Gatekeeping Subscale: The 11 items comprising this subscale yielded a Cronbach’s alpha coefficient of α = .83.

Item-scale analyses revealed robust corrected item-total correlations across both subscales, with all retained items demonstrating correlations exceeding acceptable psychometric thresholds (> .35). Subsequent replications and pedagogical studies in higher education settings have reported comparable internal consistency coefficients, typically fluctuating between .81 and .88 across varied institutional contexts (e.g., community colleges, liberal arts universities, and R1 doctoral institutions), confirming that the items possess high temporal stability and measurement precision.

Factor Analysis

Barnes (1997) conducted an exploratory factor analysis (EFA) on the 40-item candidate inventory administered to the primary validation cohort (N = 243 tenure-track faculty). Due to the theoretical expectation that educational beliefs are correlated rather than strictly orthogonal, an oblique rotation (Promax/Oblimin) was utilized.

Initial extraction yielded four empirical factors with eigenvalues exceeding unity (> 1.0), which collectively accounted for 39.0% of the total variance across the item pool. However, psychometric scrutiny of the scree plot, accompanied by conceptual inspection of item factor loadings, revealed that the third and fourth factors were composed of fragmented, mathematically unstable items with cross-loadings and negligible conceptual clarity. Consequently, Barnes retained a parsimonious, conceptually robust two-factor solution containing 24 items with unambiguous, high primary loadings (> .40) and minimal cross-loadings (< .25):

• Factor 1 (Frame of Reference): Contains 13 items (Items 1, 2, 4, 7, 8, 10, 13, 14, 18, 20, 22, 23, and 24). It isolates beliefs contrasting relative (curve-based) grading with criterion-based grading. Positively keyed items reflect comparative, norm-referenced assumptions, whereas reverse-scored items reflect criterion-referenced mastery philosophies.
• Factor 2 (Gatekeeping): Contains 11 items (Items 3, 5, 6, 9, 11, 12, 15, 16, 17, 19, and 21). It reflects beliefs surrounding grade inflation, grading stringency, bell-shaped distributions, and the necessity of grades as filters of intellectual rigor.

Instrument / Measurement Tool

• Instrument Name: Faculty Beliefs about Grades Inventory (FBGI)
• Author: Laura L. B. Barnes (1997)
• Target Population: Postsecondary faculty, university professors, college lecturers, and higher education academic administrators
• Administration Format: Self-report questionnaire, available in paper-and-pencil or digital/computer-assisted formats
• Number of Items: 24 statements
• Subscales:
  • Frame of Reference (13 items: 1, 2, 4, 7, 8, 10, 13, 14, 18, 20, 22, 23, 24)
  • Gatekeeping (11 items: 3, 5, 6, 9, 11, 12, 15, 16, 17, 19, 21)
• Response Scale: 7-point Likert scale:
  • 7 = Strongly Agree
  • 6 = Agree
  • 5 = Unsure but tend to Agree
  • 4 = Neither Agree nor Disagree
  • 3 = Unsure but tend to Disagree
  • 2 = Disagree
  • 1 = Strongly Disagree
• Scoring and Transformation Rules:
  • Eight items are reverse-scored prior to calculating subscale scores: Items 3, 5, 13, 14, 18, 20, 21, and 24. For these reversed items, scores are inverted: 1 becomes 7, 2 becomes 6, 3 becomes 5, 4 remains 4, 5 becomes 3, 6 becomes 2, and 7 becomes 1.
  • Subscale scores are derived by calculating the mean or sum of the items assigned to each respective dimension.
  • Frame of Reference Interpretation: Higher scores reflect a strong endorsement of norm-referenced (comparative / curve-based) grading, whereas lower scores indicate preference for criterion-referenced (mastery / standards-based) evaluation.
  • Gatekeeping Interpretation: Higher scores indicate an intensive gatekeeping orientation (strict grading standards, belief that high grades reflect low rigor, defense against grade inflation), whereas lower scores indicate developmental assessment perspectives (belief that high grades indicate successful learning).

Permissions & Fee and Test Year

The Faculty Beliefs about Grades Inventory was published in 1997 by Dr. Laura L. B. Barnes in the journal Educational and Psychological Measurement (Volume 57, Issue 3, pages 459–468). The full inventory items, factor structures, and scoring methodologies were placed into the published academic domain in that article. As such, the FBGI is generally available for non-commercial educational, institutional research, and scholarly purposes without royalty fees, provided appropriate scholarly attribution and citation are given. Researchers wishing to incorporate the instrument into funded commercial assessment batteries or institutional software packages should contact the publisher (Sage Publications) and the author to obtain formal licensing and permission.

References

• Barnes, L. B. (1997). Development of the Faculty Beliefs about Grades Inventory. Educational and Psychological Measurement, 57(3), 459–468. https://doi.org/10.1177/0013164497057003008
• Bloom, B. S. (1968). Learning for mastery. Evaluation Comment, 1(2), 1–12.
• Geisinger, K. F., & Rabinowitz, W. (1982). Individual differences among college faculty in grading. Journal of Instructional Psychology, 7, 20–27.
• Glaser, R. (1963). Instructional technology and the measurement of learning outcomes: Some queries. American Psychologist, 18(8), 519–521. https://doi.org/10.1037/h0049294
• Goldman, L. (1985). The betrayal of gatekeepers: Grade inflation. Journal of General Education, 37(2), 97–121.
• Milton, O., Pollio, H. R., & Eison, J. A. (1986). Making sense of college grades: Why the grading system does not work and what can be done about it. San Francisco: Jossey-Bass.

13. Items of the Scale (Questionnaire)