Staff Assessment Questionnaire

Abstract

The Staff Assessment Questionnaire (SAQ) is a comprehensive, 94-item psychometric instrument developed in 1984 through a collaborative research partnership between the Seattle School District and the University of Washington. Designed as the primary faculty-level component of the larger School Self-Assessment Service (SSAS), the SAQ operationalizes key tenets of the effective schools movement to evaluate the organizational, cultural, and instructional health of educational institutions. The instrument captures staff perceptions across nine empirically derived organizational dimensions: Strong Leadership, Dedicated Staff, High Expectations, Frequent Monitoring, Early Identification, Positive Learning Climate, Curriculum Continuity, Multicultural Education, and Sex Equity. Items are scored along a 5-point Likert-type response scale ranging from Strongly Agree to Strongly Disagree.

Extensive psychometric investigations conducted across four diverse cohorts—including pilot samples of 125 educators, large-scale field studies involving 2,145 teachers from 99 schools, and systemic validation samples comprising 2,774 teachers across urban, suburban, and rural school districts—demonstrated high internal consistency and temporal stability. Cronbach’s alpha coefficients for the subscales consistently ranged from .70 to .97 across validation waves, with strong instructional leadership displaying the highest internal reliability (α = .92 to .97) and early identification and curriculum continuity maintaining acceptable lower bounds (α = .70 to .74). Two-week test-retest reliability (r = .70 to .91) confirmed score stability over time. Evidence for content validity was established through formal multi-stakeholder panel reviews with professional educator associations, whereas predictive validity was substantiated through statistically significant associations between school-level SAQ domain profiles and aggregate student standardized achievement gains in mathematics and reading. The SAQ remains an influential diagnostic and research instrument within educational administration, organizational psychology, and school improvement initiatives.

Keywords

Staff Assessment Questionnaire, Effective Schools Framework, School Climate, Instructional Leadership, Educational Measurement, Teacher Attitudes, Psychometrics, Program Evaluation, Academic Expectations, Equity Pedagogy

Authors

The Staff Assessment Questionnaire was conceptualized, operationalized, and validated in 1984 under the joint auspices of the Seattle School District (Department of Research, Evaluation, and Assessment) and the University of Washington (College of Education). The project was spearheaded as part of the broader School Self-Assessment Service (SSAS), an initiative aimed at translating empirical organizational effectiveness research into actionable, psychometrically sound diagnostic instruments for public school systems.

Inquiries regarding historical standardization data and archival technical manuals can be directed to the educational evaluation archives of the Seattle Public Schools (Seattle, WA, USA) or the educational psychology measurement collections at the University of Washington College of Education.

Purpose

The Staff Assessment Questionnaire was constructed to address a pronounced methodological gap in educational administration: the absence of a standardized, macro-level diagnostic survey capable of capturing faculty perceptions of the institutional dynamics known to drive pupil learning. Rooted in the paradigm shift away from input-output models of educational achievement (e.g., the Coleman Report) toward organizational and cultural determinants of student success, the SAQ provides an empirical mechanism for school communities to systematically audit their working and learning environments.

From an applied perspective, the instrument fulfills three primary functions:

• School Improvement and Self-Assessment: It serves as a diagnostic tool for building-level administrators, school improvement teams, and leadership councils to identify specific organizational strengths and deficits. Aggregated staff feedback allows schools to pinpoint areas requiring immediate targeted interventions—such as clarifying instructional leadership behaviors, addressing faculty fragmentation, or establishing cohesive curriculum continuity.
• System-Wide Accountability and Policy Planning: District administrators and educational policymakers utilize SAQ data to track climate trends across diverse geographic and socioeconomic settings (urban, suburban, and rural). The tool supplies quantifiable benchmarks that inform systemic resource allocation, targeted professional development programs, and long-term strategic plans.
• Educational and Organizational Research: The instrument provides educational researchers with an empirically validated measure of organizational climate and faculty efficacy. It enables sophisticated investigations into the mediating mechanisms through which teacher collaboration, professional climate, and instructional oversight influence standardized student achievement in reading, language arts, and mathematics.

Psychological Construct

The SAQ measures the complex latent construct of School Organizational Effectiveness, defined as the collective presence of organizational structures, instructional behaviors, interpersonal norms, and equity-oriented values that foster academic achievement and healthy psychological development in all students. Rather than treating school environment as a unidimensional concept, the SAQ partitions this construct into nine distinct, interconnected operational dimensions:

1. Strong Leadership

This subscale evaluates the degree to which the building principal and administrative team function as active, visible instructional leaders. Rather than focusing strictly on managerial competence, it captures dynamic pedagogical support, systematic classroom observations, constructive feedback, transparent evaluation criteria, vision articulation, and the active mobilization of instructional resources (e.g., Item 79: “My principal is a strong instructional leader”; Item 34: “My principal leads formal discussions concerning instruction and student achievement”).

2. Dedicated Staff

Reflecting constructs from organizational psychology such as organizational citizenship behavior and collective teacher efficacy, this dimension captures the staff’s mutual commitment, willingness to exert discretionary effort, pride in their profession, collaborative problem-solving, and dedication to ongoing professional learning (e.g., Item 33: “No challenge is too tough for our staff”; Item 88: “Whatever it takes, people in our building solve problems”).

3. High Expectations

This construct assesses the faculty’s pervasive belief in the academic and developmental capabilities of all enrolled students, regardless of socioeconomic or demographic background. It measures teacher optimism regarding grade-level mastery, graduation likelihood, and standardized performance against regional and national benchmarks, directly countering the deficit-oriented assumptions that often hinder student growth (e.g., Item 36: “Most students in my school are capable of mastering grade-level academic objectives”; Item 71: “I expect most students in my school will perform below the national average in academic achievement” [reverse-scored]).

4. Frequent Monitoring

This subscale focuses on data-driven decision-making and formative instructional assessment. It measures the extent to which educators and administrators systematically use criterion-referenced testing, skill checklists, and student work samples to evaluate learning trajectories, deliver diagnostic feedback, and iteratively refine instructional delivery (e.g., Item 8: “Student assessment information… is used regularly to give specific student feedback and plan appropriate instruction”).

5. Early Identification

Addressing instructional responsiveness and intervention systems, this dimension gauges the school’s structural capacity to rapidly screen, identify, and support students presenting with specialized learning requirements, cognitive challenges, or remedial academic deficits (e.g., Item 13: “My school has effective procedures for identifying students with special learning needs”).

6. Positive Learning Climate

This dimension operationalizes the social-emotional and physical ecology of the educational setting. It integrates indicators of interpersonal safety, behavioral orderliness, fair discipline, mutual trust, professional morale, and the cleanliness and comfort of the physical facilities (e.g., Item 56: “A positive feeling permeates this school”; Item 80: “My school building is neat, bright, clean, and comfortable”).

7. Curriculum Continuity

Drawing from structural curriculum alignment theory, this construct assesses vertical and horizontal articulation across classrooms, grade levels, and sequential academic courses. It measures the degree to which individual classroom instruction deliberately builds on prior grade content and explicitly prepares students for subsequent courses using district-adopted scope and sequence documents (e.g., Item 18: “What I teach in my class contributes to the content of the grade or course that follows it”; Item 28: “What I teach in my class builds upon the content of the grade or course that precedes it”).

8. Multicultural Education

This subscale captures the presence of culturally responsive pedagogical practices, pluralistic curricular representation, critical screening of instructional materials for racial and ethnic bias, and school-wide celebration of community cultural diversity (e.g., Item 10: “Our school’s staff examines instructional materials for ethnic and racial bias”; Item 19: “Our school’s curriculum helps students view ideas from diverse ethnic perspectives and points of view”).

9. Sex Equity

Reflecting gender-equity theory in education, this dimension assesses whether school practices, motivational strategies, teaching styles, and academic expectations are deployed impartially, ensuring equal developmental and academic encouragement for both female and male students (e.g., Item 5: “Staff at our school have the same expectations of academic achievement for both female and male students”; Item 27: “Procedures used to motivate students are fair to both sexes”).

Theoretical Framework

The theoretical architecture of the Staff Assessment Questionnaire is firmly grounded in the Effective Schools Movement that emerged during the late 1970s and early 1980s, primarily shaped by seminal scholars such as Ronald Edmonds (1979), Wilbur Brookover (1979), and Lawrence Lezotte (1991). Edmonds famously challenged the prevailing socio-determinist paradigm by demonstrating that urban schools with socioeconomically disadvantaged student bodies could nevertheless achieve high academic performance when specific institutional characteristics were present.

The Seattle School District and University of Washington research team synthesized the broader literature into an overarching model comprising 12 Characteristics of Effective Schools. Within the multi-method School Self-Assessment Service (SSAS) system, three characteristics were designated for external or community evaluation: Clear Goals (evaluated through the companion School Goals Survey), and Communication and Parent/Community Involvement (evaluated through the Parent Survey). The remaining nine core characteristics were integrated into the SAQ to capture the organizational and instructional climate directly experienced and enacted by school staff.

The instrument also integrates concepts from modern organizational climate theory, Bandura’s construct of collective efficacy, and instructional leadership frameworks (such as those later popularized by Philip Hallinger and Joseph Murphy). According to this combined framework, student achievement is not simply a product of individual teacher-student dyads; it is mediated by the collective institutional climate. In an effective school, leadership provides clear focus and resources; staff maintain elevated expectations and mutual trust; the curriculum is systematically aligned; progress is formatively monitored; and the school environment is safe, orderly, and culturally inclusive.

Validity

The psychometric validity of the Staff Assessment Questionnaire was established through multi-stage qualitative and empirical investigations:

Content and Construct Validity

Content validity was embedded during the initial design phase through operational definitions derived from effective schools literature. Item pools were subjected to rigorous qualitative review panels that included representatives from the Seattle Teachers’ Association, the Principals’ Association of Seattle Schools, central office curriculum specialists, and psychometricians from the University of Washington. These panels systematically assessed item readability, ecological validity, developmental appropriateness, and substantive alignment with the targeted subscales. Problematic or ambiguous items were revised or removed prior to formal pilot testing across a random sample of teachers, administrators, parents, and students.

Predictive and Criterion-Related Validity

The instrument’s predictive validity was evaluated by examining the statistical relationship between staff SAQ domain profiles and objective measures of student performance. Multiple regression analyses and analysis of variance (ANOVA) designs revealed that aggregate school scores across several SAQ subscales—most notably High Expectations, Strong Leadership, and Frequent Monitoring—accounted for statistically significant variance in standardized student achievement in reading and mathematics. Schools that scored higher on collaborative climate, clear leadership, and frequent assessment demonstrated significantly greater academic growth than schools with lower profiles, supporting the instrument’s ability to differentiate organizational effectiveness.

Subsequent Applied Validation

Decades of applied research have continued to confirm the instrument’s structural validity. For example, Donalson (2001) used the SAQ framework to demonstrate significant relationships between teacher empowerment, principal leadership behaviors, and systemic school change processes. Similarly, Brixey (2007) utilized the SAQ in urban middle school settings, demonstrating that low student performance is systematically associated with lower scores on faculty-assessed climate, expectations, and instructional coordination.

Reliability

The SAQ demonstrates high internal consistency and temporal stability across diverse educational contexts:

Internal Consistency (Cronbach’s Alpha)

Subscale reliability coefficients were evaluated across four large-scale validation cohorts:

• Sample 1 (n = 125 teachers): Cronbach’s alpha coefficients ranged from a high of α = .97 for Strong Leadership to α = .70 for Early Identification.
• Samples 2 and 3 (n = 2,145 teachers across 99 schools): Subscale reliabilities were virtually identical to the initial sample, with Strong Leadership maintaining values above α = .95, and all remaining subscales exceeding α = .75.
• Sample 4 (n = 2,774 teachers across urban, suburban, and rural districts): Internal consistency remained robust, with Strong Leadership registering an alpha of α = .92 and the lowest subscale, Curriculum Continuity, maintaining acceptable reliability at α = .74.

Test-Retest Reliability

Temporal stability was evaluated using a stability sample of 32 teachers who completed the SAQ twice over a two-week interval without intervening professional development. Test-retest correlation coefficients across the nine subscales ranged from r = .70 for Early Identification of Student Learning Problems to r = .91 for Frequent Monitoring of Student Progress, confirming that the scale captures stable organizational perceptions rather than transient day-to-day moods.

Factor Analysis

The structural dimensionality of the SAQ was originally explored using Exploratory Factor Analysis (EFA) with principal axis factoring and oblique (Promax/Oblimin) rotations to accommodate the theoretical correlations among school climate dimensions. Across the large standardization samples (n = 2,145 and n = 2,774), factor solutions confirmed that the items reliably clustered around the nine theorized effective-school dimensions.

Key findings from the factor analytic investigations include:

• Leadership Factor Salience: Items related to administrative visibility, instructional feedback, and evaluation (e.g., Items 34, 42, 55, 62, 79, 91) loaded cleanly onto a primary Strong Leadership factor, accounting for the largest proportion of common variance (often exceeding 25–30% of total explained variance), with factor loadings consistently exceeding .60.
• Climate and Expectations Clusters: Items measuring interpersonal trust, staff collaboration, and physical order (e.g., Items 47, 56, 61, 80) grouped into a robust Positive Learning Climate factor, while items addressing student potential and mastery (e.g., Items 36, 44, 48, 66, 70) defined an independent High Expectations dimension.
• Equity Dimensions: The multicultural education items (e.g., Items 2, 7, 10, 19, 29) and sex equity items (e.g., Items 4, 5, 14, 27) resolved into distinct factors, confirming that teachers differentiate culturally pluralistic curricular efforts from gender-equity initiatives.
• Invariance Across Contexts: Factor structures remained stable when comparing urban, suburban, and rural cohorts, indicating that the conceptual framework of school effectiveness captured by the SAQ is generalizable across diverse educational environments.

Instrument / Measurement Tool

• Full Instrument Name: Staff Assessment Questionnaire (SAQ)
• Alternative Title: The School Self-Assessment Service Staff Survey
• Year of Publication: 1984
• Target Population: Certified elementary, middle, and secondary school faculty, instructional specialists, and building-level professional staff
• Total Item Count: 94 authentic survey items
• Response Format: 5-point Likert response scale:
  • Strongly Agree
  • Agree
  • Undecided
  • Disagree
  • Strongly Disagree
• Administration Time: Approximately 25 to 40 minutes
• Subscale Breakdown (9 Domains):
  • Strong Leadership: Items evaluating administrative instructional guidance, classroom feedback, and vision.
  • Dedicated Staff: Items assessing professional efficacy, mutual support, and collaborative effort.
  • High Expectations: Items measuring academic optimism, student mastery beliefs, and graduation expectations.
  • Frequent Monitoring: Items focusing on criterion-referenced assessments, testing data usage, and instructional adjustments.
  • Early Identification: Items tracking diagnostic procedures and responsive programming for special learning needs.
  • Positive Learning Climate: Items appraising building cleanliness, discipline, interpersonal trust, morale, and safety.
  • Curriculum Continuity: Items reflecting vertical and horizontal curricular alignment and district guideline adherence.
  • Multicultural Education: Items examining cultural pluralism, multiethnic curriculum, and the elimination of racial/ethnic bias.
  • Sex Equity: Items evaluating gender parity in academic expectations, teaching styles, and motivational methods.
• Scoring Procedures: Items are typically assigned numerical values from 5 (Strongly Agree) to 1 (Strongly Disagree). Negatively worded items (e.g., Item 23, 32, 35, 37, 41, 49, 54, 71) are reverse-coded prior to computing dimension means and school-level composite aggregates.

Permissions & Fee and Test Year

The Staff Assessment Questionnaire was published in 1984 by the Seattle School District in conjunction with the University of Washington as part of the public-access School Self-Assessment Service. Historically developed using municipal and institutional educational research funds, the questionnaire was placed in the public domain for research, academic dissertations, and public school improvement applications.

Researchers and school practitioners are generally permitted to administer the scale for non-commercial educational purposes, provided that proper bibliographic attribution is given to the Seattle School District and the University of Washington. Institutional researchers planning district-wide commercial implementations or modifications should consult archival documentation through the Seattle Public Schools Department of Research and Evaluation or the University of Washington College of Education.

References

• Brixey, J. E. (2007). Examining major influences on low student achievement through a university-urban middle school partnership (Publication No. 3282717) [Doctoral dissertation, University of Kansas]. ProQuest Dissertations and Theses Global.
• Brookover, W., Beady, C., Flood, P., Schweitzer, J., & Wisenbaker, J. (1979). School social systems and student achievement: Schools can make a difference. Praeger Publishers.
• Donalson, E. M. (2001). The relationship of the change process to principal leadership and teacher empowerment (Publication No. 3025615) [Doctoral dissertation, University of Missouri, Columbia]. ProQuest Dissertations and Theses Global.
• Edmonds, R. (1979). Effective schools for the urban poor. Educational Leadership, 37(1), 15–24.
• Hallinger, P., & Murphy, J. (1985). Assessing the instructional management behavior of principals. The Elementary School Journal, 86(2), 217–247. https://doi.org/10.1086/461445
• Lezotte, L. W. (1991). Correlates of effective schools: The first and second generation. Effective Schools Products, Ltd.
• Purkey, S. C., & Smith, M. S. (1983). Effective schools: A review. The Elementary School Journal, 83(4), 427–452. https://doi.org/10.1086/461325
• Seattle School District, & University of Washington. (1984). The School Self-Assessment Service: Technical manual and user’s guide. Seattle School District and University of Washington.

Items of the Scale