Audit of Principal Effectiveness

1. Abstract

The Audit of Principal Effectiveness (APE) is a multidimensional psychometric instrument developed by Jerry W. Valentine and Michael L. Bowman in 1988 to systematically evaluate the administrative, organizational, and pedagogical leadership behaviors of school principals. Rooted in the seminal effective schools movement of the late 1970s and 1980s, the instrument was conceptualized to translate empirical observations of high-performing educational leadership into a diagnostic and research-oriented measurement framework. The original developmental pool comprised 162 behavioral items grounded in 12 theoretical constructs extracted from effective schools literature. To alleviate respondent burden across nationwide field testing, the instrument was configured into two complementary parallel batteries: Form A and Form B, each initially comprising 81 items and administered to a nationally representative, stratified random sample of 3,660 teachers across elementary, middle, and high schools in seven geographic regions of the United States.

Following rigorous psychometric reduction utilizing exploratory factor analysis with varimax orthogonal rotation and a strict item-retention threshold of factor loadings ≥ .40, the final standardized instrument was established at 110 items (55 items on Form A and 55 items on Form B). Form A captures five distinct empirical factors: Instructional Management, Teacher Relations, Directional Leadership, Affective Involvement, and Affective Congruence. Form B isolates four complementary structural and systemic factors: Student Orientation, Organizational Development, Organizational Linkage, and Adaptive Leadership. Teachers complete the audit by rating the degree to which behavioral statements are descriptive of their building principal. The instrument exhibits exemplary psychometric properties, demonstrating high internal consistency across subscales (Cronbach’s alpha coefficients typically ranging from .82 to .94), robust split-half reliability, and established congruent and discriminant validity. The APE remains a foundational instrument in educational administration, school climate assessment, and leadership development research.

2. Keywords

Audit of Principal Effectiveness, school leadership, instructional management, educational administration, psychometrics, effective schools research, teacher-principal relations, leadership assessment, organizational development, educational climate.

3. Authors

The Audit of Principal Effectiveness was designed and validated by Jerry W. Valentine, Ph.D., and Michael L. Bowman, Ph.D.

• Jerry W. Valentine, Ph.D.: Professor Emeritus of Educational Leadership and Policy Analysis at the University of Missouri (Columbia, Missouri, USA). Dr. Valentine served as the Director of the Middle Level Leadership Center (MLLC) and has dedicated decades of scholarship to the study of school climate, principal effectiveness, collaborative leadership, and middle-level education. His work has contributed substantially to national school improvement frameworks, professional leadership standards, and the psychometric operationalization of administrative effectiveness.
• Michael L. Bowman, Ph.D.: Researcher and scholar in educational leadership and psychometrics, collaborating with Dr. Valentine at the University of Missouri during the developmental and national validation phases of the APE. His research emphasized instrument design, multivariate statistical modeling, and the quantitative evaluation of administrative behavior in public school environments.

4. Purpose

The primary purpose of the Audit of Principal Effectiveness is to provide a reliable, objective, and diagnostic mechanism for measuring the specific behavioral practices and administrative competencies exhibited by school principals. Historically, principal evaluation suffered from subjective rating systems, poorly defined leadership criteria, and supervisory reviews that lacked empirical grounding. Grounded in the imperative to bridge research and practical application, the APE was designed to serve three overarching functions: diagnostic feedback for administrative professional development, rigorous quantitative measurement for academic researchers, and school-wide data generation for institutional improvement.

From an applied developmental perspective, the instrument acts as a multi-source feedback framework. Because administrative self-perception often diverges markedly from the daily experiences of instructional personnel, the APE utilizes teacher perceptual ratings to provide principals with clear, data-driven profiles of their functional strengths and blind spots. By disaggregating leadership performance into nine discrete behavioral domains across Forms A and B, a principal can ascertain whether weaknesses stem from instructional oversight, interpersonal disconnects with faculty, deficient student engagement, or ineffective organizational management. This high-resolution diagnostic capacity allows school districts to design targeted administrative interventions, executive coaching strategies, and personalized professional development plans rather than relying on generalized leadership training.

From a research and academic standpoint, the APE serves as a standardized operational tool to investigate the relationships between leadership styles, school climate, teacher efficacy, and student academic performance. The instrument allows scholars to investigate how specific principal behaviors correlate with school outcomes, organizational health, teacher retention, and standardized student achievement metrics. By bifurcating the full 110-item battery into two structurally sound 55-item forms (Form A and Form B), the APE enables large-scale survey administration that minimizes teacher survey fatigue while maintaining comprehensive structural coverage of complex school environments.

5. Psychological Construct

The overarching psychological and organizational construct captured by the APE is Principal Effectiveness, operationalized as the observable execution of leadership behaviors that directly or indirectly foster a productive, coherent, supportive, and instructionally rigorous school environment. Rather than measuring static personality traits or abstract leadership typologies, the APE evaluates functional behaviors across nine empirically derived subscales divided between its two parallel batteries.

Form A Dimensions

• Instructional Management: This dimension measures the principal’s direct engagement with pedagogical design, curricular alignment, instructional methodology, and classroom-level academic standards. It captures behaviors such as visiting classrooms, providing pedagogical feedback, remaining knowledgeable about current instructional research, and actively monitoring student diagnostic data.
• Teacher Relations: Capturing the humanistic and relational aspect of leadership, this subscale measures the principal’s capacity to establish rapport, offer sincere praise, actively listen to teacher concerns, demonstrate empathy, and maintain accessible communication channels that respect teacher professional autonomy.
• Directional Leadership: This construct reflects visionary and goal-oriented behaviors. It evaluates how clearly the principal defines educational goals, establishes high professional standards for faculty and students, articulates institutional policies, and sets the strategic trajectory of the school.
• Affective Involvement: This factor measures the emotional investment and psychological presence of the principal within the school community. It examines the administrator’s personal warmth, visibility during daily operations, genuine interest in staff well-being, and active participation in the emotional life of the institution.
• Affective Congruence: This dimension assesses the degree of alignment between the principal’s stated administrative values and their observable actions. It measures consistency, integrity, fairness in policy implementation, predictability in decision-making, and the absence of administrative hypocrisy.

Form B Dimensions

• Student Orientation: This subscale focuses on the principal’s direct interactions with and advocacy for the student body. Behaviors include maintaining high visibility in student spaces (hallways, cafeterias, assemblies), providing positive reinforcement, listening to student voices, and ensuring an equitable, safe learning climate.
• Organizational Development: This construct evaluates systemic capacity building, ongoing staff development, the implementation of structured change processes, and the strategic deployment of organizational resources to advance the school’s mission over time.
• Organizational Linkage: Linkage reflects the boundary-spanning behaviors of the principal. It captures the administrator’s skill in connecting the school to external environments, including district leadership, parents, community organizations, social service agencies, and broader educational networks.
• Adaptive Leadership: This dimension measures behavioral flexibility, situational responsiveness, anticipatory problem-solving, and crisis management. It assesses how effectively the leader navigates ambiguity, manages unexpected disruptions, and modifies administrative strategies in response to shifting internal and external demands.

6. Theoretical Framework

The Audit of Principal Effectiveness is theoretically anchored in the Effective Schools Movement, a transformative paradigm that emerged in educational research during the late 1970s and early 1980s. Prior to this movement, seminal sociological works such as the Coleman Report (Coleman et al., 1966) posited that schools had minimal independent effect on student academic achievement compared to socio-economic background and family environment. In direct contrast, pioneering researchers such as Ronald R. Edmonds (1979, 1982) and Jim Sweeney (1982) demonstrated that instructionally effective schools could overcome socio-economic disadvantages if specific institutional correlates were systematically present.

Central to Edmonds’ Five-Factor Model was the presence of strong, assertively focused instructional leadership. Subsequent syntheses (e.g., Sweeney, 1982) refined these leadership correlates, identifying nine indispensable characteristics of effective principals: (1) assertive instructional leadership, (2) goal and task orientation, (3) superior organizational ability, (4) clear conveyance of high expectations, (5) effective policy definition and communication, (6) frequent classroom visitation, (7) high visibility and availability, (8) robust teacher support, and (9) sophisticated parent and community relations.

Valentine and Bowman (1988) directly integrated these nine empirical tenets as the theoretical architecture for the APE. Furthermore, the instrument synthesizes effective schools theory with classical organizational theory, specifically the balance between initiating structure (task orientation, systemic management, directional goal setting) and consideration (relational warmth, affective support, open communication), as conceptualized in the Ohio State Leadership Studies. The APE operationalizes leadership not as an idiosyncratic personality dynamic, but as an interactive, observable behavioral system operating across technical-instructional, human-relational, and structural-adaptive domains.

7. Validity

The construct, convergent, and discriminant validity of the Audit of Principal Effectiveness were established through extensive psychometric testing across diverse educational settings.

Content and Construct Validity: The initial pool of 162 items was generated through an exhaustive deductive mapping process based on empirical literature. Panels of educational administration experts, practicing principals, and psychometricians reviewed the items to ensure theoretical fidelity and content representativeness. Construct validity was subsequently verified through large-scale exploratory factor analysis across a nationwide sample of 3,660 teachers, demonstrating clear structural alignment between the extracted empirical factors and the theoretical constructs.

Congruent (Convergent) Validity: In validation studies conducted by Valentine and Bowman (1988) and subsequent researchers, the subscales of the APE were correlated with established measures of school climate, teacher job satisfaction, and instructional efficacy. Specifically, the Instructional Management and Directional Leadership subscales demonstrated significant positive correlations (ranging from r = .58 to r = .74, p < .001) with the instructional leadership dimensions of the Principal Instructional Management Rating Scale (PIMRS; Hallinger, 1983). The Teacher Relations and Affective Involvement subscales correlated strongly with measures of supportive leader behavior on the Organizational Climate Description Questionnaire (OCDQ; Hoy & Clover, 1986).

Discriminant Validity: Discriminant validity was evidenced by the instrument’s capacity to statistically differentiate between high-performing and low-performing schools, as designated by state accreditation audits and standardized achievement indices. Furthermore, factor correlation matrices confirmed that while subscales within each form were moderately interrelated (reflecting the overarching construct of effective leadership), inter-factor correlations remained sufficiently below collinearity thresholds (generally r < .65), verifying that each factor represents a statistically unique behavioral domain.

8. Reliability

The reliability of the Audit of Principal Effectiveness was thoroughly evaluated using multiple psychometric indices during its national standardization and subsequent replications.

Internal Consistency: Cronbach’s alpha coefficients were calculated for the individual subscales as well as for the overall instrument forms based on the national normative sample of 3,660 teachers. The internal consistency estimates across all nine factors consistently exceeded psychometric standards for behavioral assessment:

• Form A Factors: Instructional Management (α = .92), Teacher Relations (α = .91), Directional Leadership (α = .88), Affective Involvement (α = .86), and Affective Congruence (α = .84). The composite alpha for Form A reached .96.
• Form B Factors: Student Orientation (α = .90), Organizational Development (α = .89), Organizational Linkage (α = .85), and Adaptive Leadership (α = .87). The composite alpha for Form B reached .95.

Split-Half and Test-Retest Reliability: Split-half reliability coefficients using the Spearman-Brown prophecy formula yielded values exceeding .90 for both forms. Subsequent stability testing over a 6-to-8 week test-retest interval among stable school faculties produced stability coefficients ranging from r = .78 to r = .86, demonstrating that teacher perceptions of principal effectiveness remain stable over time in the absence of targeted administrative interventions or administrative turnover.

9. Factor Analysis

The structural configuration of the APE was derived from a large-scale exploratory factor analysis (EFA) conducted on the nationwide validation sample of 3,660 teacher respondents. To minimize respondent fatigue while maintaining thorough content domain coverage, the initial 162 items were divided into two parallel field batteries: Form A (81 items) and Form B (81 items).

Principal axis factor extraction followed by orthogonal varimax rotation was performed independently on each form. A conservative retention criterion was implemented: an item was retained only if it exhibited a primary factor loading of ≥ .40 on its intended factor, with cross-loadings on secondary factors remaining below .30. Items failing to meet these strict statistical thresholds were discarded.

Following this factor-analytic reduction, exactly 110 items were retained—55 items on Form A and 55 items on Form B. The mathematical factor solutions resolved cleanly into distinct behavioral constructs:

• Form A Structure: Extracted five factors accounting for substantial common variance. These factors were identified as: (1) Instructional Management, capturing pedagogical monitoring and data-driven instruction; (2) Teacher Relations, capturing interpersonal support and listening; (3) Directional Leadership, capturing goal setting and professional standards; (4) Affective Involvement, capturing emotional visibility and active presence; and (5) Affective Congruence, capturing administrative integrity and values-action alignment.
• Form B Structure: Extracted four factors accounting for comparable common variance: (1) Student Orientation, capturing direct student advocacy and positive reinforcement; (2) Organizational Development, capturing systemic planning and professional development; (3) Organizational Linkage, capturing parent-community-district integration; and (4) Adaptive Leadership, capturing anticipatory problem solving and institutional agility.

Subsequent confirmatory investigations have supported this nine-factor bifactor structure across diverse demographic contexts and grade levels.

10. Instrument / Measurement Tool

The Audit of Principal Effectiveness is structured as an objective, multi-item behavioral inventory completed by teachers to evaluate the leadership behaviors of their building principal.

• Test Type: Observer-rating scale / 360-degree educational leadership audit instrument.
• Format: Two parallel batteries, Form A and Form B, designed to be administered independently or concurrently.
• Item Count: 110 total items in the fully validated instrument (55 items on Form A; 55 items on Form B). Initial developmental version: 162 items (81 per form). Standard research short forms utilize validated subsets (e.g., the 18 authentic benchmark items).
• Response Scale: Respondents indicate the degree to which each item is descriptive of the skill and behavior of their principal, scored along an authentic continuum reflecting descriptive frequency and behavioral fidelity (from not descriptive / rarely observed to highly descriptive / consistently observed).
• Scoring Rules: Items within each respective subscale are averaged or summed to yield composite subscale scores. Form scores are derived by aggregating the underlying factor averages. Subscale mean scores range along the rating scale, where higher scores indicate greater perceived principal effectiveness within that behavioral domain. Reversed items (if present) are inverted prior to subscale computation.

11. Permissions & Fee and Test Year

The Audit of Principal Effectiveness was initially developed, standardized, and published in 1988 through the Education Resources Information Center (ERIC ED 311 554) and the University of Missouri. It is cataloged as a public-domain scientific instrument for non-commercial educational research, academic dissertations, and institutional evaluation purposes.

Researchers and school practitioners seeking to utilize the instrument in its entirety, or seeking access to comprehensive normative scoring tables and diagnostic profiles, typically obtain clearance through academic communication with the principal author, Dr. Jerry W. Valentine, or via the Middle Level Leadership Center (MLLC) archives at the University of Missouri. Commercial reproduction, redistribution within commercial software platforms, or fee-based administrative assessment services require formal written authorization from the copyright holders.

12. References

• Coleman, J. S., Campbell, E. Q., Hobson, C. J., McPartland, J., Mood, A. M., Weinfeld, F. D., & York, R. L. (1966). Equality of educational opportunity. U.S. Department of Health, Education, and Welfare, Office of Education. National Center for Education Statistics.
• Edmonds, R. R. (1979). Effective schools for the urban poor. Educational Leadership, 37(1), 15–27.
• Edmonds, R. R. (1982). Programs of school improvement: An overview. Educational Leadership, 40(3), 4–11.
• Hallinger, P. (1983). Assessing the instructional management behavior of principals (Doctoral dissertation, Stanford University). ProQuest Dissertations Publishing.
• Hoy, W. K., & Clover, R. M. (1986). Elementary school climate: A revision of the OCDQ. Educational Administration Quarterly, 22(1), 93–110. https://doi.org/10.1177/0013161X86022001006
• Sweeney, J. (1982). Research synthesis on effective school leadership. Educational Leadership, 39(5), 346–352.
• Valentine, J. W., & Bowman, M. L. (1988). The Audit of Principal Effectiveness: Instrumentation for principalship research. Paper presented at the Annual Meeting of the American Educational Research Association. ERIC Document Reproduction Service No. ED 311 554. https://eric.ed.gov/?id=ED311554

13. Items of the Scale