Connecticut School Effectiveness Interview and Questionnaire

Abstract

The Connecticut School Effectiveness Interview and Questionnaire (commonly known in survey format as the Connecticut School Effectiveness Questionnaire, or CSEQ) is an organizational assessment instrument developed by Robert M. Villanova and colleagues at the Connecticut State Department of Education in 1984. Designed during the height of the modern Effective Schools Movement, the CSEQ operationalizes the empirical school-level correlates identified by pioneering educational researchers such as Ronald Edmonds, Wilbur Brookover, and Lawrence Lezotte. The self-report questionnaire comprises 97 items organized into seven foundational subscales: Safe and Orderly Environment (9 items), Clear School Mission (16 items), Instructional Leadership (24 items), High Expectations (14 items), Opportunity to Learn and Time-on-Task (10 items), Frequent Monitoring of Student Progress (9 items), and Home-School Relations (15 items). Items are rated on a standard 5-point Likert scale ranging from 1 (Strongly Disagree) to 5 (Strongly Agree). Psychometric evaluations conducted across elementary and secondary school faculties demonstrated strong internal consistency for the primary leadership and climate dimensions, with Cronbach’s alpha coefficients reaching 0.93 for Instructional Leadership, 0.90 for Clear School Mission, 0.89 for Home-School Relations, and 0.87 for Safe and Orderly Environment, alongside moderate coefficients for Frequent Monitoring of Student Progress (0.77), Opportunity to Learn (0.66), and High Expectations (0.55). Ten-day test-retest reliability estimates across sample educator cohorts ranged from 0.67 to 0.90. Construct validity was originally established using a rigorous multitrait-multimethod (MTMM) matrix that triangulated questionnaire scores against structured interview protocols administered across 247 educators. The instrument yields a comprehensive school profile that assists educational leaders, school psychologists, and policymakers in identifying institutional strengths, remediating organizational deficits, and aligning instructional practices with student achievement.

Keywords

Connecticut School Effectiveness Questionnaire, CSEQ, School Climate, Instructional Leadership, Effective Schools Research, Educational Psychometrics, School Improvement, Academic Expectations, Organizational Assessment, Time-on-Task

Authors

The Connecticut School Effectiveness Interview and Questionnaire was developed by Robert M. Villanova, Ph.D., in collaboration with a specialized research and development team at the Connecticut State Department of Education (Bureau of School Improvement, Division of Curriculum and Professional Development, Hartford, Connecticut). During the early 1980s, Villanova served as an educational consultant and administrator spearheading state-wide school effectiveness initiatives, translating empirical organizational theories into standardized diagnostic instrumentation. Contributing researchers and psychometric consultants within the state task force collaborated with regional public school districts, urban education panels, and academic advisors from university faculties across New England to ensure rigorous item generation, administrative feasibility, and curricular relevance across diverse educational environments.

Purpose

The primary purpose of the Connecticut School Effectiveness Interview and Questionnaire is to provide an empirically grounded, multidimensional diagnosis of the organizational, instructional, and cultural dynamics that govern student learning within primary and secondary school environments. Developed in response to the landmark findings of the Effective Schools Movement, the CSEQ operationalizes the concept that individual school characteristics exert a decisive, measurable influence on student achievement independent of family socioeconomic status, racial background, or baseline cognitive variance. By measuring staff perceptions across key institutional practices, the instrument aims to demystify the school climate and transform abstract notions of “school quality” into actionable, measurable organizational behaviors.

In educational and clinical settings, the CSEQ serves several practical functions:

• Organizational Needs Assessment: The tool generates school-wide profile summaries that highlight institutional discrepancies, such as misalignment between administrative intent and classroom execution, gaps in curriculum sequencing, or inadequate enforcement of behavioral norms.
• School Improvement Planning: State departments of education, district superintendents, and school improvement teams utilize aggregate CSEQ data to design targeted professional development, allocate instructional coaching resources, and establish institutional benchmarks.
• Evaluation of Educational Reforms: Administered pre- and post-intervention, the questionnaire tracks longitudinal shifts in staff cohesion, instructional focus, and school climate following organizational restructuring or curriculum reform initiatives.
• Comparative Educational Research: Psychometric researchers and educational sociologists employ the CSEQ to explore how organizational variables interact with standardized student achievement metrics, teacher retention rates, and community engagement.

The theoretical rationale rests on the premise that collective teacher beliefs, supervisory behaviors, and institutional routines create an environmental press that directly influences classroom pedagogy and student self-efficacy. Rather than focusing solely on administrative inputs (such as per-pupil expenditures or physical infrastructure), the CSEQ evaluates the dynamic process variables—leadership presence, collaborative goal setting, high expectations, and parent involvement—that foster resilient learning environments.

Psychological Construct

The psychological construct underlying the CSEQ is school effectiveness, conceptualized as a multi-component organizational climate construct that promotes equitable, high-level cognitive and behavioral development across all student demographics. The instrument operationalizes school effectiveness through seven distinct, interconnected dimensions:

1. Safe and Orderly Environment

This subscale (Items 1–9) measures the extent to which the physical and psychological atmosphere of the school is purposeful, secure, clean, and free from the threat of physical or verbal harm. It reflects an underlying climate of mutual respect, orderly conduct, and shared responsibility among teachers, administrators, and parents for sustaining a constructive discipline policy. High scores reflect an environment where teachers feel safe working and students feel comfortable learning without chronic behavioral disruptions.

2. Clear School Mission

Encompassing Items 10 through 25, this dimension assesses the degree to which a shared, written philosophy guides instructional decisions. It places heavy emphasis on sequential, coordinated curriculum objectives across basic skill areas—specifically reading, language arts, and mathematics. The construct captures institutional consensus regarding instructional priorities, ensuring that instructional objectives are documented, systematically monitored, and recognized by faculty as the core purpose of schooling.

3. Instructional Leadership

The largest dimension on the instrument (Items 26–49, totaling 24 items) operationalizes the active engagement of the building principal as an instructional leader rather than merely a bureaucratic manager. The construct encompasses managerial visibility, direct classroom supervision, pre- and post-observation conferences, systematic review of teacher lesson plans, collaborative analysis of student test results, and resource allocation to support ongoing teacher professional development.

4. High Expectations

Spanning Items 50 through 63, this construct captures the psychological norms and collective teacher efficacy regarding student potential. Drawing directly from social-psychological models of expectancy and academic socialization, this dimension evaluates whether teachers reject deficit-based views of socioeconomic background, maintain belief in their personal responsibility for student mastery of basic skills, implement preventive rather than punitive academic supports, and provide heterogeneous, equitable learning opportunities across diverse student groups.

5. Opportunity to Learn and Time-on-Task

Items 64 to 73 measure the structural and temporal protection of instructional periods within the school day. This construct examines the allocation of adequate instructional time (e.g., minimum dedicated blocks for reading and mathematics), the mitigation of non-instructional interruptions (such as disciplinary intrusions or uncoordinated pull-out programs), the regulation of student attendance, and the minimization of passive, unguided seatwork in favor of active academic learning time.

6. Frequent Monitoring of Student Progress

This subscale (Items 74–82) evaluates the institutional utilization of comprehensive assessment systems to guide pedagogical adjustments. The construct spans criterion-referenced testing, continuous programmatic evaluation, disaggregated achievement analysis across student subgroups (gender, race, ethnicity, socioeconomic status), and consistent grading standards, balanced with opportunities for recognizing student achievement and co-curricular talents.

7. Home-School Relations

Covering Items 83 through 97, this dimension measures the relational partnership between the home and the school community. It taps parental involvement in school governance, communication frequency, mutual reinforcement of homework policies and discipline, high conference attendance rates, and significant, non-superficial parent engagement in the educational enterprise.

Theoretical Framework

The theoretical architecture of the Connecticut School Effectiveness Questionnaire is situated within the Effective Schools Movement of the late 1970s and 1980s, which emerged as an empirical counter-narrative to earlier sociological studies—notably the Coleman Report (Coleman et al., 1966) and the work of Jencks et al. (1972). These earlier studies had suggested that family socioeconomic background was the near-exclusive determinant of student achievement and that schools possessed little independent capacity to alter educational trajectories.

Pioneering educational researcher Ronald Edmonds (1979) challenged this deterministic perspective by identifying high-performing urban schools that successfully educated low-income and minority students. Edmonds posited a core set of organizational correlates common to effective institutions: strong administrative leadership, high expectations for all children, an orderly and quiet school atmosphere, an emphasis on basic skills, and frequent monitoring of pupil progress. Simultaneously, researchers such as Wilbur Brookover and Lawrence Lezotte demonstrated that school climate variables accounted for significant variance in student cognitive outcomes after controlling for student intake demographics.

The CSEQ also draws heavily on the structural and process syntheses proposed by Purkey and Smith (1983), who argued that school effectiveness is an emergent property of organizational culture. In their framework, dynamic process variables—such as collaborative planning, shared academic goals, and collegial supervision—interact with structural elements (e.g., protected schedules, clear curriculum standards) to generate a strong school-wide ethos. Furthermore, the High Expectations subscale incorporates psychological insights from teacher expectancy theory (Rosenthal & Jacobson, 1968; Proctor, 1984), positing that educator attributions regarding student educability directly moderate pedagogical persistence, curriculum rigor, and student self-concept.

Finally, the Opportunity to Learn dimension integrates direct instruction theory and the concept of Academic Learning Time (ALT) pioneered by the Beginning Teacher Evaluation Study (Fisher et al., 1980). This paradigm maintains that achievement is a direct mathematical function of time allocated to curriculum-aligned instruction during which students experience high rates of academic engagement and success.

Validity

The development of the CSEQ involved empirical validation procedures designed to establish content, convergent, and discriminant validity across educational organizations.

Content Validity

Content validity was established through systematic expert categorization protocols. The pool of survey items was derived directly from the “far-right descriptors” (the most explicit behavioral benchmarks of organizational health) within the companion Connecticut School Effectiveness Structured Interview protocols. An independent panel of expert educational researchers and practitioners was tasked with sorting the candidate items into the designated school effectiveness categories. In accordance with strict pre-established psychometric thresholds, an item was retained only if it achieved at least 80 percent inter-rater agreement among panel members regarding its construct alignment. Following this review, the questionnaire underwent pilot testing with a cohort of classroom teachers to identify ambiguities in item phrasing, refine syntactical clarity, and verify response distribution.

Construct Validity: Multitrait-Multimethod (MTMM) Analysis

Construct validity was evaluated using a classical Multitrait-Multimethod Matrix (Campbell & Fiske, 1959). The analysis compared two distinct measurement methodologies—the self-administered Connecticut School Effectiveness Questionnaire (Method 1) and the clinically conducted, structured Connecticut School Effectiveness Interview (Method 2)—across the seven correlated effectiveness traits among a diverse sample of 247 professional educators.

The MTMM analysis yielded the following psychometric findings:

• Convergent Validity: The validities (correlations between different methods measuring the same trait) were statistically significant and substantially greater than zero across all seven dimensions. Educators’ self-reported questionnaire scores correlated moderately to strongly with the ratings assigned by independent interviewers evaluating the corresponding trait, confirming that the traits possessed empirical reality beyond survey response artifacts.
• Discriminant Validity: Discriminant validity was supported across multiple criteria: (a) each validity diagonal value was higher than the correlations between different traits measured by different methods in the same block, and (b) each validity diagonal value was generally higher than the off-diagonal values in the monomethod blocks. While some inter-trait correlation was observed—as expected in highly unified organizational climates—the seven dimensions demonstrated distinct construct variance rather than reflecting a single, undifferentiated halo effect.

Reliability

The reliability of the Connecticut School Effectiveness Questionnaire was examined using internal consistency analysis (Cronbach’s alpha) and test-retest temporal stability coefficients across independent cohorts of educators.

Internal Consistency

Internal consistency estimates were computed based on responses from a baseline normative sample of 423 classroom teachers across Connecticut public schools. The resulting Cronbach’s alpha coefficients for the seven subscales were:

• Instructional Leadership (24 items): $\alpha = 0.93$ (Excellent)
• Clear School Mission (16 items): $\alpha = 0.90$ (Excellent)
• Home-School Relations (15 items): $\alpha = 0.89$ (Good to Excellent)
• Safe and Orderly Environment (9 items): $\alpha = 0.87$ (Good)
• Frequent Monitoring of Student Progress (9 items): $\alpha = 0.77$ (Acceptable)
• Opportunity to Learn and Time-on-Task (10 items): $\alpha = 0.66$ (Questionable/Moderate)
• High Expectations (14 items): $\alpha = 0.55$ (Poor/Low)

The psychometric handbook noted that while dimensions focusing on administrative processes and behavioral policies demonstrated strong homogeneity, the lower coefficient for High Expectations (0.55) reflected the complex, multifaceted nature of teacher attribution items, grouping practices, and socioeconomic beliefs embedded within that scale. Similarly, Opportunity to Learn (0.66) combined heterogeneous operational indicators ranging from scheduled minute allocations to pull-out program management.

Test-Retest Stability

To assess temporal stability, the instrument was administered twice over a 10-day test-retest interval to a cohort of 60 elementary school teachers. Stability coefficients demonstrated strong temporal consistency across all dimensions:

• Clear School Mission: $r = 0.90$
• Safe and Orderly Environment: $r = 0.85$
• Instructional Leadership: $r = 0.83$
• Home-School Relations: $r = 0.82$
• Opportunity to Learn and Time-on-Task: $r = 0.74$
• High Expectations: $r = 0.69$
• Frequent Monitoring of Student Progress: $r = 0.67$

All test-retest correlations were statistically significant at $p < 0.001$, demonstrating that educator responses represent stable organizational assessments rather than transient situational attitudes.

Factor Analysis

At the time of the CSEQ’s initial publication in the 1984 state technical handbook, formal exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) solutions were not formally documented in the technical report. The developers established dimensionality primarily through structural theoretical modeling, rigorous expert sorting (requiring $ge 80%$ consensus), and multitrait-multimethod validation matrices.

Subsequent psychometric examinations of effective schools inventories based on the Connecticut model have evaluated the degree to which these seven correlates load onto independent latent constructs versus a higher-order overarching general factor (often designated as Overall School Health or Academic Climate Ethos). In structural evaluations of similar instruments, EFA using principal axis factoring with oblique rotations (such as Promax or Oblimin) typically yields robust primary factors for Instructional Leadership and Curriculum Mission/Alignment, with individual item loadings routinely exceeding $lambda = 0.60$.

However, CFA studies exploring 7-factor oblique models often reveal substantial latent factor inter-correlations (frequently ranging from $r = 0.45$ to $r = 0.75$), particularly between Safe Environment, Clear Mission, and High Expectations. As a consequence, psychometricians frequently specify either a bifactor model or a second-order model where the seven first-order dimensions load onto a global institutional effectiveness factor. In such structural models, indices such as the Comparative Fit Index (CFI) and Root Mean Square Error of Approximation (RMSEA) typically demonstrate adequate fit when item cross-loadings related to classroom management and instructional time are accounted for.

Instrument / Measurement Tool

The Connecticut School Effectiveness Questionnaire is structured as an organizational diagnostic inventory for institutional profiling. Below are the structural specifications and operational rules of the measurement tool:

• Measurement Paradigm: Organizational climate and process assessment via self-report survey.
• Target Population: Certified elementary, middle, and secondary school educators, including classroom teachers, specialists, and building administrators.
• Total Item Count: 97 items.
• Subscale Breakdown:
  • Safe and Orderly Environment: 9 items (Items 1–9)
  • Clear School Mission: 16 items (Items 10–25)
  • Instructional Leadership: 24 items (Items 26–49)
  • High Expectations: 14 items (Items 50–63)
  • Opportunity to Learn and Time-On-Task: 10 items (Items 64–73)
  • Frequent Monitoring of Student Progress: 9 items (Items 74–82)
  • Home-School Relations: 15 items (Items 83–97)
• Response Format: Standard 5-point Likert scale:
  • 1 = Strongly Disagree
  • 2 = Disagree
  • 3 = Undecided
  • 4 = Agree
  • 5 = Strongly Agree
• Scoring and Aggregation Procedures:
  • Items are scored directly from 1 to 5 as indicated above.
  • Subscale scores are calculated by summing the item ratings within each dimension or by averaging item responses to yield a mean subscale score ranging from 1.00 to 5.00.
  • Individual teacher scores are typically aggregated to the school building level to produce building-wide characteristic means, standard deviations, and normative rank orders.
  • Two primary analytical profiles are generated: (a) a Summary Profile displaying the relative rank and mean across the seven macro-characteristics, and (b) an Integrated Item Profile pinpointing specific procedural strengths and instructional bottlenecks.
• Administration Time: Approximately 30 to 45 minutes for self-completion.

Permissions & Fee and Test Year

The Connecticut School Effectiveness Interview and Questionnaire was authored by Robert M. Villanova and the research staff of the Connecticut State Department of Education and officially published in 1984 in the technical reference volume titled Handbook for the Use of the Connecticut School Effectiveness Interview and Questionnaire (Hartford, CT: Connecticut Department of Education). As an educational instrument produced under the auspices of a state government agency for public school improvement and technical assistance, the scale has historically operated within the public domain for non-commercial educational research, institutional evaluation, and academic scholarship. Educational institutions, school districts, and university researchers wishing to administer, modify, or electronically reproduce the instrument for research or professional development purposes should appropriately cite the original 1984 state handbook and verify current operational guidelines with the Connecticut State Department of Education.

References

• Brookover, W. B., Beady, C., Flood, P., Schweitzer, J., & Wisenbaker, J. (1979). School social systems and student achievement: Schools can make a difference. Praeger Publishers.
• Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105. https://doi.org/10.1037/h0046016
• Coleman, J. S., Campbell, E. Q., Hobson, C. J., McPartland, J., Mood, A. M., Weinfeld, F. D., & York, R. L. (1966). Equality of educational opportunity (OE-38001). U.S. Department of Health, Education, and Welfare, Office of Education. National Center for Education Statistics.
• Edmonds, R. (1979). A discussion of the literature and issues related to effective schooling. Center for Urban Studies, Harvard Graduate School of Education. Cambridge, MA.
• Fisher, C. W., Berliner, D. C., Filby, N. N., Marliave, R., Cahen, L. S., & Dishaw, M. M. (1980). Teaching behaviors, academic learning time, and student achievement: An overview. In C. Denham & A. Lieberman (Eds.), Time to learn (pp. 7–32). National Institute of Education.
• Jencks, C., Smith, M., Acland, H., Bane, M. J., Cohen, D., Gintis, H., Heyns, B., & Michelson, S. (1972). Inequality: A reassessment of the effect of family and schooling in America. Basic Books.
• Lezotte, L. W. (1989). Base school improvement on what we know about effective schools. The American School Board Journal, 176(8), 18–20.
• Proctor, C. P. (1984). Teacher expectations: A model for school improvement. Elementary School Journal, 84(4), 469–481. https://doi.org/10.1086/461373
• Purkey, S. C., & Smith, M. S. (1983). Effective schools: A review. Elementary School Journal, 83(4), 427–452. https://doi.org/10.1086/461325
• Rosenthal, R., & Jacobson, L. (1968). Pygmalion in the classroom: Teacher expectation and pupils’ intellectual development. Holt, Rinehart and Winston.
• Villanova, R. M., Gauthier, W. J., Proctor, C. P., & Shoemaker, J. (1984). Handbook for the use of the Connecticut School Effectiveness Interview and Questionnaire. Hartford, CT: Connecticut State Department of Education.

Items of the Scale