Pupil Attitude Questionnaire

Abstract

The Pupil Attitude Questionnaire (PAQ) is a standardized psychometric instrument developed by Canadian educational researcher Henry Kolesar in 1967 to operationalize and measure secondary school student alienation within formal educational institutions. Rooted in Melvin Seeman’s classic sociological taxonomy of alienation, the PAQ conceptualizes schools as specialized, hierarchical bureaucratic organizations and assesses the degree to which adolescent students experience alienation as non-voluntary “clients” within these organizational systems. The questionnaire comprises 60 self-report items distributed across five empirically and theoretically validated subscales: Powerlessness (12 items), Self-Estrangement (12 items), Normlessness (14 items), Meaninglessness (12 items), and Isolation (10 items). Responses are recorded on a five-point Likert-type scale, incorporating both standard scoring, reverse-keyed items, and an unfolding curvilinear scoring mechanism for select meaninglessness dimensions to capture epistemic ambiguity.

Initial development involved an item pool of 164 items administered to a pilot sample of 163 high school students in Alberta, Canada, which was systematically pruned via item-total correlations, factor loadings, and discrimination indices to a refined 60-item instrument. Normative validation was subsequently conducted on a representative sample of 1,764 secondary students across 20 high schools. The PAQ demonstrates robust psychometric properties, including a one-week test-retest stability coefficient of r = .79 (N = 92), strong content and face validity established by a panel of 14 independent expert judges, and established construct validity via statistically significant correlations with teacher observational ratings (p < .001) and school pupil-control orientations. Factorial validity was substantiated through iterative exploratory factor analyses confirming a five-factor orthogonal structure. Over the past five decades, the PAQ has served as a foundational instrument in educational sociology, institutional psychology, and school climate assessment, particularly in elucidating how bureaucratic rigidities influence student engagement, disaffection, and academic achievement.

Keywords

Pupil Attitude Questionnaire, Student Alienation, Melvin Seeman, School Bureaucracy, Powerlessness, Normlessness, Meaninglessness, Self-Estrangement, Social Isolation, Educational Sociology, Psychometrics, High School Climate, Institutional Disaffection, Pupil Control Orientation

Authors

The Pupil Attitude Questionnaire was authored and standardized by Henry Kolesar, Ph.D., in 1967 as part of his doctoral dissertation research within the Department of Educational Administration at the University of Alberta in Edmonton, Alberta, Canada. Kolesar’s investigation—entitled An Empirical Study of Client Alienation in the Bureaucratic Organization—was conducted under the guidance of leading Canadian scholars in educational bureaucracy and organizational behavior. Kolesar’s work was subsequently expanded, popularized, and integrated into broader organizational climate paradigms in American educational research by prominent educational administration theorists, most notably Wayne K. Hoy (The Ohio State University and Rutgers University) and Mary Rafalides (Rutgers University), who examined student alienation as a direct structural consequence of school custodialism and humanistic pupil control orientations.

Purpose

The primary purpose of the Pupil Attitude Questionnaire is to provide an objective, empirically validated measure of multidimensional alienation experienced by high school students within bureaucratic educational environments. Historically, educational institutions were predominantly analyzed through the lens of administrative efficiency, pedagogical technique, or standardized scholastic aptitude, often neglecting the affective and psychological experiences of the students subjected to mandatory institutional controls. Kolesar designed the PAQ to fill this critical conceptual void by treating the student not merely as a passive recipient of instruction, but as an institutional “client” compelled by compulsory education laws to function within a formalized, rule-governed hierarchy.

From a theoretical perspective, the PAQ operationalizes how the organizational characteristics of modern secondary schools—such as centralization of authority, rigid division of labor, standardization of procedures, and formalization of disciplinary rules—foster psychological estrangement among adolescents. The instrument was intentionally structured to evaluate whether students perceive their school environment as a democratic community that cultivates intrinsic human growth or as an impersonal bureaucratic machine that enforces conformity through external coercion.

In research and applied psychoeducational contexts, the PAQ serves multiple diagnostic and investigative functions:

• School Climate and Institutional Assessment: Educational sociologists and administrative researchers utilize the scale to evaluate how organizational structures (e.g., decentralized versus authoritarian governance) directly correlate with student disaffection and aggregate school morale.
• Investigation of Disciplinary Orientations: The PAQ has been extensively deployed in conjunction with the Pupil Control Orientation (PCO) scale to determine how custodial, punitive teaching styles exacerbate student powerlessness and normlessness compared to humanistic, autonomy-supportive teaching styles.
• At-Risk and Dropout Identification: By isolating specific dimensions of alienation—such as meaninglessness (the inability to connect present academic tasks to future outcomes) or self-estrangement (engagement in schooling purely for extrinsic compliance rather than intrinsic value)—school psychologists can identify students at elevated risk for chronic absenteeism, academic underachievement, behavioral infractions, and early institutional withdrawal.
• Intervention and Reform Evaluation: The instrument facilitates pre- and post-intervention evaluations of organizational restructuring, such as restorative justice practices, student-led governance, and personalized curriculum models designed to alleviate adolescent institutional distress.

Psychological Construct

The Pupil Attitude Questionnaire is predicated upon the multidimensional psychological construct of alienation, adapted specifically to the contextual realities of secondary school environments. Drawing from Melvin Seeman’s conceptual breakthrough in 1959, Kolesar conceptualized school alienation not as a unitary, undifferentiated malaise, but as five distinct yet intercorrelated psychosocial conditions:

1. Student Powerlessness

Student powerlessness refers to the subjective expectancy or belief held by an individual that their own behavior cannot determine the outcomes, reinforcements, or occurrences they experience within the school system. In a bureaucratic school setting, this manifests as a perceived total lack of personal agency and democratic participation regarding administrative governance, institutional rules, curriculum selection, and disciplinary processes. Highly powerless students perceive teachers and administrators as autonomous autocrats who impose arbitrary mandates without student recourse. Exemplary scale items capturing this dynamic include Item 5 (“Schools are run by others and there is little that pupils can do about it”) and Item 41 (“In this school the teachers are the rulers and the pupils are the slaves”).

2. Student Self-Estrangement

Self-estrangement reflects the psychological state in which a student engages in academic activities not for their intrinsic satisfaction, creative self-realization, or self-actualization, but strictly for manipulative, extrinsic rewards or out of coerced compliance. The self-estranged student experiences school tasks as alien, hollow, and detached from their authentic selfhood. Learning becomes a mechanical transaction aimed at securing satisfactory grades, avoiding sanctions, or merely passing the time until release. Items measuring this construct include Item 25 (“I study hard in school mainly because I want to get good grades”), Item 31 (“Usually, I would rather play hooky than come to school”), and Item 43 (“If homework assignments were not required, I would seldom do homework”).

3. Student Normlessness

Derived from the sociological concept of anomie, student normlessness is defined as a high subjective expectancy that socially unapproved or institutionally forbidden behaviors are necessary to achieve desired educational goals. When legitimate structural avenues for success are perceived as blocked, unfair, or insufficient, the student feels justified in adopting deviant or manipulative survival strategies. This construct captures behaviors such as academic dishonesty, deceptive sycophancy toward authority figures, and opportunistic rule-breaking. Characteristic items include Item 1 (“White lies are justified when they help to avoid punishment”), Item 2 (“It is a good policy to tell teachers only what they want to hear”), and Item 35 (“Copying parts of essays from books is justified if this results in good marks on the essays”).

4. Student Meaninglessness

Student meaninglessness involves the individual’s inability to discern intelligible connections between their daily academic labors and their future life outcomes, occupational trajectory, or societal reality. It represents a state of epistemic confusion and cognitive dissonance, where the curricular content appears fragmented, purposeless, and irrelevant. The student exhibits low predictive capacity regarding what their educational achievement actually signifies for adulthood. Illustrative items include Item 14 (“It is possible on the basis of the level of my present school achievement, to predict with a high degree of accuracy, the level of achievement I can expect in adulthood”) and Item 33 (“What I am doing at school will assist me to do what I want when I graduate”).

5. Student Isolation

Isolation within the school context designates the student’s conscious detachment from, or explicit rejection of, the values, norms, and collective goals traditionally upheld and rewarded by the educational institution. The isolated student does not assign positive valence to high academic performance, school spirit, official extracurricular participation, or teacher approval, often prioritizing peer solidarity or counter-school subcultures over institutional integration. Exemplary items include Item 49 (“If I had my way, I’d close all schools”) and Item 50 (“Having lots of friends is more important than is getting ahead in school”).

Theoretical Framework

The theoretical architecture of the Pupil Attitude Questionnaire is situated at the intersection of classical sociological theory, industrial organizational psychology, and educational administration models. Specifically, the instrument synthesizes three overarching paradigms: Melvin Seeman’s Social-Psychological Taxonomy of Alienation, Max Weber’s Theory of Bureaucratic Rationalization, and the sociological functionalism of Émile Durkheim and Karl Marx.

Historically, Karl Marx conceptualized alienation (Entfremdung) as the objective structural condition under capitalism wherein the industrial worker is systematically separated from the act of production, the product of their labor, their fellow workers, and their innate human potential (Gattungswesen or species-being). Durkheim, meanwhile, formulated anomie as a condition of normlessness and deregulated desires emerging from rapid social change and structural fragmentation. In 1959, Melvin Seeman translated these macro-sociological constructs into a rigorous social-psychological paradigm by operationalizing alienation from the subjective viewpoint of the actor, decomposing it into powerlessness, meaninglessness, normlessness, isolation, and self-estrangement. Seeman integrated Julian Rotter’s social learning theory, defining powerlessness specifically as an individual’s expectancy that reinforcements are externally controlled rather than internally determined.

Henry Kolesar recognized that public secondary schools possess virtually all the structural hallmarks of Max Weber’s ideal-type bureaucracy: strict functional specialization, hierarchical authority structures, standardized impersonality, and extensive codification of rules. However, unlike employees who join a bureaucracy for remuneration, high school students are involuntary clients mandated by law to attend. Drawing upon Amitai Etzioni’s compliance theory, Kolesar argued that when involuntary clients are subjected to coercive, highly formalized organizational control, alienation inevitably emerges as a psychological reaction. Students who perceive the institutional bureaucracy as unyielding, rigid, and paternalistic naturally experience heightened levels of powerlessness and self-estrangement.

This theoretical framework was subsequently expanded in educational research by Wayne K. Hoy and colleagues. Hoy conceptualized schools along a continuum of “Pupil Control Orientation,” contrasting custodial organizations (which treat students as irresponsible, misbehaved subordinates requiring rigid surveillance and punitive discipline) with humanistic organizations (which treat the school as an educational community where students learn self-discipline and cooperative responsibility). The PAQ’s conceptualization explicitly assumes that custodial organizational climates systematically generate higher levels of client alienation across Seeman’s five dimensions, whereas humanistic climates mitigate alienation by fostering personal efficacy, shared decision-making, and intrinsic value in learning.

Validity

The psychometric validity of the Pupil Attitude Questionnaire was established through four rigorous, conventional validation procedures during its original development and subsequent replication studies: content validity, face validity, construct validity, and factorial validity.

Content and Face Validity

Content validity was ensured during the initial scale construction phase through extensive domain sampling. Kolesar compiled an initial item universe of 164 statements reflecting the diverse spectrum of interactions, conflicts, governance mechanisms, and cognitive evaluations characterizing the student-school relationship. These items were designed to comprehensively represent the theoretical definitions of Seeman’s five alienation dimensions applied to academic life. To establish face validity, this comprehensive pool was subjected to review by a panel of 14 independent expert judges in educational psychology, educational administration, and sociology. The judges evaluated each item for conceptual clarity, age-appropriateness, linguistic precision, and alignment with the theoretical constructs, systematically eliminating ambiguous, redundant, or psychometrically weak items.

Construct Validity

Construct validity was demonstrated through empirical hypothesis testing regarding how student alienation scores relate to observable external criteria and organizational indicators:

• Correlations with Teacher Ratings: In the primary validation study involving secondary schools in Alberta, student scores across the PAQ subscales were correlated with independent teacher behavioral ratings of student alienation, disengagement, and classroom passivity. The correlation between overall student self-reported alienation on the PAQ and teacher assessments was statistically significant at the p < .001 level, confirming that the self-report instrument accurately measures behaviorally manifest institutional detachment.
• Pupil Control Orientation Studies: In landmark subsequent validation research conducted by Rafalides and Hoy (1971), construct validity was reinforced by testing theoretical relationships between school organizational climate and PAQ scores. As theoretically predicted, students attending high schools characterized by custodial pupil control orientations exhibited significantly higher alienation across all PAQ subscales than students attending schools characterized by humanistic orientations. This provided compelling convergent and discriminant evidence of the PAQ’s capacity to capture organizational variation.
• Criterion-Related Validity: Significant relationships have been repeatedly demonstrated between elevated PAQ alienation scores and adverse academic outcomes, including increased disciplinary referrals, lower grade-point averages, elevated truancy rates, and reduced involvement in voluntary extracurricular activities.

Inter-Scale Correlational Matrix

Kolesar evaluated the internal construct validity of the five-factor model by examining the inter-scale correlations among the subscales and with the total alienation score. All bivariate correlations between the individual subscales and the total PAQ score were positive and statistically significant (p < .01). Furthermore, all inter-subscale correlations were positive and statistically significant, with one theoretical exception: the correlation between Meaninglessness and Isolation failed to achieve statistical significance. Psychometricians have noted that this non-significant correlation accurately reflects theoretical divergence: an adolescent who rejects institutional values (isolation) does not necessarily lack an understanding of the instrumental relationship between credentials and adult employment (meaninglessness), and vice versa.

Reliability

The reliability of the Pupil Attitude Questionnaire has been established across multiple independent evaluations, focusing on stability over time (test-retest reliability) and internal consistency across subscales.

Test-Retest Stability

During the formal instrument refinement process, the revised 60-item PAQ was administered to a stability cohort of 92 high school students over a one-week interval. The test-retest reliability coefficient for the total composite alienation score was r = .79, indicating strong temporal stability of student attitudes toward their school bureaucracy over the short term. Given the complex, affective, and situation-dependent nature of adolescent school attitudes, an empirical coefficient approaching .80 confirms that the PAQ captures enduring psychological orientations rather than transient affective moods.

Internal Consistency and Scale Refinement Metrics

The initial reduction of the PAQ from 164 to 60 items was conducted via a pilot study involving 163 high school students in Alberta. Item selection was governed by three psychometric filtering techniques:

1. Item-Total Correlation: Items exhibiting low or inconsistent correlation with their designated subscale composite were eliminated.
2. Discriminant Power Analysis: Items were analyzed to ensure they clearly separated high-scoring (top 27%) and low-scoring (bottom 27%) quartiles of student respondents.
3. Inter-Item Homogeneity: Subscales were evaluated to maintain homogeneous item pools reflecting their singular theoretical dimension.

Subsequent administrations and secondary analyses of the 60-item instrument (e.g., Rafalides & Hoy, 1971; Hoy, 1972) yielded split-half and Cronbach’s alpha internal consistency coefficients generally ranging between .72 and .84 across the individual subscales, with the composite PAQ total score consistently demonstrating reliability coefficients exceeding .85 in large secondary school samples (N = 1,764).

Factor Analysis

The factorial validity and structural integrity of the Pupil Attitude Questionnaire were examined by Kolesar through extensive exploratory factor analyses (EFA) conducted on the normative sample of 1,764 secondary students enrolled in 20 high schools across Alberta, Canada.

Factor Extraction and Rotation

Principal factor extraction was performed on the inter-item correlation matrix, followed by orthogonal (Varimax) rotation to obtain simple structure. Multiple extraction criteria—including Kaiser’s eigenvalue-greater-than-one (K1) rule and inspection of Cattell’s scree plot—were evaluated alongside theoretical interpretability. The analytical results firmly supported a robust five-factor orthogonal solution that mapped directly onto Melvin Seeman’s theoretical paradigm of alienation, fully justifying the retention of the 60 items.

Factor Composition and Item Distribution

The 60 items sorted into five discrete factors without substantial cross-loadings:

• Factor I: Normlessness (14 items) — Items: 1, 2, 3, 11, 15, 18, 24, 27, 35, 42, 52, 56, 57, and 58. This factor accounted for the largest proportion of common variance, reflecting beliefs that rule violation, dishonesty, and expedient manipulation are required to survive and succeed within the school.
• Factor II: Powerlessness (12 items) — Items: 5, 7, 8, 13, 28, 29, 30, 34, 41, 51, 53, and 59. This factor clusters statements expressing a complete inability to influence administrative policy, disciplinary outcomes, or daily institutional scheduling.
• Factor III: Self-Estrangement (12 items) — Items: 10, 12, 16, 21, 26, 31, 32, 36, 40, 43, 44, and 54. This factor is marked by items denoting a lack of intrinsic joy in academic labor, boredom, and reliance on extrinsic prods or escapist impulses.
• Factor IV: Meaninglessness (12 items) — Items: 6, 14, 17, 19, 33, 37, 38, 39, 45, 46, 47, and 60. Items loading on this factor capture uncertainty regarding the functional utility of school studies in predicting adult life outcomes and societal efficacy.
• Factor V: Isolation (10 items) — Items: 4, 9, 20, 22, 23, 25, 48, 49, 50, and 55. This factor represents ideological and psychological estrangement from the institutional goals, values, and formal culture of the secondary school.

Item factor loadings across the five designated dimensions generally ranged from .35 to .72, meeting classical psychometric thresholds for structural validity. Confirmatory studies in educational sociology have repeatedly corroborated this five-dimensional framework over competing single-factor or two-factor models.

Instrument / Measurement Tool

• Instrument Name: Pupil Attitude Questionnaire (PAQ)
• Alternative Titles: Kolesar Client Alienation Scale; Student Alienation Index
• Author: Henry Kolesar (1967)
• Target Population: Secondary school students (Adolescents, Grades 9–12; ages 14–19)
• Administration Format: Self-administered paper-and-pencil or digital questionnaire; suitable for group or individual testing
• Completion Time: Approximately 25 to 35 minutes
• Total Item Count: 60 items
• Subscales (5):
  • Powerlessness (12 items)
  • Self-Estrangement (12 items)
  • Normlessness (14 items)
  • Meaninglessness (12 items)
  • Isolation (10 items)
• Response Scale: 5-point Likert-type scale with categories:
  • Strongly Agree (SA)
  • Agree (A)
  • Undecided (U)
  • Disagree (D)
  • Strongly Disagree (SD)
• Scoring Architecture and Rules:
  • Standard Direct Scoring: Strongly Agree = 5, Agree = 4, Undecided = 3, Disagree = 2, Strongly Disagree = 1. Higher scores denote greater alienation.
  • Reverse Scoring: Items where agreement indicates positive institutional integration, autonomy, or intrinsic motivation are reversed (Strongly Agree = 1, Agree = 2, Undecided = 3, Disagree = 4, Strongly Disagree = 5). The 19 reverse-scored items are:
    
    Items 4, 6, 13, 15, 20, 23, 26, 28, 29, 34, 36, 44, 45, 46, 51, 53, 54, 55, and 59.
  • Curvilinear / Unfolding Scoring (Meaninglessness Subscale): For nine specific items on the meaninglessness scale, Kolesar employed an unfolding scoring system designed to capture cognitive ambivalence and epistemic doubt. For these items, expressing absolute certainty (either strongly agreeing or strongly disagreeing that school guarantees specific future outcomes) indicates low meaninglessness, whereas “Undecided” represents maximum alienation/cognitive ambiguity:
    
    Scoring: SA = 1, A = 3, U = 5, D = 3, SD = 1.
    
    Applies strictly to: Items 14, 17, 19, 33, 37, 38, 39, 47, and 60.
• Interpretation: Subscale totals are generated by summing relevant items; a Total Alienation Index can be computed by summing all 60 items. Elevated composite scores reflect pervasive institutional disaffection and client alienation.

Permissions & Fee and Test Year

The Pupil Attitude Questionnaire was formulated and published in 1967 as part of Henry Kolesar’s doctoral dissertation at the University of Alberta, Edmonton, Canada. As an academic dissertation instrument developed in the public university domain and subsequently reproduced across scholarly publications (such as the High School Journal in 1971), the PAQ is widely recognized in the psychometric literature as an open-access research instrument available for non-commercial educational and scholarly investigations.

No commercial fee or proprietary licensing purchase is required to administer the scale for academic research, school climate evaluations, or doctoral research. Researchers utilizing the instrument must provide appropriate academic attribution and cite Henry Kolesar’s original 1967 dissertation alongside foundational validation studies (e.g., Rafalides & Hoy, 1971). Parties interested in commercial adaptation, widespread electronic distribution within commercial assessment platforms, or institutional translation into other languages should consult institutional archives at the University of Alberta.

References

• Durkheim, É. (1897). Le suicide: Étude de sociologie. Félix Alcan.
• Etzioni, A. (1961). A comparative analysis of complex organizations: On power, involvement, and their correlates. Free Press of Glencoe.
• Hoy, W. K. (1972). Dimensions of student alienation and characteristics of secondary schools. Administrative Science Quarterly, 17(1), 38–51. https://doi.org/10.2307/2392094
• Hoy, W. K., & Forsyth, P. B. (1986). Effective supervision: Theory into practice. Random House.
• Hoy, W. K., & Miskel, C. G. (2012). Educational administration: Theory, research, and practice (9th ed.). McGraw-Hill.
• Kolesar, H. (1967). An empirical study of client alienation in the bureaucratic organization (Publication No. 67-001) [Doctoral dissertation, University of Alberta]. University of Alberta Institutional Repository.
• Marx, K. (1959). Economic and philosophic manuscripts of 1844 (M. Milligan, Trans.). Foreign Languages Publishing House. (Original work published 1932).
• Rafalides, M., & Hoy, W. K. (1971). Student sense of alienation and pupil control orientation of high schools. The High School Journal, 55(3), 101–111. https://www.jstor.org/stable/40365774
• Rotter, J. B. (1966). Generalized expectancies for internal versus external control of reinforcement. Psychological Monographs: General and Applied, 80(1), 1–28. https://doi.org/10.1037/h0092976
• Seeman, M. (1959). On the meaning of alienation. American Sociological Review, 24(6), 783–791. https://doi.org/10.2307/2088565
• Weber, M. (1947). The theory of social and economic organization (A. M. Henderson & T. Parsons, Trans.). Oxford University Press.

13. Items of the Scale (Questionnaire)