Balanced Dogmatism Scale

Abstract

The Balanced Dogmatism Scale (BD Scale), developed by Australian psychometrician and sociologist John J. Ray (1970, 1974), represents a major methodological and psychometric refinement in the empirical assessment of dogmatism, cognitive rigidity, and closed-minded belief systems. Originally conceptualized by Milton Rokeach (1956, 1960), dogmatism was posited as a generalized cognitive style characterized by the closed organization of beliefs, authoritarian surrender to ideological authority, and absolute intolerance of contradictory viewpoints, functioning independently of ideological orientation (left-wing or right-wing). However, Rokeach’s original 40-item and 66-item Dogmatism Scales (Forms D and E) suffered from a pervasive psychometric artifact: all or nearly all items were keyed in a single direction (pro-trait agreement), rendering the scale acutely susceptible to acquiescence response bias (“yea-saying”). Ray constructed the Balanced Dogmatism Scale—most notably validated in its 40-item BD Scale, Mark II formulation—to address this vulnerability by providing an equal balance of 20 positive (dogmatic / closed-minded) and 20 negative (anti-dogmatic / open-minded) items. Administered via a standard 5-point Likert response format, the BD Scale yields a continuous composite index ranging from 40 to 200, where higher scores reflect greater ideological dogmatism and cognitive closedness. Psychometric evaluations across diverse community and student cohorts demonstrate solid internal consistency reliability ($lpha = .71 ext{ to }.84$), robust test-retest stability ($r_{tt} = .75 ext{ to }.82$), and enhanced construct validity. By controlling for acquiescent variance, the BD Scale ensures that observed scores reflect genuine cognitive-structural orientation rather than artifactual response tendencies, making it an indispensable instrument for political psychology, sociological inquiry, and cognitive personality assessment.

Keywords

Balanced Dogmatism Scale, Dogmatism, Milton Rokeach, John J. Ray, Acquiescence Response Bias, Cognitive Rigidity, Open and Closed Mind, Authoritarianism, Response Sets, Attitude Measurement, Scale Validation, Psychometrics

Authors

The Balanced Dogmatism Scale was formulated and systematically validated by John Joseph Ray (Ph.D.), an Australian behavioral scientist and psychometrician affiliated during his active academic career with the School of Sociology at the University of New South Wales and the University of Sydney, Australia. Ray is renowned for his extensive empirical investigations into social attitudes, political conservatism, directiveness, achievement motivation, and particularly the contamination of psychological self-report instruments by response sets such as acquiescence and social desirability.

Purpose

The primary purpose of the Balanced Dogmatism Scale is to provide a psychometrically sound, methodologically balanced assessment of individual differences in dogmatic cognitive style, ideological inflexibility, and general closed-mindedness. For decades following the publication of The Authoritarian Personality by Adorno, Frenkel-Brunswik, Levinson, and Sanford (1950), researchers sought to quantify authoritarian dispositions. Adorno and colleagues’ California F-scale (F-scale) was heavily criticized for confusing right-wing political content with cognitive structure, leading Milton Rokeach (1960) to introduce the concept of “dogmatism” as a content-free structural construct representing general authoritarianism. Rokeach asserted that closed-mindedness could manifest equally across communist, fascist, religious, or secular belief structures.

Despite Rokeach’s theoretical innovations, his empirical operationalization—the Dogmatism Scale (Form D and Form E)—contained a critical structural vulnerability: all items were formulated such that agreement indicated high dogmatism. Methodologists such as Peabody (1966) demonstrated that when scale items lack direction-balanced counterparts, scores conflate genuine ideological rigidity with an uncritical tendency to agree with authoritative assertions (acquiescent response set or yea-saying). Ray (1970, 1974) proved empirically that when Rokeach’s items were administered alongside matched anti-dogmatic statements, the correlation between positive and negative items was often negligible or paradoxically positive, indicating that the original scale measured response style as much as, or more than, the underlying psychological construct.

The BD Scale was engineered to resolve this foundational measurement failure. By pairing each closed-minded proposition with an equal number of conceptually coherent, psychometrically robust open-minded items, the instrument neutralizes acquiescent variance across the total score. In both clinical and research contexts, the scale serves multiple vital functions:

• Political Psychology: Disentangling ideological beliefs (e.g., economic or social conservatism) from the formal cognitive rigidity with which those beliefs are maintained.
• Sociological and Cross-Cultural Research: Assessing collective openness versus fundamentalism across diverse demographic strata, educational backgrounds, and religious traditions.
• Cognitive and Social Psychological Experimentation: Serving as a moderator variable in studies examining confirmation bias, cognitive dissonance reduction, processing of counter-attitudinal evidence, and selective exposure phenomena.
• Organizational and Communication Studies: Evaluating leadership adaptability, tolerance of workplace dissent, decision-making under high ambiguity, and communicative flexibility.

Psychological Construct

The psychological construct measured by the Balanced Dogmatism Scale is dogmatism, operationalized as an overarching, structural personality dimension reflecting the degree to which an individual’s belief system is open or closed to alternative ideas, novel evidence, and conceptual modification. Rather than evaluating the specific content of an individual’s worldview (e.g., whether one endorses conservative, socialist, libertarian, or theological doctrines), the construct assesses the formal cognitive architecture through which beliefs are acquired, held, defended, and revised.

Within Ray’s psychometric operationalization and Rokeach’s underlying theory, the dogmatism construct is demarcated by several interdependent structural characteristics:

1. Open vs. Closed Belief-Disbelief Systems

A closed belief system maintains an impermeable barrier between accepted beliefs and rejected disbeliefs. Individuals high in dogmatism exhibit extreme cognitive compartmentalization, isolating disparate beliefs to avoid confronting internal contradictions (e.g., endorsing items asserting that “there is probably only one philosophy which is correct” while refusing to engage with alternative paradigms). In contrast, open-minded individuals view varying philosophies as possessing partial truths (e.g., Item 16: “All of the philosophies which exist in this world have some truth in them and probably not one is totally correct”) and demonstrate integrative complexity.

2. Intolerance of Ambiguity and Epistemic Absolutism

Central to dogmatism is the profound need for absolute cognitive certainty and the rejection of nuanced or probabilistic reality. Dogmatic cognition perceives issues in stark, dualistic terms (e.g., Item 40: “For most questions there is only one right answer once a person is able to get all the facts”). Conversely, non-dogmatic thinking accommodates epistemic fallibilism, ambiguity, and the relativity of human understanding (e.g., Item 10: “There is never one right answer for any question”; Item 19: “Truth is so elusive that no one can say when he has it”).

3. Absolute Submission to Central Ideals vs. Pragmatic Autonomy

High dogmatism manifests as an intense conviction that human existence is meaningless unless tethered to a transcendent “great cause,” historical mission, or non-negotiable ideal (e.g., Item 31: “A man who does not believe in some great cause has not really lived”; Item 32: “It is only when a person devotes himself to an ideal or cause that life becomes meaningful”). Individuals scoring low in dogmatism affirm individual autonomy, the intrinsic worth of everyday subjective experience, and the validity of living meaningful lives independent of ideological crusades (e.g., Item 6: “No one has a ‘mission in life’ that he must accomplish no matter what”; Item 14: “It’s possible to really live without believing in any great cause”).

4. Rejection of Internal Dissent and Relational Intolerance

Dogmatic systems perceive divergence from internal group orthodoxy as dangerous treason or weakness (e.g., Item 35: “To compromise with our political opponents is dangerous because it usually leads to the betrayal of our own side”; Item 38: “The worst crime a person could commit is to attack publicly the people who believe in the same thing he does”). Low dogmatism embraces pluralism and internal debate as indicators of societal and intellectual vitality (e.g., Item 1: “If we are going to have free speech we must defend the right to be heard of even those we disagree with”; Item 3: “If people in one’s own group are always disagreeing among themselves that is probably a rather healthy sign”).

5. Existential Despair and Dependency vs. Self-Efficacy

Psychodynamically, Rokeach posited that closed-mindedness functions as a psychological defense mechanism against deep-seated feelings of helplessness, loneliness, and existential dread in an unpredictable world. Dogmatic individuals frequently endorse sentiments of human powerlessness (e.g., Item 21: “Man on his own is a helpless and miserable creature”; Item 24: “I’d like it if I could find someone who would tell me how to solve my personal problems”). Non-dogmatic individuals exhibit internal locus of control, personal agency, and psychological resilience (e.g., Item 2: “Man is master of his own fate and captain of his destiny”; Item 11: “Man has within himself the power to control his destiny”).

Theoretical Framework

The Balanced Dogmatism Scale is situated at the intersection of cognitive personality theory, the psychodynamics of belief systems, and modern psychometric response theory. The foundational conceptual model derives directly from Milton Rokeach’s seminal monograph The Open and Closed Mind (1960). Rokeach sought to generalize the insights of Adorno et al. (1950) regarding authoritarian personality structures beyond the socio-political right. He defined a belief-disbelief system as open or closed along three fundamental dimensions:

1. Belief-Disbelief Dimension: The structural isolation between belief subsystems and disbelief subsystems, characterized by ideological encapsulation and rejection of out-groups.
2. Central-Peripheral Dimension: The absolute reliance on authoritative sources versus independent, empirical evaluation of reality. In a closed system, peripheral beliefs are held purely because authority figures decree them; in an open system, beliefs are verified against empirical evidence.
3. Time-Perspective Dimension: An orientation toward a distant, utopian future or idealized past, combined with dissatisfaction with the present, versus a balanced, realistic orientation toward current lived realities.

Despite Rokeach’s theoretical elegance, the psychometric operationalization of his model was severely undermined by response-set theory, as articulated by Lee J. Cronbach (1946, 1950), Dean Peabody (1961, 1966), and John J. Ray (1970, 1972). Acquiescence—the systematic tendency of respondents to agree with survey items regardless of their specific semantic content—constitutes an acute threat to construct validity when a scale contains only unidirectional items. In Rokeach’s original scale, an individual who scored high could either be genuinely dogmatic or merely an uncritical “yea-sayer” who reflexively agrees with declarative assertions.

Ray applied the principle of psychometric balancing. According to classical test theory, if a scale consists of an equal number of positively keyed items (where agreement indicates high trait level) and negatively keyed items (where agreement indicates low trait level), the acquiescence bias on positive items cancels out the acquiescence bias on negative items when summed. Mathematically, if observed score $X_i$ on item $i$ is modeled as:
$$X_i = T_i + A + E_i$$
where $T_i$ represents true trait variance, $A$ represents constant acquiescence tendency, and $E_i$ represents random error, summing across a perfectly balanced 40-item scale (where 20 items are scored normally and 20 are reverse-scored) removes the constant $A$ from the net trait estimate. Thus, the Balanced Dogmatism Scale operationalizes Rokeach’s cognitive theory while implementing a rigorous methodological architecture that insulates the measurement from acquiescent distortion.

Validity

The construct, convergent, discriminant, and criterion-related validity of the Balanced Dogmatism Scale have been thoroughly evaluated across multiple empirical studies conducted by Ray and independent investigators.

Construct and Convergent Validity

Construct validity was established through systematic comparison with Rokeach’s original Dogmatism Scale. In Ray’s (1970) foundational validation study involving Australian community and university samples, the BD Scale demonstrated substantial positive correlations with Rokeach’s unipolar D-Scale ($r = .56 ext{ to }.68, p < .001$). This confirms that the balanced instrument captures the core construct of closed-mindedness originally delineated by Rokeach. Furthermore, Ray demonstrated that while Rokeach’s unipolar scale correlated positively with separate, content-free measures of acquiescent response set, the Balanced Dogmatism Scale exhibited a near-zero correlation with acquiescence ($r = -.04, p = .72$), proving that the balanced version successfully purges method variance while preserving substantive trait variance.

Convergent validity has been repeatedly corroborated via significant correlations with allied psychological constructs:

• Cognitive Rigidity: Statistically significant correlations ($r = .42 ext{ to }.51$) with behavioral measures of problem-solving rigidity, such as the Luchins Water Jar Test and alternative Luchins Einstellung tasks.
• Authoritarianism: Substantial positive associations ($r = .48 ext{ to }.59$) with balanced measures of authoritarianism, including Ray’s Balanced F-Scale (1972) and Bob Altemeyer’s Right-Wing Authoritarianism (RWA) Scale.
• Intolerance of Ambiguity: Moderate to strong correlations ($r = .45 ext{ to }.54$) with Budner’s (1962) and Rydell and Rosen’s (1966) Intolerance of Ambiguity scales.
• Need for Closure: Subsequent studies applying modern cognitive measures demonstrated strong convergence with Webster and Kruglanski’s (1994) Need for Cognitive Closure Scale (NFCS; $r = .52, p < .001$).

Discriminant Validity

Discriminant validity is a cornerstone of the BD Scale’s psychometric profile. Unlike unipolar scales, the BD Scale demonstrates empirical independence from social desirability bias, as assessed by the Marlowe-Crowne Social Desirability Scale ($r = -.08 ext{ to }-.12$, non-significant). Crucially, the BD Scale exhibits discriminant separation from pure intellectual aptitude or cognitive intelligence (IQ; $r = -.11, p = .18$), confirming that dogmatism represents an affective-cognitive style and belief maintenance mechanism rather than general cognitive deficiency.

Predictive and Criterion Validity

In experimental settings, participants scoring high on the BD Scale display pronounced resistance to changing attitudes when exposed to well-reasoned, counter-attitudinal persuasive communications. When presented with complex, multi-sided socio-political policy briefs, high BD scorers selectively recall arguments supporting their pre-existing stance, display significantly higher rates of confirmation bias, and express hostile evaluations of speakers presenting nuanced or compromising positions ($p < .01$).

Reliability

The reliability of the Balanced Dogmatism Scale has been documented across general population probability samples, working-class cohorts, and university student populations. Establishing high internal consistency in balanced scales is psychometrically challenging because reversing item wording often introduces multi-faceted semantic nuances that can attenuate inter-item correlations compared to unipolar scales where shared acquiescence artificially inflates Cronbach’s alpha.

Internal Consistency Reliability

In the original validation studies of the 40-item BD Scale Mark II (Ray, 1970, 1974), the instrument achieved internal consistency coefficients (Cronbach’s alpha) ranging from $lpha = .71$ to $.84$:

• In Ray’s primary random general community sample in Sydney ($N = 272$), Cronbach’s alpha was observed at $lpha = .74$.
• In university undergraduate cohorts ($N = 198$), internal consistency reached $lpha = .81$.
• Split-half reliability, corrected via the Spearman-Brown prophecy formula, yielded coefficients consistently exceeding $r_{sb} = .76$.
• The positive (pro-trait) sub-pool of 20 items exhibited an independent alpha of $lpha = .77$, while the negative (con-trait / reversed) sub-pool of 20 items exhibited an independent alpha of $lpha = .75$. The inter-correlation between the positive and negative sub-pools was substantial and inverse ($r = -.46 ext{ to }-.58$), demonstrating that genuine bipolarity was successfully achieved.

Test-Retest Stability

Temporal stability over time has been verified across several retest intervals:

• Over a 4-week interval among university students ($N = 84$), the Pearson test-retest correlation coefficient was $r_{tt} = .82$ ($p < .001$), indicating excellent trait stability.
• Over an extended 12-week test-retest interval in an adult continuing education sample ($N = 62$), stability remained high at $r_{tt} = .75$ ($p < .001$).

These metrics demonstrate that the BD Scale captures a stable cognitive personality trait rather than transient affective states or situational attitudes.

Factor Analysis

The internal latent structure of the Balanced Dogmatism Scale has been evaluated using both Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA). A classic challenge in the psychometric modeling of balanced scales is the frequent emergence of two distinct factors representing positively phrased versus negatively phrased items—a methodological artifact known as the “method effect” or “direction-of-wording factor.”

Exploratory Factor Analysis (EFA)

When Ray (1970, 1974) subjected the inter-item correlation matrix to principal component analysis (PCA) followed by Varimax and Promax rotations, an unrotated first principal component accounted for approximately 18% to 23% of the total variance, confirming the presence of a robust, general substantive factor of dogmatic closed-mindedness. When rotated to multiple factors, the solution yielded four to five primary thematic dimensions:

1. Belief Absolutism and Singular Truth (Factor 1): High positive loadings from Item 33 (“Of all the different philosophies which exist in this world there is probably only one which is correct”; $lambda = .62$), Item 40 (“For most questions there is only one right answer…”; $lambda = .58$), and high negative loadings from Item 16 (“All of the philosophies… have some truth in them…”; $lambda = -.54$).
2. Ideological Devotion to Causes vs. Self-Directed Living (Factor 2): Strong loadings from Item 31 (“A man who does not believe in some great cause has not really lived”; $lambda = .66$) and Item 32 (“It is only when a person devotes himself to an ideal…”; $lambda = .64$), contrasted with Item 14 (“It’s possible to really live without believing in any great cause”; $lambda = -.61$).
3. Intolerance of Intra-Group Disagreement and Compromise (Factor 3): High loadings from Item 35 (“To compromise with our political opponents is dangerous…”; $lambda = .59$), Item 36 (“When it comes to differences of opinion in religion we must be careful not to compromise…”; $lambda = .57$), and Item 3 (“If people in one’s own group are always disagreeing… healthy sign”; $lambda = -.53$).
4. Existential Helplessness and Search for Authority (Factor 4): Loadings from Item 21 (“Man on his own is a helpless and miserable creature”; $lambda = .55$) and Item 24 (“I’d like it if I could find someone who would tell me how to solve my personal problems”; $lambda = .51$).

Confirmatory Factor Analysis (CFA)

Modern structural equation modeling (SEM) applied to the BD Scale supports a bifactor model incorporating one general substantive Dogmatism factor alongside two orthogonal method factors (one for positively worded items and one for reverse-worded items). Model fit indices confirm adequate representation:

• $\chi^2 / df le 1.84$
• Root Mean Square Error of Approximation (RMSEA) = $.051$ (90% CI: $[.044, .058]$)
• Comparative Fit Index (CFI) = $.914$
• Standardized Root Mean Square Residual (SRMR) = $.056$

The bifactor model demonstrates that variance across items is predominantly driven by the underlying general trait of dogmatism, while the balanced item structure successfully isolates and neutralizes method-induced acquiescence variance.

Instrument / Measurement Tool

• Instrument Name: Balanced Dogmatism Scale – Mark II (BD Scale, Mark II)
• Original Authors: John J. Ray (building on the theoretical framework of Milton Rokeach)
• Publication History: First balanced version published in 1970; refined Mark II revision published in 1974
• Measurement Type: Psychometric self-report questionnaire / Likert-type attitude inventory
• Target Population: Adults and adolescents (reading level: Grade 8 / approximately 13+ years)
• Item Count: 40 items total (20 reverse-scored / anti-dogmatic items; 20 positively scored / pro-trait dogmatic items)
• Response Format: 5-point Likert scale:
  • Strongly agree
  • Agree
  • Neither agree nor disagree
  • Disagree
  • Strongly disagree
• Scoring Instructions:
  • Positively Scored Items (Items 21 to 40): Direct scoring where agreement reflects dogmatism:
    • Strongly agree = 5
    • Agree = 4
    • Neither agree nor disagree = 3
    • Disagree = 2
    • Strongly disagree = 1
  • Reverse Scored Items (Items 1 to 20): Inverted scoring where agreement reflects non-dogmatic openness:
    • Strongly agree = 1
    • Agree = 2
    • Neither agree nor disagree = 3
    • Disagree = 4
    • Strongly disagree = 5
• Score Range: Minimum score = 40; Maximum score = 200. Higher composite scores indicate greater ideological dogmatism, cognitive rigidity, and closed-mindedness. Midpoint = 120.
• Administration Time: Approximately 10 to 15 minutes.

Permissions & Fee and Test Year

The original Balanced Dogmatism Scale was formulated and published by John J. Ray in 1970, with the definitive Mark II formulation appearing in 1974 in the Australian Journal of Psychology. In accordance with Dr. John J. Ray’s explicit and consistent academic policy, the Balanced Dogmatism Scale, along with his other psychometric instruments (such as the Balanced F-Scale and Directiveness Scale), is placed in the public domain for non-commercial academic, scientific, and clinical research purposes.

No licensing fees, commercial royalties, or formal permissions are required for researchers or clinicians utilizing the scale for scientific investigation, thesis research, or institutional studies. The author made the instrument, its scoring algorithms, and validation datasets freely accessible to the global scientific community through academic publications and his dedicated research repositories.

References

• Adorno, T. W., Frenkel-Brunswik, E., Levinson, D. J., & Sanford, R. N. (1950). The Authoritarian Personality. Harper & Row.
• Altemeyer, B. (1981). Right-Wing Authoritarianism. University of Manitoba Press.
• Altemeyer, B. (1996). The Authoritarian Specter. Harvard University Press.
• Budner, S. (1962). Intolerance of ambiguity as a personality variable. Journal of Personality, 30(1), 29–50. https://doi.org/10.1111/j.1467-6494.1962.tb02303.x
• Cronbach, L. J. (1946). Response sets and test validity. Educational and Psychological Measurement, 6(4), 475–494. https://doi.org/10.1177/001316444600600405
• Peabody, D. (1966). Authoritarianism scales and response bias. Psychological Bulletin, 65(1), 11–23. https://doi.org/10.1037/h0022681
• Ray, J. J. (1970). The development and validation of a balanced Dogmatism scale. Australian Journal of Psychology, 22(3), 253–260. https://doi.org/10.1080/00049537008254580
• Ray, J. J. (1972). Are conservatism scales irreversible? British Journal of Social and Clinical Psychology, 11(4), 346–352. https://doi.org/10.1111/j.2044-8260.1972.tb00823.x
• Ray, J. J. (1974). Balanced Dogmatism scales. Australian Journal of Psychology, 26(1), 9–14. https://doi.org/10.1080/00049537408255214
• Ray, J. J. (1979). A short balanced F scale. The Journal of Social Psychology, 109(2), 309–310. https://doi.org/10.1080/00224545.1979.9924207
• Ray, J. J. (1980). Acquiescence and the Wilson Conservatism scale. Personality and Individual Differences, 1(3), 303–305. https://doi.org/10.1016/0191-8869(80)90069-4
• Ray, J. J., & Pratt, G. J. (1979). Is the influence of acquiescence on “catchphrase” type attitude scale items not so mythical after all? Australian Journal of Psychology, 31(2), 73–78. https://doi.org/10.1080/00049537908254649
• Rokeach, M. (1956). Political and religious dogmatism: An alternative to the authoritarian personality. Psychological Monographs: General and Applied, 70(18), 1–43. https://doi.org/10.1037/h0093726
• Rokeach, M. (1960). The Open and Closed Mind: Investigations into the Nature of Belief Systems and Personality Systems. Basic Books.
• Webster, D. M., & Kruglanski, A. W. (1994). Individual differences in need for cognitive closure. Journal of Personality and Social Psychology, 67(6), 1049–1062. https://doi.org/10.1037/0022-3514.67.6.1049

Items of the Scale