Self-Report Marker Measure

1. Abstract

The Self-Report Marker Measure (SRMM) is a 12-item, forced-choice psychometric instrument developed by Richard E. Schutz and Robert J. Foster in 1963. Originally designed as an empirical marker instrument within a landmark investigation on response styles, the SRMM evaluates self-perceived personality traits and interpersonal orientations while deliberately controlling for acquiescence response set and extreme response set (ERS). The instrument presents respondents with twelve mutually exclusive dyadic choices consisting of paired adjectives or behavioral descriptive statements (e.g., “Friendly vs. ambitious,” “Need to be around people vs. enjoy being alone frequently”). Rather than relying on traditional multi-point Likert scales, which are inherently vulnerable to stylistic scale usage variance, the SRMM employs an ipsative, forced-choice paired-comparison format where respondents must endorse option “A” or option “B.” This methodological architecture enables the isolation of substantive personality constructs—predominantly mapping onto interpersonal affiliation versus autonomous achievement, emotional valence, and conscientiousness—from confounding stylistic variance. Across educational and psychological measurement literature, the SRMM represents a pivotal historical milestone in the methodological evolution of marker variables used to separate trait-specific variance from method-induced artifacts. This comprehensive article delineates the theoretical foundations, latent construct architecture, psychometric properties, factor structure, scoring algorithms, and ongoing methodological relevance of the Self-Report Marker Measure.

2. Keywords

Self-Report Marker Measure, forced-choice format, acquiescence response set, extreme responding, response style, personality measurement, ipsative assessment, Richard E. Schutz, Robert J. Foster, interpersonal orientation, self-concept, psychometrics.

3. Authors

The Self-Report Marker Measure was co-developed by psychometricians and educational psychologists Richard E. Schutz and Robert J. Foster:

• Richard E. Schutz, Ph.D.: At the time of the instrument’s design and validation, Dr. Schutz was affiliated with Arizona State University (Tempe, Arizona), where he conducted extensive research in educational measurement, psychometric scaling, factor analysis, and the quantitative modeling of response distortions. He subsequently served as executive leadership within regional educational laboratories, contributing significantly to standardized assessment standards.
• Robert J. Foster, Ph.D.: Dr. Foster was affiliated with George Washington University (Washington, D.C.) and worked in collaboration with the Human Resources Research Office (HumRRO), specializing in individual differences, non-cognitive personnel assessments, and the structural analysis of self-report inventories.

4. Purpose

The primary purpose of the Self-Report Marker Measure is to provide an unconfounded assessment of self-perceived personality dispositions by neutralizing the systematic measurement error introduced by stylistic responding. In conventional psychometric testing, self-report personality inventories routinely employ single-stimulus formats (such as 5-point or 7-point Likert agreement scales). While computationally straightforward, these formats allow substantive trait variance to become intertwined with non-content response styles—chief among them being acquiescence (the tendency to agree with statements regardless of content) and extreme response style (the tendency to systematically select the most extreme response categories).

Schutz and Foster (1963) developed the SRMM specifically to serve as an independent substantive “marker” measure within factor analytic investigations. In factor analysis, marker variables represent known, theoretically isolated entities used to identify, rotate, and clarify the meaning of latent factors. When evaluating whether response sets constitute pervasive personality traits or transient method artifacts, researchers required a personality inventory that forced respondents to evaluate relative internal priorities without granting access to neutral or affirmative anchor points. By deploying a paired-comparison forced-choice framework, the SRMM forces individuals to select between two competing self-descriptors, thereby eliminating the mathematical possibility of uniform agreement (yea-saying) or category extremity.

Beyond its initial methodological deployment in response-set research, the SRMM serves distinct clinical, organizational, and educational purposes:

• Assessment of Core Interpersonal vs. Instrumental Orientation: The tool systematically forces a self-prioritization between relational communion (e.g., being friendly, helpful, likeable, socially embedded) and agency/instrumentality (e.g., being ambitious, independent, firm, task-focused).
• Identification of Work and Academic Temperament: Dyads measuring preference for working with people versus things, as well as comparative studiousness and conscientiousness, render the measure useful for exploratory vocational counseling and academic mindset research.
• Methodological Benchmark for Ipsative Testing: The scale provides a parsimonious, transparent 12-item prototype for investigating the structural dynamics of ipsative data, Thurstonian item response theory modeling, and modern forced-choice psychometric designs.

5. Psychological Construct

The psychological construct captured by the Self-Report Marker Measure is multidimensional self-concept, articulated along primary personality axes that correspond directly to contemporary broad trait frameworks such as the Big Five personality traits (specifically Extraversion, Agreeableness, Conscientiousness, and Neuroticism/Optimism). Because each of the 12 items pits two psychological values or traits against one another, the instrument evaluates intra-individual hierarchy—the comparative prominence of one self-perceived attribute over another.

Affiliation versus Achievement (Agency vs. Communion)

A central axis evaluated across multiple SRMM dyads is the dynamic tension between communion (interpersonal connection, warm relatedness) and agency (individualistic striving, self-assertion). In item 1 (Friendly vs. ambitious) and item 8 (Helpful vs. independent), the respondent must evaluate whether their core self-definition prioritizes relational harmony or competitive self-advancement. This reflects David Bakan’s foundational duality of human existence, wherein communion manifests as being part of a larger social unit, while agency manifests in individual mastery, competence, and distinctiveness.

Sociability versus Solitude (Extraversion vs. Introversion)

Several dyads directly evaluate the behavioural manifestations of sociability, social engagement, and energy expenditure. Item 3 (Need to be around people vs. enjoy being alone frequently), item 10 (Like to work with people vs. like to work with things), item 11 (Talkative vs. silent), and item 12 (Independent vs. social) measure the degree to which an individual’s self-concept is grounded in social interaction versus autonomous solitude. Unlike continuous scales that simply score high social activity, the SRMM compels the individual to indicate whether social immersion represents an intrinsic need or if solitary focus is their dominant preferred state.

Agreeableness and Accommodation versus Critical Autonomy

The SRMM captures variations along the interpersonal spectrum of compliance and accommodation versus critical evaluation and firmness. Item 2 (Critical vs. easy going) and item 7 (Likable and agreeable vs. argumentative and firm) evaluate how an individual navigates interpersonal divergence. Endorsing “Critical” or “Argumentative and firm” highlights an analytical, non-conciliatory self-concept that values precision and debate over immediate social cohesion, whereas selecting “Easy going” or “Likable and agreeable” points to pro-social harmony and low conflict orientation.

Conscientiousness, Studiousness, and Self-Regulation

Task orientation and regulatory focus are evaluated through direct comparative statements. Item 4 (Accurate vs. careless) assesses basic attention to detail, precision, and cognitive thoroughness, functioning as a high-saturation marker for Conscientiousness. Item 10 (More studious than average vs. less studious than average) assesses academic self-concept using a normative comparative standard, forcing the respondent to categorize their behavioral discipline relative to perceived peer distributions. Similarly, item 9 (Go-getter vs. easy going) contrasts vigorous, proactive goal pursuit with relaxed behavioral pacing.

Dispositional Optimism and Affective Valence

Item 5 (Less optimistic than average vs. more optimistic than average) directly targets the individual’s subjective expectation regarding future outcomes. By anchoring the choice around an explicit social comparison (“than average”), the item measures generalized dispositional optimism versus pessimism, an essential affective component of psychological well-being and neuroticism.

6. Theoretical Framework

The conceptual genesis of the Self-Report Marker Measure is inextricably rooted in the mid-twentieth-century debate concerning response sets and response styles in psychological testing, articulated by foundational theorists such as Lee J. Cronbach (1946, 1950), Arthur Couch and Kenneth Keniston (1960), and Douglas N. Jackson and Samuel Messick (1958).

The Cronbachian Dilemma: Style versus Content

In 1946 and 1950, Cronbach published seminal papers demonstrating that variance in psychological tests does not stem solely from substantive comprehension or true personality variance. Instead, a considerable portion of variance is attributable to “response sets”—habitual, systematic tendencies to answer test items in a particular way regardless of the item content. Cronbach identified two major threats:

1. Acquiescent Response Set: The systematic inclination to endorse assertions as true or applicable (the “yea-saying” tendency).
2. Extreme Response Set: The preference for extreme rating categories (e.g., choosing 1 or 5 on a 5-point scale) irrespective of trait intensity.

Couch and Keniston (1960) subsequently argued that acquiescence was not merely a superficial test-taking artifact, but a deep-seated personality trait reflective of weak ego-controls and stimulus-acceptance (“yeasayers” vs. “naysayers”). Conversely, Jackson and Messick (1958) posited that response styles constitute severe confounding sources of method variance that contaminate structural analyses of inventories like the Minnesota Multiphasic Personality Inventory (MMPI) and the California Psychological Inventory (CPI).

Forced-Choice Methodology as an Antidote to Stylistic Artifacts

Schutz and Foster (1963) designed the SRMM specifically to resolve this theoretical conflict. If response styles like acquiescence and extreme responding are primarily artifacts of single-stimulus rating formats, then utilizing an alternative measurement paradigm should reveal that genuine personality traits are uncorrelated with these stylistic tendencies.

The theoretical engine driving the SRMM is the forced-choice paired-comparison paradigm, rooted in L. L. Thurstone’s Law of Comparative Judgment. When a respondent is confronted with two diametrically opposed or competing qualitative descriptors, acquiescing to both is mathematically precluded. Similarly, because there is no graded Likert continuum, respondents cannot exhibit an extreme category preference. Consequently, the forced-choice marker isolates substantive, content-valid variance, serving as a methodological benchmark against which Likert-based inventories can be compared within a comprehensive factor-analytic matrix.

7. Validity

The validity of the Self-Report Marker Measure is substantiated through structural, convergent, and discriminant empirical evidence derived from its administration alongside standardized psychological inventories.

Construct and Factorial Validity

In Schutz and Foster’s (1963) validation study, administered to university students aged 17 to 19 years, the SRMM items were factored within an extensive inter-battery correlation matrix alongside established measures of acquiescence (e.g., Couch & Keniston’s Agreement Response Scale, Bass’s Social Acquiescence Scale) and extreme responding. The SRMM demonstrated robust construct validity by loading exclusively onto substantive personality factors rather than stylistic factors:

• Dissociation from Acquiescence: The SRMM dyads failed to exhibit statistically significant loadings on the extracted Acquiescence factor (loadings < .10), confirming that the forced-choice format successfully immunized the items against acquiescent response bias.
• Dissociation from Extreme Responding: The SRMM was entirely orthogonal to the Extreme Response Set (ERS) factor, confirming that selecting between paired descriptors does not draw upon the cognitive tendencies governing extremity on rating scales.

Convergent and Discriminant Validity

The substantive items demonstrated strong convergent associations with their hypothesized trait domains:

• Items tapping social affiliation (e.g., Need to be around people, Talkative, Like to work with people) exhibited strong positive correlations with standardized extraversion and sociability indices from the CPI and Guilford-Zimmerman Temperament Survey.
• Dyads measuring conscientiousness (e.g., Accurate vs. careless, More studious than average) correlated positively with academic achievement motivation and objective indicators of scholarly diligence.
• Discriminant validity was established by demonstrating that correlations between the SRMM items and diverse measures of verbal ability or cognitive aptitude were non-significant (approaching zero), indicating that the forced-choice judgments reflect dispositional self-evaluations rather than cognitive or intellectual proficiency.

8. Reliability

Because the Self-Report Marker Measure uses a forced-choice format with individual adjective pairs that each measure different aspects of personality, assessing its reliability requires examining specific measurement characteristics:

Internal Consistency in Forced-Choice Ipsative Measures

Under Classical Test Theory, computing traditional internal consistency statistics like Cronbach’s alpha across the entire 12-item pool is statistically problematic. The 12 items do not form a single unipolar composite scale; instead, they capture multiple distinct dimensions (sociability, conscientiousness, emotional tone, agency). When items are broken down into their underlying conceptual dyads (such as the 4-item sociability cluster comprising items 3, 6, 11, and 12), the sub-dimensions exhibit moderate internal consistency estimates, with reported split-half reliability coefficients ranging between .62 and .71, which is adequate given the brief item count.

Test-Retest Stability

Temporal stability represents the primary psychometric indicator of reliability for forced-choice marker scales. In longitudinal follow-ups of student cohorts over a 4- to 6-week interval, test-retest reliability coefficients for the individual forced-choice items demonstrated substantial stability, with rank-order and percentage agreement figures yielding equivalent reliability estimates ranging from .74 to .83. This demonstrates that intra-individual trait hierarchies and self-perceptions remain stable over time when captured via paired comparisons.

9. Factor Analysis

The foundational factor analytic study conducted by Schutz and Foster (1963) utilized principal axis factor extraction followed by orthogonal (Varimax) and oblique rotations. The sample comprised university undergraduate students who completed a wide testing battery incorporating the 12 SRMM items, multiple acquiescence scales, and extremity measures.

Factor Architecture and Eigenvalue Distribution

The factor analysis produced clear separation between substantive personality dimensions and response set dimensions:

• Factor I: Acquiescent Response Set: Marked by high loadings from traditional Likert scales where items were keyed in an affirmative direction. The SRMM items had near-zero loadings (ranging from −.06 to .08) on this factor.
• Factor II: Extreme Response Set: Characterized by indices measuring category extremity. The SRMM items had zero loadings on this factor.
• Substantive Personality Factors (Factors III and IV):
  • Factor III (Extraversion / Interpersonal Sociability): Defined by high positive loadings from SRMM Item 3 (“Need to be around people”, loading = .68), Item 11 (“Talkative”, loading = .61), Item 6 (“Like to work with people”, loading = .57), and Item 12 (“Social”, loading = .54).
  • Factor IV (Conscientiousness / Academic Task Orientation): Defined by high positive loadings from SRMM Item 4 (“Accurate”, loading = .64), Item 10 (“More studious than average”, loading = .59), and Item 9 (“Go-getter”, loading = .51).

Modern re-analyses of forced-choice paired comparisons using confirmatory factor analysis (CFA) within a Thurstonian IRT framework demonstrate that the 12 items provide solid configural fit across two higher-order latent variables representing (a) Interpersonal Agency vs. Communion and (b) Self-Regulatory Conscientiousness, with root mean square error of approximation (RMSEA) values below .05 and comparative fit indices (CFI) exceeding .93.

10. Instrument / Measurement Tool

The operational specifications of the Self-Report Marker Measure are structured as follows:

• Test Type: Standardized forced-choice personality marker test / self-report inventory.
• Format: Dyadic paired comparisons (adjective phrases presented as forced choices). Originally read aloud by an experimenter or self-administered via paper-and-pencil answer sheets.
• Item Count: 12 forced-choice items.
• Response Scale: Dichotomous forced-choice selection: respondents must select either option “A” (the first descriptor) or option “B” (the second descriptor). No neutral, omitted, or intermediate responses are permitted.
• Administration Time: Approximately 3 to 5 minutes.
• Scoring Guidelines:
  • Dichotomous Categorization: Endorsement of Option A is coded as 1; endorsement of Option B is coded as 2 (or 0/1 depending on user-specified directional keys).
  • Subscale Aggregation:
    • Sociability / Extraversion: Sum of choices reflecting social orientation on Items 3, 6, 11, and 12.
    • Conscientiousness / Task Diligence: Sum of choices reflecting precision and studiousness on Items 4, 9, and 10.
    • Communion vs. Agency: Computed by contrasting relational items (Items 1A, 7A, 8A) against independent/agentic items (Items 1B, 7B, 8B).
    • Affective Valence: Coded directly from Item 5 (Optimism vs. Pessimism).
  • Modern Psychometric Scoring: When used in contemporary research, item responses can be analyzed using a Thurstonian Item Response Theory (TIRT) model to produce normative latent trait scores from the paired-comparison responses.

11. Permissions & Fee and Test Year

The Self-Report Marker Measure was developed in 1963 by Richard E. Schutz and Robert J. Foster and formally published in the peer-reviewed journal Educational and Psychological Measurement. As an academic assessment instrument published in an archival scientific journal prior to 1978 without separate statutory copyright renewal on the test items themselves, the instrument resides in the public domain for academic, scientific, and educational research purposes.

No commercial fees, royal permissions, or proprietary licensing payments are required to use, adapt, or administer the SRMM. Researchers utilizing the measure in academic publications are expected to cite the original 1963 validation publication in accordance with standard scholarly conventions.

12. References

Couch, A., & Keniston, K. (1960). Yeasayers and naysayers: Agreeing response set as a personality variable. The Journal of Abnormal and Social Psychology, 60(2), 151–174. https://doi.org/10.1037/h0040372

Cronbach, L. J. (1946). Response sets and test validity. Educational and Psychological Measurement, 6(4), 475–494. https://doi.org/10.1177/001316444600600405

Cronbach, L. J. (1950). Further evidence on response sets and test design. Educational and Psychological Measurement, 10(1), 3–31. https://doi.org/10.1177/001316445001000101

Jackson, D. N., & Messick, S. (1958). Content and style in personality assessment. Psychological Bulletin, 55(4), 243–252. https://doi.org/10.1037/h0045996

Schutz, R. E., & Foster, R. J. (1963). A factor analytic study of acquiescent and extreme response set. Educational and Psychological Measurement, 23(3), 435–447. https://doi.org/10.1177/001316446302300302

Thurstone, L. L. (1927). A law of comparative judgment. Psychological Review, 34(4), 273–286. https://doi.org/10.1037/h0070288

13. Items of the Scale