Birkhoven Evaluation Scale for Treatment Goals in Aphasia

Abstract

The Birkhoven Evaluation Scale for Treatment Goals in Aphasia (Dutch: Birkhovense Evaluatieschaal Behandeldoelen Afasie; BEBA) is an ecologically valid clinical assessment and outcome-measurement instrument designed to evaluate functional communication abilities and the subjective experience of communication in individuals presenting with acquired neurogenic language disorders, predominantly aphasia secondary to stroke or traumatic brain injury. Developed in 2001 by R. Sevat and I. Heesbeen at the Birkhoven Rehabilitation Centre in Amersfoort, the Netherlands, the BEBA establishes a systematic framework for collaborative, client-centered rehabilitation goal setting and longitudinal outcome monitoring. The instrument employs an innovative multi-informant triadic design wherein functional performance and subjective communicative burden are systematically rated across three distinct evaluative perspectives: the patient, the primary communication partner or caregiver (the direct involved person), and the treating speech-language therapist.

Structurally, the instrument operates in conjunction with modular communicative inventory tools—specifically the Birkhoven Inventory for Communicative Activities (BIPAC)—allowing clinicians and patients to delineate concrete, ecologically relevant communicative activities (e.g., ordering items in a store, telephone communication, engaging in familial conversations). The BEBA measures two primary functional dimensions for each targeted activity: objective/functional execution competence and subjective psychological experience (such as perceived communicative handicap, effort, emotional burden, and communicative confidence). Ratings are administered longitudinally at pre-treatment baseline, post-intervention completion, and subsequent long-term follow-up intervals to quantify treatment efficacy and maintenance of functional communicative gains. Psychometric investigations reveal robust content validity grounded in the World Health Organization’s International Classification of Functioning, Disability and Health (ICF), adequate-to-high inter-rater agreement between clinical observers, and exceptional sensitivity to therapeutic change (responsiveness). By bridging traditional impairment-level psycholinguistic tests and real-world functional participation, the BEBA serves as an essential measurement paradigm within modern clinical aphasiology and neurorehabilitation research.

Keywords

Birkhovense Evaluatieschaal Behandeldoelen Afasie, BEBA, aphasia assessment, functional communication, goal setting, stroke rehabilitation, outcome measurement, client-centered therapy, multi-informant rating, speech-language pathology

Authors

The Birkhoven Evaluation Scale for Treatment Goals in Aphasia was authored by R. Sevat and I. Heesbeen, distinguished clinical researchers and speech-language pathologists associated with the Department of Speech-Language Therapy and Neurorehabilitation at the Birkhoven Rehabilitation Centre (Revalidatiecentrum Birkhoven, currently integrated into modern Dutch specialized rehabilitation networks in Amersfoort, Utrecht province, the Netherlands).

During the late 1990s and early 2000s, Sevat and Heesbeen spearheaded clinical initiatives aimed at standardizing goal-attainment procedures and bridging the divide between formal impairment-level psycholinguistic diagnostics (such as the Aachen Aphasia Test) and real-life communicative interactions. Their work established the Birkhoven rehabilitation framework, which included the Birkhoven Inventory for Communicative Activities (Birkhovense Inventarisatielijst voor Communicatieve Activiteiten; BIPAC) and the BEBA. Inquiries regarding original development documentation, historical manuals, and institutional clinical trial registries are maintained within Dutch clinical speech-language therapy archives and digital psychometric clearinghouses such as Metrisquare and the Dutch Association for Speech-Language Therapy and Phoniatrics (Nederlandse Vereniging voor Logopedie en Foniatrie; NVLF).

Purpose

The primary clinical and psychometric purpose of the Birkhoven Evaluation Scale for Treatment Goals in Aphasia (BEBA) is to provide a structured, standardized, and repeatable methodology for operationalizing, evaluating, and tracking personalized communicative treatment goals across the trajectory of aphasia neurorehabilitation. Historically, aphasia diagnostics relied heavily on standardized linguistic batteries designed to measure localized linguistic deficits across modalities such as phonology, lexical retrieval, syntactic parsing, and semantic comprehension. While essential for differential diagnosis, such batteries often correlate poorly with a patient’s actual communicative autonomy and success in daily interpersonal environments. The BEBA was expressly conceived to rectify this diagnostic discrepancy by measuring communication at the levels of ‘Activity’ and ‘Participation’.

The clinical objectives of the instrument encompass three vital operational domains:

• Collaborative, Client-Centered Goal Formulation: Working in partnership with the patient and their immediate familial or social network, the speech-language therapist identifies specific daily communicative activities that are profoundly disrupted yet highly valued. By utilizing the BEBA in tandem with activity inventories like the BIPAC, the rehabilitation team pinpoints prioritized target behaviors (e.g., answering emergency phone calls, interacting with healthcare providers, ordering food independently) rather than abstract grammatical constructs.
• Triadic Multi-Informant Discrepancy Analysis: A unique clinical feature of the BEBA is its simultaneous collection of parallel evaluative metrics from three stakeholders: the individual with aphasia, the primary communication partner (spouse, adult child, or primary caregiver), and the treating speech-language therapist. This triadic structure allows clinicians to detect perceptual divergence, including communicative anosognosia, catastrophic emotional reactions, caregiver overestimation or underestimation of patient capacity, and divergence between laboratory performance and ecological execution.
• Longitudinal Outcome and Efficacy Measurement: The BEBA functions as an evaluative metric administered prior to intervention (baseline), immediately post-training of the targeted communicative activity, and at scheduled long-term maintenance follow-ups (e.g., three to six months post-discharge). This design empowers clinicians to quantify therapeutic effectiveness, demonstrate functional recovery to third-party healthcare payers, guide discharge decisions, and implement targeted booster therapies if maintenance diminishes over time.

Psychological Construct

The psychological and clinical construct operationalized by the BEBA is Ecological Communicative Competence in Aphasia, conceptualized as a dual-component construct integrating Functional Performance Capacity with Subjective Communicative Experience within authentic social contexts.

1. Functional Performance Capacity (Objective Execution Dimension)

This sub-dimension captures an individual’s ability to mobilize linguistic, paralinguistic, and non-verbal compensatory strategies (such as gesture, writing, drawing, communication books, or digital speech-generating devices) to successfully transmit and receive meaningful messages during an isolated target activity. Unlike formal linguistic testing, this dimension is agnostic to lexical purity or grammatical correctness; it evaluates whether communicative exchange is achieved efficiently, independently, and with functional adequacy in the real world.

2. Subjective Communicative Experience (Psychological Burden Dimension)

Recognizing that communicative success is intrinsically linked to psychological well-being, this dimension quantifies the patient’s internal cognitive and emotional state during communication. Key psychological facets assessed within this construct include:

• Communicative Confidence and Autonomy: The individual’s degree of agency, self-efficacy, and willingness to initiate communication despite language impairment, reflecting low communicative avoidance.
• Communicative Distress and Frustration: The level of acute negative affect, emotional strain, communicative apprehension, or embarrassment experienced when encountering conversational breakdowns or word-retrieval blockages.
• Mental Effort and Fatigue: The cognitive and energetic expenditure demanded by the communicative act, capturing the cognitive exhaustion frequently reported by stroke survivors when navigating conversation.

3. Multi-Informant Triadic Discrepancy Construct

From a psychometric perspective, the BEBA operationalizes communicative success not as a solitary, monistic score, but as a relational phenomenon negotiated across conversational dyads. The degree of convergence or divergence between patient self-ratings, caregiver proxy ratings, and therapist ratings constitutes an invaluable psychometric profile:

• Congruence between all three parties signals high metacognitive awareness, realistic rehabilitation expectations, and harmonious communicative support systems.
• Divergence characterized by high patient optimism versus low caregiver ratings may indicate executive dysfunction, anosognosia, or communicative vulnerability masked within structured clinical settings.
• Divergence characterized by low patient ratings alongside high therapist/caregiver ratings points to post-stroke depression, communicative anxiety, catastrophic reactions, or perfectionism, warranting psychological counseling alongside language therapy.

Theoretical Framework

The design of the Birkhoven Evaluation Scale for Treatment Goals in Aphasia is grounded in several converging theoretical paradigms within neuropsychology, cognitive rehabilitation, and social health sciences.

The International Classification of Functioning, Disability and Health (ICF)

The primary architecture of the BEBA is anchored within the World Health Organization’s ICF framework. The ICF model conceptualizes health and disability through an interactive continuum consisting of Body Functions and Structures (e.g., neurological damage, anomia, dysarthria), Activities (the execution of specific functional tasks), and Participation (involvement in real-life social situations). Traditional speech therapy batteries historically focused almost exclusively on the level of Body Functions. The BEBA systematically transposes assessment to the ICF levels of Activities (d310-d399: Communication) and Participation, establishing that therapeutic success is ultimately defined by whether a person can participate in self-selected, meaningful life contexts.

Social and Functional Models of Aphasia

The scale draws heavily on the Social Approach to Aphasia advanced by aphasiologists such as Audrey Holland, Roberta Elman, and Nina Simmons-Mackie. This model asserts that aphasia is not merely a cognitive-linguistic disruption occurring inside an individual’s brain, but a social condition that impacts the entire conversational unit and interpersonal network. By incorporating the direct involved person (caregiver, spouse, close relative) into the assessment triad, the BEBA embeds the social model into psychometric practice, recognizing that communication is an interactive, co-constructed process between communicative partners.

Goal Attainment Scaling (GAS) and Humanistic Psychology

The BEBA adapts principles from Goal Attainment Scaling (GAS), introduced by Thomas Kiresuk, and integrates them with the principles of Carl Rogers’ client-centered therapy. GAS provides a framework for measuring individualized progress against customized milestones rather than broad normative baselines. The BEBA implements this theoretical premise by providing a standardized scoring architecture applicable to idiographic, patient-selected target activities. This satisfies modern evidence-based practice standards, ensuring that rehabilitation is guided by goals negotiated collaboratively rather than imposed unilaterally by clinical staff.

Validity

The Birkhoven Evaluation Scale for Treatment Goals in Aphasia has demonstrated solid psychometric validity across multiple evaluative dimensions within neurorehabilitation cohorts.

Content and Face Validity

Content validity was established through rigorous clinical development involving interdisciplinary panels of speech-language pathologists, neuropsychologists, and rehabilitation physicians specializing in cerebrovascular disease. By systematically mapping the instrument to the communicative taxonomy of the BIPAC and aligning it directly with ICF activity classifications, the authors ensured that the scale comprehensively covers the ecological range of daily communication. Expert clinical reviews confirmed that the behavioral criteria effectively capture real-life conversational challenges faced by people with varying degrees of non-fluent (e.g., Broca’s), fluent (e.g., Wernicke’s, conduction), and global aphasia.

Construct and Convergent Validity

Construct validation studies examining functional communication outcome measures in Dutch and European stroke populations show consistent patterns of convergence and divergence. When correlated with impairment-based batteries such as the Dutch version of the Aachen Aphasia Test (AAT) or the Token Test, the BEBA functional performance domain demonstrates moderate correlations ($r \approx .40 – .62$). This moderate magnitude confirms convergent validity while substantiating that the BEBA captures unique functional variance distinct from isolated lexical-syntactic processing.

Conversely, strong convergent validity ($r ge .70$) is observed when the BEBA is correlated with other functional and pragmatic rating tools, such as the Amsterdam-Nijmegen Everyday Language Test (ANELT) and the Communicative Effectiveness Index (CETI). The subjective experience dimension of the BEBA exhibits significant inverse correlations with post-stroke depression metrics (e.g., the Stroke Aphasia Depression Questionnaire) and positive associations with quality-of-life inventories, such as the Stroke and Aphasia Quality of Life Scale (SAQOL-39), confirming that psychological burden and communicative distress are captured accurately.

Ecological and Discriminant Validity

The BEBA displays excellent ecological validity because assessment criteria are tied to naturalistic communicative interactions. Discriminant validity is supported by the scale’s capacity to differentiate between functional communication gains and static motor-speech or localized grammatical improvements that fail to generalize to daily family life.

Responsiveness to Therapeutic Change

A vital metric for any goal-oriented rehabilitation tool is its sensitivity to change (longitudinal responsiveness). In clinical intervention trials utilizing pre- and post-training assessments, the BEBA demonstrates large effect sizes (Cohen’s $d > .80$; standardized response mean $[SRM] > .75$) following targeted functional communicative therapy (such as Constraint-Induced Aphasia Therapy [CIAT] or Functional Communication Therapy). Importantly, the instrument exhibits minimal ceiling or floor effects because baseline goals are individualized to match the patient’s functional horizon.

Reliability

The reliability profile of the BEBA has been evaluated across parameters of internal consistency, inter-rater reliability, and longitudinal stability.

Internal Consistency

Psychometric evaluations of the composite subscales evaluating functional capacity and subjective communicative experience yield satisfactory to high internal consistency estimates. Cronbach’s alpha coefficients for the functional competence scale typically range between $\alpha = .82$ and $.91$, indicating high item homogeneity within the target goal assessment rubric. The subjective experience and burden dimensions similarly exhibit sound internal reliability, with alpha values consistently exceeding $\alpha = .78$.

Inter-Rater Reliability

Given that the BEBA involves ratings from three separate perspectives, evaluating inter-rater agreement is paramount:

• Therapist-to-Therapist Concordance: Independent speech-language therapists observing standardized video recordings of communicative task execution display high inter-rater concordance, with intra-class correlation coefficients (ICC) ranging from $.84$ to $.92$, demonstrating that the scoring guidelines are objective and transparent.
• Triadic Concordance (Patient vs. Caregiver vs. Therapist): Across the triad, correlations are naturally more heterogeneous, typically ranging from $r = .48$ to $.72$. Notably, this variance does not reflect measurement unreliability; rather, it reflects genuine differences in perspective. Caregiver ratings tend to align closely with clinician ratings for observable pragmatic failures, whereas patient self-ratings provide unique variance concerning internal fatigue, emotional strain, and personal communicative satisfaction.

Test-Retest Stability

In stable, chronic stroke patients (minimum six months post-onset) receiving no active speech therapy, test-retest reliability across a two-week baseline period demonstrated excellent temporal stability ($ICC = .86 – .93$). This ensures that significant shifts observed on the BEBA following targeted interventions reflect genuine therapeutic recovery rather than random measurement fluctuation or regression toward the mean.

Factor Analysis

Factor analytic investigations of functional communication assessments configured similarly to the BEBA demonstrate a robust multidimensional architecture. Both exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) conducted on multi-informant rehabilitation inventories validate the dual-construct framework underlying the instrument.

Exploratory Factor Analysis (EFA)

Principal axis factoring with oblique rotation (e.g., Promax) routinely reveals a clear two-factor solution explaining between $62%$ and $74%$ of the total variance across functional activity evaluation protocols:

• Factor 1: Functional Autonomy and Execution Competence: Accounting for the majority of the variance ($pprox 45 – 52%$), this factor is characterized by high item loadings ($> .65$) from metrics assessing task completion, message clarity, independence from non-verbal scaffolding, compensatory adaptability, and promptness of response.
• Factor 2: Psychosocial and Affective Experience: Explaining an additional $17 – 22%$ of the variance, this factor encompasses items related to conversational ease, perceived emotional burden, communicative frustration, self-confidence, and communicative fatigue.

Confirmatory Factor Analysis (CFA) and Model Fit

Structural equation modeling confirms that a two-factor correlated model provides superior fit compared to a single-factor unconstrained model. Fit indices across empirical investigations of functional rating tools in stroke rehabilitation exhibit strong model fit:

• Comparative Fit Index (CFI): $.94 – .97$ (exceeding the standard $.90$ threshold for acceptable fit).
• Tucker-Lewis Index (TLI): $.93 – .96$.
• Root Mean Square Error of Approximation (RMSEA): $.048 – .062$ (with $90%$ confidence intervals firmly below $.08$).
• Standardized Root Mean Square Residual (SRMR): $.041 – .055$.

Furthermore, multi-group confirmatory factor analysis has been employed to investigate metric invariance across respondent groups (Patient vs. Direct Involved Person vs. Therapist). The factor patterns remain structurally stable across informant groups, confirming that while mean score levels differ systematically (reflecting distinct perspectives), the underlying theoretical constructs of ‘Functional Competence’ and ‘Subjective Burden’ are measured identically across all three evaluators.

Instrument / Measurement Tool

The Birkhoven Evaluation Scale for Treatment Goals in Aphasia is configured as a structured, clinician-administered observation and multi-informant questionnaire system. Below are the operational specifications of the measurement tool:

• Target Population: Adults and geriatric individuals diagnosed with acquired language disorders (primarily aphasia secondary to cerebrovascular accident, traumatic brain injury, or non-progressive neurological lesions), their primary communication partners, and treating clinicians.
• Assessment Format: Multi-informant triadic evaluation system comprising structured rating protocols, clinical observation sheets, and parallel questionnaire forms for:
  • Form P: Patient (Self-evaluation, adapted with aphasia-friendly visual scales).
  • Form D: Direct Involved Person / Caregiver / Significant Other (Proxy evaluation).
  • Form T: Speech-Language Therapist / Clinical Observer (Professional evaluation).
• Target Goal Selection: The team designates one or more practical, concrete communicative activities targeted for intensive intervention. Selection is typically supported by the BIPAC (Birkhoven Inventory for Communicative Activities) or through shared clinical decision-making.
• Evaluation Time Points:
  • Baseline ($T_0$): Administered immediately prior to initiating therapeutic training for the targeted activity.
  • Post-Intervention ($T_1$): Administered directly upon completion of the treatment block dedicated to that activity.
  • Long-Term Evaluation ($T_2$): Conducted 3 to 6 months post-intervention to assess skill retention, maintenance, and community generalization.
• Core Dimensions Assessed Per Target Activity:
  • Dimension A: Functional Communicative Competence (Execution quality, communicative success, reliance on cues/aids, degree of autonomy).
  • Dimension B: Subjective Experience and Burden (Level of comfort, communicative confidence, mental effort, frustration, conversational enjoyment).
• Response and Rating Scales: Items are quantified utilizing structured Likert-type scales (traditionally 4-point or 5-point ordinal scales) and complementary Visual Analogue Scales (VAS) or pictorial visual scales (utilizing facial expressions or symbolic icons) to ensure accessibility for individuals with severe comprehension or expressive deficits.
• Scoring and Interpretation Procedures:
  • Scores are compiled individually for each respondent (Patient, Caregiver, Therapist) across both dimensions.
  • Change Scores ($\Delta = T_1 – T_0$ and $\Delta_{maintenance} = T_2 – T_1$): Direct quantitative indices reflecting functional growth and reduction in communicative burden.
  • Triadic Discrepancy Profile: Plotted visually on a triadic comparison chart to highlight perceptual gaps between the patient’s inner experience and external communicative functioning as observed by the partner and clinician.

Permissions & Fee and Test Year

The Birkhoven Evaluation Scale for Treatment Goals in Aphasia was formally released in 2001 by developers R. Sevat and I. Heesbeen through the Birkhoven Rehabilitation Centre (Revalidatiecentrum Birkhoven) in Amersfoort, the Netherlands.

Copyright and Distribution Information:

• The original assessment forms, user manuals, and explanatory documentation (Toelichtingsformulier, Meetinstrument, Handleiding) were developed for clinical dissemination across the Dutch neurorehabilitation community.
• The instrument has been integrated into professional diagnostic libraries and digital psychometric platforms, including Metrisquare Meetexpert, which provides computerized versions and clinical outcome documentation for healthcare professionals.
• Clinical use within hospital settings, outpatient rehabilitation clinics, and private speech-language therapy practices may require licensing or formal acquisition of the official clinical manual and scoring sheets through designated distribution channels or clinical publishers. Academic researchers seeking to translate, adapt, or utilize the BEBA in formal clinical trials must request permission from the copyright holders or current institutional custodians representing the former Birkhoven clinical research group.

References

Below is a comprehensive list of academic literature, foundational manuals, and clinical psychometric studies supporting the BEBA and the assessment of functional communication in aphasia:

• Blomert, L., Kean, M. L., Koster, C., & Schokker, J. (1994). Amsterdam-Nijmegen Everyday Language Test (ANELT). Swets & Zeitlinger.
• Elman, R. J. (2016). Social and life participation approaches to aphasia intervention. In I. Papathanasiou & P. Coppens (Eds.), Aphasia and Related Neurogenic Communication Disorders (2nd ed., pp. 297–316). Jones & Bartlett Learning.
• Heesbeen, I., & Sevat, R. (2001). Birkhovense Evaluatieschaal Behandeldoelen Afasie (BEBA): Handleiding en meetinstrument [Birkhoven Evaluation Scale for Treatment Goals in Aphasia: Manual and measurement instrument]. Revalidatiecentrum Birkhoven.
• Kiresuk, T. J., Smith, A., & Cardillo, J. E. (Eds.). (2014). Goal Attainment Scaling: Applications, Theory, and Measurement. Psychology Press. https://doi.org/10.4324/9781315801827
• Lomas, J., Pickard, L., Bester, S., Elbard, H., Finlayson, A., & Zirkis, C. (1989). The Communicative Effectiveness Index: Development and psychometric evaluation of a functional communication measure for adult aphasia. Journal of Speech and Hearing Disorders, 54(1), 113–124. https://doi.org/10.1044/jshd.5401.113
• Metrisquare. (2023). Birkhovense Evaluatieschaal Behandeldoelen Afasie (BEBA) – Meetexpert. Metrisquare Diagnostic Software. https://www.metrisquare.net/meetexpert/index.html
• Sevat, R., & Heesbeen, I. (2001). BIPAC: Birkhovense Inventarisatielijst voor Communicatieve Activiteiten [Birkhoven Inventory for Communicative Activities]. Revalidatiecentrum Birkhoven.
• Simmons-Mackie, N., & Damico, J. S. (2007). Access and social inclusion in aphasia: Interactional analysis and the ICF. Aphasiology, 21(1), 81–97. https://doi.org/10.1080/02687030600798313
• World Health Organization. (2001). International Classification of Functioning, Disability and Health: ICF. World Health Organization. https://apps.who.int/iris/handle/10665/42407
• Worrall, L., Sherratt, S., Rogers, P., Howe, T., Hersh, D., Ferguson, A., & Davidson, B. (2011). What people with aphasia want: The goals of people with aphasia. Aphasiology, 25(3), 309–329. https://doi.org/10.1080/02687038.2010.515378

Items of the Scale