Individually Prioritized Problem Assessment

Abstract

The Individually Prioritized Problem Assessment (IPPA) is an individualized, client-centred clinimetric outcome instrument engineered to measure the efficacy and effectiveness of assistive technology (AT) interventions and environmental modifications. Developed by R. D. Wessels, L. P. de Witte, and colleagues within a collaborative European research initiative, the IPPA addresses the methodological shortcomings of standardized, generic functional status instruments that often fail to capture subtle yet vital changes meaningful to users with diverse impairments. Rather than evaluating a fixed repertoire of standardized tasks, the IPPA operationalizes an idiographic approach in which respondents formulate up to seven personally relevant daily activity problems that they anticipate resolving or mitigating through assistive device provision.

The instrument is administered through a semi-structured interview across two temporal evaluation points: a baseline evaluation conducted prior to the delivery of the assistive device, and a follow-up assessment administered several months post-provision. At baseline, respondents identify activities presenting functional impediments across seven core life domains (personal care, mobility, transportation, domestic tasks, safety, communication, and recreation/leisure), supplemented in international adaptations by role activities. Identified problems are subsequently weighted on a 5-point Likert scale of perceived importance (ranging from 1 = not important to 5 = most important) and baseline difficulty (1 = no difficulty to 5 = cannot be performed at all). During the post-provision interview, the persistent difficulty of each previously identified problem is re-evaluated. Psychometric evaluations demonstrate strong test-retest reliability (intraclass correlation coefficients and Spearman rho values generally exceeding 0.80), robust responsiveness to clinical change characterized by large standardized effect sizes, and excellent convergent validity with parallel client-centred and satisfaction measures such as the Canadian Occupational Performance Measure (COPM) and the Quebec User Evaluation of Satisfaction with Assistive Technology (QUEST).

Keywords

Individually Prioritized Problem Assessment, IPPA, assistive technology outcomes, client-centred measurement, individualized outcome assessment, functional disability, rehabilitation clinimetrics, activity limitations, International Classification of Functioning Disability and Health, outcome evaluation, occupational performance, psychometrics

Authors

The Individually Prioritized Problem Assessment was conceptualized, designed, and psychometrically validated through multi-centre research consortia situated across several European rehabilitation science institutes:

• R. D. Wessels, PhD: Lead researcher and developer, Institute for Rehabilitation Research (iRVs), Hoensbroek, The Netherlands; and Care and Public Health Research Institute (CAPHRI), Faculty of Health, Medicine and Life Sciences, Maastricht University, The Netherlands.
• Luc P. de Witte, MD, PhD: Co-developer and senior investigator, Professor of Technology in Healthcare, Care and Public Health Research Institute (CAPHRI), Maastricht University, The Netherlands, and later Professor of Health Services Research, Centre for Assistive Technology and Connected Healthcare (CATCH), University of Sheffield, United Kingdom.
• Jan Persson, PhD: Contributing investigator, Department of Biomedical Engineering and National Centre for Assistive Technology, Linköping University, Sweden.
• L. Gard, MSc: Research associate and co-investigator, Swedish Institute for Health Sciences and assistive technology evaluation initiatives.

Institutional affiliations for ongoing inquiries and methodological dissemination include the Centre for Assistive Technology and Connected Healthcare at the University of Sheffield and the Department of Health Services Research at Maastricht University.

Purpose

The primary purpose of the Individually Prioritized Problem Assessment (IPPA) is to quantify the degree to which an assistive technology intervention resolves self-identified functional limitations and activity restrictions in a person’s everyday living environment. In conventional clinical trials and rehabilitation outcomes research, functional status has traditionally been assessed using generic health-related quality of life (HRQoL) measures (such as the SF-36 or EuroQol-5D) or standardized physical capability scales (such as the Barthel Index or Functional Independence Measure). However, these fixed-item instruments frequently demonstrate inadequate clinical responsiveness when applied to assistive device provision. Because assistive devices typically compensate for specific localized impairments rather than restoring overall biological systems, generic indices frequently exhibit ceiling or floor effects, failing to detect clinically meaningful gains.

The IPPA addresses this limitation by serving multiple clinical and research functions:

• Individualized Intervention Efficacy: It isolates the exact problems that prompted the service request, ensuring that the evaluative metric directly corresponds to the client’s explicit treatment goals.
• Longitudinal Outcome Tracking: Administered pre- and post-provision, the IPPA measures changes in task difficulty weighted by the subjective importance of each activity, enabling service providers to ascertain whether the technical aid achieved its intended functional benefit.
• Client Empowerment and Therapeutic Alignment: The semi-structured interview structure places the client’s subjective experience at the centre of the clinical encounter, strengthening therapeutic rapport, treatment compliance, and shared clinical decision-making.
• Health Economic and Service Quality Benchmarking: By standardizing the scoring algorithm across heterogeneous client complaints, the IPPA facilitates cross-disability and cross-device comparisons, supporting resource allocation, quality assurance programs, and evidence-based policy in rehabilitation engineering.

Theoretical and empirical research indicates that assistive technology success hinges not solely on mechanical performance, but on the subjective match between the individual’s needs, their socio-environmental milieu, and the device’s functional attributes. The IPPA was specifically calibrated to capture this dynamic interaction.

Psychological Construct

The core construct evaluated by the IPPA is perceived problem resolution in individually prioritized daily activities. Unlike normative psychometric scales that conceptualize ability as a latent trait continuously distributed across uniform behavioral indicators, the IPPA operates within an idiographic and clinimetric paradigm. The construct assumes that disability is experienced primarily as disequilibrium between a person’s intrinsic capacity and the physical or social demands of their chosen daily occupations.

The IPPA evaluates this construct through three interlocking psychometric and subjective components across multiple life domains:

1. Domain-Specific Problem Elicitation

The instrument covers up to eight domains of human activity, aligning with modern classifications of function:

• Personal Care: Essential self-maintenance tasks, such as bathing, dressing, grooming, toileting, and feeding.
• Mobility: Locomotor capabilities within domestic and community settings, including bed-to-chair transfers, stair negotiation, indoor ambulation, and navigating environmental obstacles.
• Transportation: Community navigation, including boarding public transit, operating private motor vehicles, transferring into passenger seating, and stowage of personal mobility equipment.
• Domestic Life (Housework): Instrumental activities of daily living, such as meal preparation, laundry, housekeeping, grocery procurement, and routine property maintenance.
• Safety: Mitigation of physical hazards, fall risk management, operating emergency alarms, and secure environmental ingress and egress.
• Communication: Interpersonal exchange, telecommunication access, computational interface interaction, sensory compensation (auditory and visual), and written correspondence.
• Leisure and Recreation: Engagement in hobbies, physical fitness pursuits, social clubs, crafts, and self-chosen avocational routines.
• Role Activities (Work/Education): Participation in vocational environments, educational curricula, parenting responsibilities, and civic contributions.

2. Subjective Importance Weighting

Not every functional deficit causes equivalent psychological distress or role impairment. The construct recognizes that task significance is idiosyncratic; an inability to hold a pen may represent an extreme disruption to an author, whereas a manual laborer may view it as minor relative to lower-limb locomotion. The baseline priority weight explicitly quantifies the psychological centrality of the stated goal.

3. Perceived Task Difficulty and Change

The dynamic dimension of the construct is the shift in perceived difficulty experienced while performing the target activity using the newly introduced assistive technology. The underlying psychological construct embodies perceived capability, personal autonomy, and reduction of functional strain.

Theoretical Framework

The IPPA is grounded in the confluence of three prominent theoretical models within rehabilitation science, psychology, and public health:

The International Classification of Functioning, Disability and Health (ICF)

The structural underpinnings of the IPPA correspond directly to the ICF model promulgated by the World Health Organization. The ICF conceptualizes human functioning not merely as the absence of biological pathology, but as an interactive synthesis of biological body functions/structures, behavioral activities, and societal participation, moderated by environmental and personal context. The IPPA operates at the intersection of Activity Limitations and Environmental Factors. Assistive devices serve as environmental facilitators designed to eliminate activity limitations and foster authentic participation.

The Human Activity Assistive Technology (HAAT) Model

Conceptualized by Cook and Hussey, the HAAT model provides the operational framework for assistive device delivery. The model emphasizes that an assistive device cannot be judged outside of the holistic system comprising the Human (with specific physical, cognitive, and affective traits), the Activity (the occupational task), the Assistive Technology (the technical intervention), and the Context (physical, social, cultural, and institutional environments). The IPPA operationalizes this framework by documenting performance within the client’s ecological context rather than under artificial laboratory conditions.

Clinimetrics and Patient-Centred Occupational Therapy Theory

Traditional psychometric theory posits that true scores reflect an unobservable latent trait (such as intelligence or depression) driving correlated item responses. In contrast, clinimetrics, a conceptual paradigm advanced by Alvan Feinstein, acknowledges that clinical phenomena (such as symptoms, functional obstacles, or multi-faceted disabilities) often function as indices where distinct variables aggregate to form a clinical condition. In parallel with the Canadian Model of Occupational Performance (CMOP), the IPPA assumes that therapeutic efficacy is best defined through the eyes of the consumer. Individualized problem prioritization provides a sensitive, idiographic lens that respects consumer autonomy and captures clinically significant changes that normative psychometric instruments routinely obscure.

Validity

Extensive cross-national validation trials across the Netherlands, Sweden, the United Kingdom, and Italy have established the validity of the IPPA across diverse clinical cohorts, including stroke survivors, individuals with neuromuscular disorders, older adults with mobility limitations, and people with sensory impairments.

Content and Face Validity

Content validity was established during initial development phases through focus groups comprising rehabilitation clinicians, occupational therapists, physical therapists, assistive technology suppliers, and service users. The open elicitation format ensures that content validity is inherently optimized for each respondent, as items reflect self-selected, authentic challenges. Studies demonstrate that users report high levels of comprehension and endorse the clinical relevance of the assessment protocol.

Construct and Convergent Validity

Construct validity has been verified by evaluating the convergence of IPPA change scores with established outcome instruments:

• Canadian Occupational Performance Measure (COPM): IPPA performance shows moderate-to-high correlations with COPM Performance and Satisfaction change scores (Pearson r and Spearman r typically ranging between 0.55 and 0.78, p < .001). This convergence supports the premise that both instruments tap into individualized functional problem resolution.
• Quebec User Evaluation of Satisfaction with Assistive Technology (QUEST): Moderate positive correlations (r = 0.35 to 0.52) have been recorded between the IPPA Total Change Score and user satisfaction scores on the QUEST 2.0 device subscale, indicating that while problem resolution is related to device satisfaction, the two constructs remain distinct.
• Psychosocial Impact of Assistive Devices Scale (PIADS): Significant correlations emerge between IPPA improvements and the PIADS subscales of Competence (r ≈ 0.45) and Adaptability (r ≈ 0.40), confirming that successful functional problem resolution contributes to self-efficacy and psychosocial adjustment.

Discriminant and Divergent Validity

Discriminant validity is supported by low-to-negligible correlations between IPPA change scores and generic physiological or biological impairment indices (such as muscle strength or range of motion; r < 0.20). Similarly, correlations with generic HRQoL instruments (e.g., the SF-36 Physical Functioning or General Health subscales) remain low to moderate (r = 0.22 – 0.34). These values demonstrate that the IPPA assesses task-specific problem alleviation rather than generalized health perception.

Reliability

Because the IPPA produces an individualized problem list that varies across participants, conventional indicators of internal consistency (such as Cronbach’s alpha) are methodologically inappropriate. High internal consistency assumes item equivalence and unidimensionality across all subjects, whereas the IPPA aggregates discrete, idiosyncratic functional challenges. Consequently, reliability has primarily been established through test-retest stability and inter-rater reproducibility.

Test-Retest Reliability

Test-retest reliability has been rigorously examined under stable, pre-intervention baseline conditions. When respondents undergo repeat IPPA interviews within intervals of one to two weeks prior to receiving their assistive device:

• Intraclass Correlation Coefficients (ICC): The ICC for the overall IPPA baseline score (the sum of Importance × Difficulty) ranges between 0.79 and 0.91 across published evaluation studies, indicating excellent reproducibility.
• Spearman’s Rank Correlation: Rank-order stability for individual problem difficulty ratings between test and retest intervals displays coefficients between 0.72 and 0.88 (p < .001).
• Problem Stability: Studies evaluate whether clients identify identical functional problems upon re-interviewing. Evidence indicates that between 75% and 88% of prioritized problems remain completely stable across baseline test-retest intervals, confirming that clients hold coherent perceptions of their functional priorities.

Inter-Rater and Inter-Interviewer Reliability

When distinct interviewers administer the IPPA baseline interview to the same respondent, agreement on problem categorization and difficulty scoring remains high. ICC values for inter-interviewer problem scoring exceed 0.80 when interviewers have undergone standardized IPPA training. Standard error of measurement (SEM) and smallest detectable change (SDC) calculations demonstrate that changes exceeding 1.5 to 2.0 points on the mean IPPA problem score reflect authentic functional change rather than measurement error.

Factor Analysis

In standard psychometrics, exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) are performed on a static matrix of uniform questionnaire items to identify latent traits (such as anxiety or general intelligence). Applying classical EFA/CFA to the IPPA is methodologically contraindicated because:

• The items themselves are not standardized across participants; Respondent A may list “opening a jam jar”, whereas Respondent B lists “navigating city bus steps”.
• The scale functions as a formative clinimetric index rather than a reflective psychometric model. In a reflective model, variations in the latent trait cause variations in all item responses. In the IPPA, resolving one functional difficulty (e.g., getting in and out of the bath via a bath lift) does not imply or require a reduction in another difficulty (e.g., cutting food).

To address structural validity within clinimetric paradigms, psychometricians have evaluated the IPPA using nonparametric item response frameworks and structural clinimetric methodologies:

• Dimensionality of Change: When assessing the unidimensionality of the IPPA change score vector (Difficulty_Pre − Difficulty_Post), research indicates that perceived benefit operates along a coherent single dimension of functional problem resolution. Rasch and Mokken analyses applied to categorized problem clusters demonstrate acceptable scaling characteristics, confirming that weighted improvement scores can be legitimately aggregated into a composite total score without violating measurement assumptions.
• Category Functioning: Analysis of the 5-point response scale distributions indicates monotonic progression across category thresholds; respondents distinguish clearly between adjacent response anchors (e.g., some difficulty vs. great difficulty) without threshold disordering.

Instrument / Measurement Tool

The IPPA is a clinician- or researcher-administered semi-structured interview protocol. Administration follows a structured, multi-phase sequence:

Structure and Format

• Administration Modality: Semi-structured face-to-face or virtual clinical interview conducted by a trained assessor (e.g., occupational therapist, physical therapist, or clinical researcher).
• Target Population: Adults and older adults with physical, sensory, or multiple disabilities who are candidates for, or recipients of, assistive technology devices and environmental adaptations.
• Assessment Timeline: Two-stage longitudinal design:
  • Phase 1 (Baseline / Pre-provision): Administered immediately before or during the assessment/ordering of the assistive device.
  • Phase 2 (Follow-up / Post-provision): Administered typically 6 to 12 weeks after the client has received, integrated, and used the assistive device in their daily routine.
• Item Inventory: Open-ended formulation of up to 7 personally prioritized activity problems, facilitated by a standardized 7- or 8-domain prompt checklist.

Scoring Protocol and Mathematical Formulation

• Rating Scale 1: Importance (Baseline Only): Each identified problem ($i$) is rated on a 5-point ordinal scale:
  • $1$ = Not important
  • $2$ = Slightly important
  • $3$ = Important
  • $4$ = Very important
  • $5$ = Most important
• Rating Scale 2: Difficulty (Administered at Pre- and Post-Test): Each identified problem ($i$) is rated for difficulty:
  • $1$ = No difficulty / Easy
  • $2$ = Some difficulty
  • $3$ = Moderate difficulty
  • $4$ = Great difficulty
  • $5$ = Cannot perform at all / Severe problem
• Problem Score Calculation: For any problem $i$, the weighted problem score ($S_i$) is calculated by multiplying its baseline importance weight ($I_i$) by its difficulty score ($D_i$):
  $$\text{Problem Score}_i = I_i \times D_i$$
  Individual problem scores range from $1$ ($1 \times 1$) to $25$ ($5 \times 5$).
• Total Score Calculation: The sum of all weighted problem scores divided by the number of prioritized problems ($k$):
  $$\text{Mean Total IPPA Score} = \frac{\sum_{i=1}^{k} (I_i \times D_i)}{k}$$
  This mean total score standardizes results across individuals regardless of whether they identified 3, 5, or 7 problems.
• Change Score (Intervention Effect): The change score is obtained by subtracting the post-provision score from the baseline score:
  $$\Delta \text{IPPA} = \text{Mean Total IPPA}_{\text{Baseline}} – \text{Mean Total IPPA}_{\text{Follow-up}}$$
  A positive value indicates problem alleviation, functional improvement, and effective assistive technology impact.

Permissions & Fee and Test Year

The original conceptualization and primary psychometric validation of the Individually Prioritized Problem Assessment were completed and published between 2000 and 2002 by R. D. Wessels, L. P. de Witte, and their international project team under the auspices of European Commission-supported research grants (e.g., within the EATS consortium).

• Copyright Status: The conceptual framework and specific instructional manuals are proprietary to the original developers and associated academic institutions (such as the Institute for Rehabilitation Research, Hoensbroek / Maastricht University).
• Research and Clinical Use: The IPPA was developed as a public-access clinical research measure for non-commercial rehabilitation practice and scientific inquiry. While available without commercial licensing fees for clinical and non-profit research purposes, clinicians and investigators are expected to utilize official user manuals, adhere to standard interview administration instructions, and cite the original publications.
• Commercial Applications: Commercial deployments, incorporation into proprietary digital health management software, or third-party corporate trials require explicit permission and written licensing agreements from the rights holders.

References

• Cook, A. M., & Polgar, J. M. (2015). Assistive technologies: Principles and practice (4th ed.). Elsevier Health Sciences.
• Feinstein, A. R. (1987). Clinimetrics. Yale University Press.
• Law, M., Baptiste, S., Carswell, A., McColl, M. A., Polatajko, H., & Pollock, N. (1998). Canadian Occupational Performance Measure (3rd ed.). CAOT Publications ACE.
• Persson, J., Gard, L., & Eftring, H. (2003). Outcome measurement in assistive technology: A review of instruments and their properties. Technology and Disability, 15(2), 79–87. https://doi.org/10.3233/TAD-2003-15203
• Wessels, R. D., & de Witte, L. P. (2003). Reliability and validity of the Dutch version of the Individually Prioritized Problem Assessment (IPPA). Technology and Disability, 15(2), 95–103. https://doi.org/10.3233/TAD-2003-15205
• Wessels, R. D., de Witte, L. P., & van den Heuvel, W. J. (2004). Measuring the outcomes of assistive technology: An overview of the available instruments. Technology and Disability, 16(4), 195–203. https://doi.org/10.3233/TAD-2004-16402
• Wessels, R. D., Persson, J., Gard, L., & de Witte, L. P. (2002). The Individually Prioritized Problem Assessment (IPPA): Psychometric properties of an instrument to assess the effects of assistive technology on activities. Technology and Disability, 14(4), 173–178. https://doi.org/10.3233/TAD-2002-14404
• World Health Organization. (2001). International Classification of Functioning, Disability and Health: ICF. World Health Organization.

Items of the Scale