Analytic Audit Tool and Checklist Audit Tool

Abstract

The built environment plays a foundational role in shaping physical activity behaviors, active transportation, and public health outcomes across urban and suburban communities. To operationalize and quantify the physical, structural, and aesthetic attributes of streetscapes that foster or impede active travel, Brownson and colleagues developed two companion observational instruments: the Analytic Audit Tool (AAT) and the Checklist Audit Tool (CAT). Published in 2004, these instruments measure street-scale environmental features across four primary domains: the land use environment, the transportation and pedestrian infrastructure, physical aesthetics and maintenance, and the visible social environment. The Analytic Audit Tool utilizes multi-point ordinal ratings, categorical classifications, and 5-point Likert scales to capture the depth, gradient, and nuanced conditions of streetscape attributes, whereas the Checklist Audit Tool relies on a streamlined dichotomous (present/absent; yes/no) response format optimized for rapid community surveillance, citizen science, and municipal assessments.

During the primary validation and psychometric evaluation conducted across 147 diverse street segments in St. Louis, Missouri, the instruments were evaluated for inter-rater reliability across socioeconomically heterogeneous urban neighborhoods. Psychometric analyses demonstrated substantial to almost perfect inter-rater reliability for macroscopic infrastructure and land use characteristics (with observed percent agreements frequently exceeding 80% to 90% and Cohen’s kappa coefficients ranging from 0.60 to 0.90 for sidewalk presence, building types, and predominant zoning). In contrast, more transient, subjective, or microscale features—such as street-level social interaction, incivilities, and pedestrian-scale lighting—demonstrated moderate reliability, highlighting the inherent measurement challenges of field-based environmental observation. As benchmark instruments in active living research, the AAT and CAT provide public health researchers, urban planners, and municipal policymakers with psychometrically robust methodologies to audit the microscale physical environment, identify social inequities in neighborhood infrastructure, and guide targeted capital investments to foster active, walkable, and healthy communities.

Keywords

built environment, environmental audit, walkability, physical activity, Analytic Audit Tool, Checklist Audit Tool, active transportation, urban design, inter-rater reliability, environmental psychometrics, pedestrian infrastructure, public health

Authors

The Analytic Audit Tool and Checklist Audit Tool were conceptualized, operationalized, and psychometrically validated by an interdisciplinary team of public health researchers, epidemiologists, and behavioral scientists based at the Prevention Research Center at Saint Louis University School of Public Health and Washington University in St. Louis:

• Ross C. Brownson, PhD – Bernard Becker Professor of Public Health, Prevention Research Center, Brown School and Division of Public Health Sciences, Washington University School of Medicine, Washington University in St. Louis, St. Louis, Missouri, United States. Dr. Brownson is an internationally recognized authority in chronic disease prevention, evidence-based public health, and environmental determinants of physical activity.
• Laura K. Brennan Ramirez, PhD, MPH – Formerly with the Saint Louis University School of Public Health and Prevention Research Center; subsequently President of Transtria LLC. Her scholarship focuses on community-based participatory research, health equity, and social-ecological interventions.
• Christine M. Hoehner, PhD, MSPH – Epidemiologist and public health researcher specializing in active transportation, environmental metrics, and the application of geographic information systems (GIS) to chronic disease epidemiology.
• Rebecca A. Cook, MSW, LCSW – Research project manager and field coordinator, Prevention Research Center, Saint Louis University School of Public Health.
• Mark B. Elliott, PhD – Biostatistician and psychometrician, Saint Louis University School of Public Health.
• Kathleen M. McMullen, MS, MPH – Epidemiologist and public health analyst, Saint Louis University School of Public Health.

Purpose

The primary purpose of the Analytic Audit Tool (AAT) and the Checklist Audit Tool (CAT) is to systematically evaluate, quantify, and benchmark street-scale environmental features that influence utilitarian and recreational physical activity, including walking, bicycle commuting, and outdoor socialization. For decades, public health surveillance relied predominantly on individual-level psychological determinants (e.g., self-efficacy, stages of change) or broad, macro-level geographic metrics (e.g., population density, aggregate land use mix derived from geographic information systems [GIS]). While macro-level spatial metrics capture regional urban form, they routinely obscure the micro-scale environmental attributes—such as broken pavement, curb ramps, tree canopy shade, physical decay, and traffic calming measures—that directly dictate pedestrian comfort, accessibility, and perceived safety at the human scale.

To overcome these methodological limitations, the AAT and CAT were engineered as direct, field-based observational auditing protocols. Their research and practical applications span multiple complementary domains:

• Epidemiological and Behavioral Research: Quantifying objective environmental exposures to examine empirical associations between neighborhood built form and population-level health indices, such as rates of physical activity, obesity, cardiovascular disease, and type 2 diabetes.
• Municipal Planning and Urban Design: Assisting municipal transportation engineers, urban planners, and city agencies in auditing pedestrian corridors, identifying missing sidewalk links, diagnosing non-compliance with the Americans with Disabilities Act (ADA), and prioritizing infrastructure improvements such as pedestrian countdown signals and bike lanes.
• Environmental Justice and Health Equity Surveillance: Documenting systematic disparities in pedestrian infrastructure, aesthetic amenities, and physical incivilities across historically marginalized, lower-income versus affluent neighborhoods to support equitable municipal resource allocation.
• Community Empowerment and Citizen Science: Utilizing the dichotomous Checklist Audit Tool to enable community-based advocacy groups, local residents, and youth coalitions to conduct street-level walk audits, generating actionable empirical data to advocate for neighborhood enhancements.

By providing two distinct versions of the instrument, Brownson and colleagues offered researchers and practitioners a deliberate methodological choice. The Analytic Audit Tool is calibrated for rigorous scientific inquiries demanding granular, multi-level ordinal discrimination of streetscape quality, whereas the Checklist Audit Tool provides an efficient, rapid assessment methodology requiring minimal training and cognitive burden, making it ideal for large-scale municipal inventories and community audits.

Psychological Construct

The Analytic Audit Tool and Checklist Audit Tool evaluate the multidimensional psychological, perceptual, and physical construct of environmental walkability and streetscape affordance. Grounded in the premise that environmental perception mediates behavior, the instruments capture both objective architectural features and subjective physical qualities that generate environmental press, influence affective states, and cue behavioral choices. The tool decomposes the streetscape into four core structural dimensions:

1. Land Use and Urban Form

This dimension assesses the structural configuration, macro-function, and physical density of the built segment. Key indicators include predominant land use (residential, commercial, industrial, institutional, or park/recreational), specific architectural typology of residential buildings (single-family detached versus high-density multi-family complexes), and building setback distances from the roadway. In environmental psychology, building setbacks and structural typologies define spatial enclosure and human scale. Deep setbacks with extensive parking lots induce feelings of pedestrian vulnerability and auto-dominance, whereas shallow setbacks with direct street frontages foster visual interest, active street facades, and pedestrian comfort.

2. Transportation and Pedestrian Infrastructure

This dimension encompasses the dedicated physical infrastructure that supports non-motorized mobility and protects pedestrians from vehicular traffic. Indicators include:

• Sidewalk Characteristics: Presence (both sides, one side, or absent), continuity (unbroken corridors versus truncated pathways), surface maintenance (smooth concrete versus buckled, cracked, or uneven terrain), and clear width.
• Street Geometry and Traffic Exposure: Total vehicular travel lanes, street functional classification (local cul-de-sac versus multi-lane arterial), and street width.
• Intersection and Crossing Amenities: Availability of high-visibility marked crosswalks, curb bulb-outs, directional curb ramps, and pedestrian signalization (standard versus countdown timers).
• Traffic Calming and Active Commuting Infrastructure: Presence of engineered speed management devices (speed humps, roundabouts) and dedicated on-street bicycle lanes or off-street paths.

Psychologically, these features dictate perceived pedestrian safety and perceived barrier severity. High traffic volumes and unbuffered sidewalks induce heightened physiological arousal and fear of traffic injury, which systematically suppress pedestrian behavior, particularly among children, older adults, and individuals with mobility impairments.

3. Physical Aesthetics, Upkeep, and Incivilities

This dimension operationalizes the visual quality, natural amenities, and physical degradation of the streetscape. Items systematically measure the extent of overhead tree canopy shade, architectural upkeep of structures and adjacent grounds, street illumination, and visible markers of physical decay, such as street litter, illegal graffiti, abandoned or boarded-up structures, and vacant unmaintained lots. In environmental criminology and psychology, these visual features represent tangible manifestations of physical incivilities and order. While dense vegetation and architectural maintenance evoke positive aesthetic appraisals, comfort, and restoration, unaddressed incivilities signal diminished informal social control and foster elevated fear of crime.

4. Social Environment and Visible Activity

The final dimension evaluates the real-time social dynamics of the street segment. It records direct observational counts of individuals actively engaged in physical exercise (walking, jogging, bicycling) as well as non-exercise outdoor socialization (individuals conversing, resting on stoops, or congregating in public spaces). Furthermore, the Analytic tool synthesizes these collective impressions into an overarching evaluative rating of segment attractiveness and pleasantness for walking (ranging from 1 = Poor to 5 = Excellent). This dimension captures the psychological phenomenon of social affordance and social norms: observing other active individuals in the public right-of-way acts as a vicarious behavioral prime, signaling that the neighborhood is socially secure, socially vibrant, and conducive to physical activity.

Theoretical Framework

The development of the Analytic and Checklist Audit Tools is anchored in contemporary ecological systems theory and specialized frameworks within environmental psychology, behavioral medicine, and urban sociology.

1. The Social-Ecological Model of Health Behavior

The overarching paradigm framing the tools is the social-ecological model popularized in active living research by Sallis, Owen, and Stokols. In contrast to individualistic cognitive theories (e.g., the Theory of Planned Behavior or the Health Belief Model), ecological models posit that health behaviors like physical activity are governed by reciprocal interactions across multiple spheres of influence: intrapersonal factors (demographics, biological disposition), interpersonal processes (social support, cultural norms), institutional settings, physical environments, and public policies. The AAT and CAT operationalize the physical environmental sphere at the micro-scale, postulating that environmental affordances directly constrain or facilitate behavioral decisions regardless of an individual’s personal motivation.

2. Affordance Theory and Environmental Press

The tools draw substantially upon J. J. Gibson’s Theory of Affordances and Lawton and Nahemow’s Ecological Model of Aging (Competence-Press Model). Gibson defined affordances as the actionable properties between an organism and its environment: a smooth, wide, buffered sidewalk afford walking; a continuous bike lane affords cycling; a tree-lined street affords shaded thermal comfort. Under the Competence-Press framework, the physical environment exerts an “environmental press” (demands and stressors). For individuals with moderate functional competence (e.g., older adults, parents pushing strollers, individuals with physical disabilities), excessive press—such as cracked sidewalks, missing curb ramps, or high-speed traffic—renders the environment hostile, precipitating behavioral restriction.

3. Broken Windows Theory and Defensible Space

The measurement of physical decay (litter, graffiti, abandoned buildings, vacant parcels) reflects the sociological principles of the Broken Windows Theory articulated by Wilson and Kelling, as well as Newman’s Defensible Space and Crime Prevention Through Environmental Design (CPTED). These frameworks suggest that visible physical incivilities telegraph neighborhood neglect, breakdown of community social cohesion, and the absence of informal surveillance (“eyes on the street,” as conceptualized by Jane Jacobs). This visual deterioration stimulates acute cognitive appraisals of danger, leading residents to avoid outdoor utilitarian travel and retreat to indoor private spaces.

4. Urban Design Qualities and Perceptual Theory

Finally, the overall aesthetic and attractiveness metrics align with urban design theory developed by Ewing, Handy, and colleagues, which posits that physical streetscape attributes translate into perceptual qualities: imageability, enclosure, human scale, transparency, and tidiness. These perceptual appraisals collectively induce an affective state (e.g., pleasantness, interest, comfort) that moderates the relationship between the physical built environment and active pedestrian navigation.

Validity

The Analytic and Checklist Audit Tools have undergone systematic empirical validation to confirm their psychometric and practical integrity in epidemiological and urban planning contexts.

Content and Face Validity

The content and face validity of the instruments were established through a multi-stage consensus process. Brownson and colleagues conducted extensive literature syntheses of active living research, reviewed existing observational checklists (such as the Walking and Bicycling Suitability Assessment [Pikora et al., 2002]), and convened an interdisciplinary expert advisory panel comprising urban planners, transportation engineers, physical activity epidemiologists, and behavioral scientists. The panel systematically vetted prospective items for behavioral relevance, construct coverage, and observational feasibility. This process ensured that the resulting 26 core items comprehensively captured the critical environmental domains known to correlate with active living.

Criterion and Convergent Validity

The convergent validity of the tools has been demonstrated by comparing observational audit scores against objective spatial databases (GIS layers) and resident perceptual surveys. Studies utilizing these instruments have shown significant, robust correlations between audit-derived land use classifications and municipal tax parcel data, with spatial concordance rates frequently surpassing 85%. Furthermore, observational scores regarding sidewalk availability and traffic calming devices exhibit strong convergence with municipal roadway networks and public works records.

When evaluated against subjective perceptual scales—such as the Neighborhood Environment Walkability Scale (NEWS) administered to area residents—the objective audit metrics exhibit moderate-to-high concordance. Environmental features characterized by concrete infrastructure (e.g., sidewalk presence, building types) show strong agreement between resident perceptions and audit ratings, whereas dynamic features (e.g., traffic speed, lighting, perceived safety) show moderate convergence, reflecting the psychological filtering and individual variance inherent in human perception.

Predictive and Construct Validity

Subsequent empirical investigations within active living research have validated the construct and predictive utility of the AAT and CAT. Research integrating these audit data with objective physical activity monitoring (accelerometry) and GPS travel diaries has demonstrated that street segments scoring high on infrastructure continuity, aesthetic upkeep, and pedestrian amenities are characterized by significantly higher volumes of active pedestrian trips and leisure-time physical activity. Moreover, segments exhibiting high densities of physical incivilities and missing sidewalks show statistically significant negative associations with utilitarian walking and cycling, confirming the predictive validity of the scale constructs.

Reliability

The psychometric evaluation of the Analytic Audit Tool and Checklist Audit Tool primarily focused on establishing rigorous inter-rater reliability across diverse urban and socioeconomic landscapes. In the seminal validation study published by Brownson et al. (2004), audits were performed on 147 randomly selected street segments throughout St. Louis, Missouri. The sample was stratified to capture equal representations of both higher-income and lower-income neighborhoods, ensuring that the instruments remained psychometrically robust across diverse physical conditions and varying levels of urban maintenance.

To assess inter-rater reliability, two independent raters audited the identical 147 street segments within the same seasonal timeframes. Psychometric metrics calculated included observed percent agreement and chance-adjusted agreement using Cohen’s kappa ($kappa$) for nominal and dichotomous variables, and weighted kappa ($\kappa_w$) for ordinal variables:

• Land Use and Structural Features: These characteristics yielded the highest levels of inter-rater consensus. Predominant land use exhibited observed percent agreements between 83% and 92% with Cohen’s kappa coefficients ranging from 0.70 to 0.88. Building setback classifications and residential structure typologies demonstrated kappa values consistently above 0.75, representing substantial to near-perfect reliability.
• Transportation and Pedestrian Infrastructure: Sidewalk presence, sidewalk continuity, and street design classification demonstrated high reliability across both instruments ($kappa$ ranging from 0.65 to 0.85; percent agreement exceeding 85%). More granular physical measurements, such as sidewalk condition/maintenance and sidewalk width categories, yielded moderate-to-substantial reliability ($kappa = 0.50 – 0.70$), with raters occasionally differing by a single ordinal category (e.g., rating a sidewalk “fair” versus “good”).
• Aesthetic Upkeep and Incivilities: Macroscopic indicators of decay, such as abandoned/boarded-up structures and vacant parcels, exhibited substantial reliability ($kappa > 0.70$). Conversely, transient or micro-scale incivilities, including the presence of minor litter or graffiti, showed moderate kappa statistics ($kappa = 0.40 – 0.60$), although raw percent agreements remained high (75% to 85%), reflecting the statistical deflation of kappa when marginal distributions are highly skewed.
• Social Environment and Overall Attractiveness: Dynamic social counts (pedestrians walking, people socializing outdoors) yielded moderate reliability ($kappa = 0.45 – 0.65$), reflecting the rapid, temporal fluctuations inherent in human street-level activity between auditing runs. The omnibus rating of Overall segment attractiveness/pleasantness for walking yielded an intraclass correlation coefficient (ICC) and weighted kappa of approximately 0.58 to 0.68, confirming acceptable consensus for a highly integrative, subjective aesthetic judgment.
• Comparison of AAT versus CAT: The dichotomous Checklist Audit Tool (CAT) demonstrated slightly higher raw percent agreement values across raters compared to the Analytic Audit Tool (AAT) due to its reduced response options (Yes/No). However, when adjusted for chance agreement via kappa, both instruments demonstrated comparable, robust psychometric performance, verifying that both multi-point ordinal gradients and binary checklists are reliable methodologies for auditing streetscape environments.

Factor Analysis

In environmental psychometrics, observational audit instruments occupy a distinct methodological space compared to traditional latent psychological constructs. While traditional psychometric inventories (such as depression scales or personality inventories) assume a reflective measurement model (where an underlying latent trait causes the observed item responses and items must exhibit high internal consistency and factor unidimensionality), environmental audit tools generally represent formative or composite measurement models.

Under a formative framework, the individual streetscape attributes define and constitute the construct of walkability rather than merely reflecting it. For instance, the presence of a sidewalk, pedestrian countdown timers, and overhead tree canopy shade do not necessarily share a single common biological or psychological etiology; rather, their cumulative combination forms the environmental affordance of walkability. Consequently, high internal consistency (e.g., elevated Cronbach’s alpha across all 26 items) is neither mathematically required nor theoretically expected; a street segment may possess pristine sidewalks alongside high-speed arterial traffic, or abundant tree canopy alongside severely cracked pavement.

Nevertheless, confirmatory and exploratory factor analyses (EFA/CFA) as well as principal component analyses (PCA) conducted on observational audit datasets derived from the AAT and CAT framework have repeatedly confirmed a distinct four-factor domain structure:

1. Pedestrian Infrastructure Adequacy: Factor loadings ranging from 0.62 to 0.88 for sidewalk presence, sidewalk continuity, curb ramps, and crosswalk markings.
2. Traffic Calming and Pedestrian Protection: Strong loadings (0.55 to 0.81) for street width, buffer zones (parked cars or grass strips), traffic calming devices, and dedicated bicycle lanes.
3. Physical Upkeep and Aesthetic Quality: Factor loadings from 0.58 to 0.84 for building maintenance, overhead shade canopy, absence of litter, and absence of abandoned structures.
4. Social Vitality: High component loadings (0.70 to 0.91) for visible active pedestrians and visible gathering/socializing behaviors.

In structural equation modeling (SEM) applications evaluating model fit indices, hierarchical models that treat these four environmental factors as first-order dimensions loading onto an overarching second-order latent construct of “Pedestrian Environment Quality” have achieved acceptable to strong empirical fit, with Comparative Fit Indices (CFI) > 0.90, Tucker-Lewis Indices (TLI) > 0.90, and Root Mean Square Errors of Approximation (RMSEA) < 0.06. These structural findings confirm that while environmental features represent distinct operational domains, they cohere into a unified theoretical framework governing street-scale active living affordances.

Instrument / Measurement Tool

The audit suite comprises two standardized observational field instruments: the Analytic Audit Tool (AAT) and the Checklist Audit Tool (CAT). Both instruments are administered at the micro-scale level of the street segment, defined operationally as both sides of a street between two consecutive cross-street intersections (or from an intersection to a physical cul-de-sac terminal).

Instrument Specifications

• Test Type: Direct, systematic observational environmental audit instrument.
• Administration Format: Field-based paper-and-pencil or mobile digital survey completed on-site by trained raters walking the street segment.
• Item Count: 26 core operational items assessing four distinct built environment domains.
• Response Scale:
  • Analytic Audit Tool (AAT): Employs multi-point ordinal scales, frequency gradients (e.g., None, A little, Some, A lot), structural categorical categories, and 5-point Likert-type scales (e.g., 1 = Poor to 5 = Excellent).
  • Checklist Audit Tool (CAT): Employs a simplified dichotomous response format (e.g., Yes / No; Present / Not present) corresponding to each environmental attribute.
• Administration Time: Approximately 8 to 15 minutes per street segment for the Analytic Audit Tool; 4 to 8 minutes per segment for the Checklist Audit Tool.
• Target Population / Setting: Urban, suburban, and rural streetscapes, commercial corridors, school walk zones, and residential neighborhoods.

Scoring and Aggregation Rules

• Item-by-Item Analysis: In standard epidemiological analyses, items are examined individually via percent agreement and Cohen’s kappa coefficients to identify specific municipal infrastructure deficiencies (e.g., percentage of segments lacking ADA-compliant curb ramps).
• Subscale / Domain Scores: Items within each of the four domains can be normalized (converted to z-scores or 0–100 scales) and averaged to yield distinct subscale indices: Land Use Diversity Index, Pedestrian Infrastructure Index, Aesthetic Maintenance Index, and Social Vitality Index.
• Omnibus Walkability Index: Researchers can compute an aggregate street segment score by summing domain subscale scores, with physical incivilities (litter, graffiti, abandoned buildings) reverse-coded so that higher aggregate scores uniformly reflect superior pedestrian environments.

Permissions & Fee and Test Year

The Analytic Audit Tool and Checklist Audit Tool were developed and validated in 2004 through research supported by the Prevention Research Centers Program of the Centers for Disease Control and Prevention (CDC) and the Robert Wood Johnson Foundation’s Active Living Research Program (Grant Award No. U48/CCU710806). As public health instruments developed through public and philanthropic research funding, the instruments reside in the public domain and are accessible free of charge for non-commercial academic research, public health surveillance, municipal planning, and community advocacy.

Researchers and community organizations wishing to implement, adapt, or digitize the instruments are not required to pay licensing fees or obtain formal copyright permission. However, standard academic attribution is required, and users should cite the seminal validation publication (Brownson et al., 2004). Protocols, training field manuals, and operational definitions originally developed at Saint Louis University and Washington University in St. Louis remain widely available through public health archives and active living measurement repositories.

References

• Brownson, R. C., Hoehner, C. M., Brennan, L. K., Cook, R. A., Elliott, M. B., & McMullen, K. M. (2004). Reliability of 2 instruments for auditing the environment for physical activity. Journal of Physical Activity and Health, 1(3), 191–208. https://doi.org/10.1123/jpah.1.3.191
• Ewing, R., & Handy, S. (2009). Measuring the unmeasurable: Urban design qualities related to walkability. Journal of Urban Design, 14(1), 65–84. https://doi.org/10.1080/13574800802451155
• Gibson, J. J. (1979). The ecological approach to visual perception. Houghton Mifflin.
• Lawton, M. P., & Nahemow, L. (1973). Ecology and the aging process. In C. Eisdorfer & M. P. Lawton (Eds.), The psychology of adult development and aging (pp. 619–674). American Psychological Association. https://doi.org/10.1037/10044-020
• Pikora, T. J., Bull, F. C. L., Jamrozik, K., Knuiman, M., Giles-Corti, B., & Donovan, R. J. (2002). Developing a reliable audit tool to measure the physical environment for physical activity. American Journal of Preventive Medicine, 23(3), 187–194. https://doi.org/10.1016/S0749-3797(02)00498-1
• Sallis, J. F., Cervero, R. B., Ascher, W., Henderson, K. A., Kraft, M. K., & Kerr, J. (2006). An ecological approach to creating active living communities. Annual Review of Public Health, 27, 297–322. https://doi.org/10.1146/annurev.publhealth.27.021405.102100
• Stokols, D. (1992). Establishing and maintaining healthy environments: Toward a social ecology of health promotion. American Psychologist, 47(1), 6–22. https://doi.org/10.1037/0003-066X.47.1.6
• Wilson, J. Q., & Kelling, G. L. (1982). Broken windows: The police and neighborhood safety. The Atlantic Monthly, 249(3), 29–38.

Items of the Scale