Gut Feelings Questionnaire for General Practitioners

Abstract

The Gut Feelings Questionnaire for General Practitioners (originally developed in Dutch as the Pluis/Niet-Pluis vragenlijst voor huisartsen; Stolper et al., 2013) is a specialized psychometric instrument designed to capture and quantify the non-analytical, intuitive diagnostic impressions experienced by primary care physicians during medical consultations. Grounded in contemporary cognitive psychology and decision theory, the questionnaire operationalizes the Dutch clinical concepts of pluis (a reassuring sense that a patient’s clinical situation is benign and safe) and niet-pluis (an intuitive sense of alarm indicating that something serious or atypical may be occurring, even in the absence of overt pathological markers). The measurement tool comprises two primary, distinct subscales: the Sense of Alarm (SoA) dimension and the Sense of Reassurance (SoR) dimension, along with context-specific items evaluating the trigger mechanisms, somatic sensations, and subsequent clinical management decisions. The instrument has been validated in multiple European countries across both simulated and routine primary care environments. Psychometric evaluations demonstrate robust content validity established through rigorous international Delphi consensus procedures, stable two-factor structural validity confirmed via exploratory and confirmatory factor analyses, adequate internal consistency (with Cronbachu2019s alpha coefficients typically ranging from .70 to .85 across diverse language adaptations), and significant predictive validity for critical patient outcomes, including urgent specialist referrals and undetected severe pathologies. As an assessment tool, the questionnaire bridges the gap between tacit cognitive heuristics and evidence-based medicine, offering clinicians and researchers an empirical framework to evaluate the diagnostic utility of medical intuition in reducing diagnostic delays and diagnostic errors.

Keywords

Gut Feelings Questionnaire, Pluis/Niet-pluis, Clinical Intuition, Diagnostic Reasoning, Primary Care, Sense of Alarm, Sense of Reassurance, Dual-Process Theory, Medical Decision-Making, Heuristics in Medicine, Psychometrics, General Practice.

Authors

The Gut Feelings Questionnaire was developed by an international multidisciplinary research collaboration led by primary care clinicians, medical educators, and cognitive psychologists based primarily in the Netherlands and Belgium:

• C. Erik Stolper, MD, PhD: General Practitioner and Senior Researcher, Department of Family Practice, CAPHRI Care and Public Health Research Institute, Maastricht University, Maastricht, The Netherlands; and Department of Family Medicine and Population Health, University of Antwerp, Antwerp, Belgium.
• Margaretha W. J. van de Wiel, PhD: Cognitive Psychologist and Associate Professor, Department of Work and Social Psychology, Maastricht University, Maastricht, The Netherlands.
• Paul Van Royen, MD, PhD: Professor of Family Medicine, Department of Family Medicine and Population Health, Faculty of Medicine and Health Sciences, University of Antwerp, Antwerp, Belgium.
• Geert-Jan Dinant, MD, PhD: Emeritus Professor of General Practice, Department of Family Practice, CAPHRI, Maastricht University, Maastricht, The Netherlands.
• Marloes A. van Bokhoven, PhD: Senior Researcher, Department of Family Practice, Maastricht University, Maastricht, The Netherlands.

Correspondence regarding the original research program on gut feelings in general practice is typically directed to the Department of Family Practice at Maastricht University or the University of Antwerp’s Primary Care Research Network.

Purpose

The clinical diagnostic trajectory in general practice is characterized by high uncertainty, low disease prevalence, undifferentiated presentations, and constrained consultation times. In this high-stakes context, physicians frequently experience immediate, holistic impressions regarding the severity of a patientu2019s condition before analytical reasoning can systematically categorize every symptom. For decades, medical education and evidence-based practice models treated these subjective impressionsu2014often colloquially termed “hunches,” “intuition,” or “gut feelings”u2014with skepticism, viewing them as idiosyncratic, unscientific, or prone to cognitive bias. The primary purpose of the Gut Feelings Questionnaire (GFQ) is to transform this informal, tacit cognitive phenomenon into an empirically measurable, scientifically validated psychological construct.

From a clinical perspective, the GFQ serves as an explicit metacognitive prompt. By recording whether a consultation evokes a sense of alarm or a sense of reassurance, general practitioners (GPs) can systematically register their intuitive appraisals and cross-examine them against objective biomedical findings. The instrument helps clinicians acknowledge warning signals that bypass standard diagnostic algorithms, facilitating timely interventions in occult conditions such as early-stage sepsis, atypical myocardial infarction, meningococcal infection, or occult malignancy. Conversely, documenting a validated sense of reassurance prevents unnecessary diagnostic testing, iatrogenic harm, and diagnostic cascade effects by reinforcing watchful waiting strategies.

In academic and research settings, the GFQ enables health services researchers to investigate the diagnostic accuracy, sensitivity, and specificity of physician intuition across epidemiological contexts. It allows researchers to quantify the relationship between physician experience level, diagnostic acumen, tolerance of ambiguity, and patient outcomes. Furthermore, the questionnaire provides a rigorous assessment framework for medical educators. By deploying the GFQ in residency training and simulated patient encounters, educators can teach trainees how to calibrate intuitive cognitive heuristics, identify cognitive dissonance, and integrate non-analytical reasoning with analytical clinical algorithms to minimize diagnostic error.

Psychological Construct

The psychological construct measured by the Gut Feelings Questionnaire resides at the intersection of cognitive psychology, somatic affective theory, and medical expertise. Stolper and colleagues delineated gut feelings in general practice into two distinct, non-overlapping psychological dimensions that operate as diagnostic compasses: the Sense of Alarm and the Sense of Reassurance.

1. The Sense of Alarm (Niet-Pluis Gevoel)

The Sense of Alarm is defined as an uneasy, visceral sensation experienced by the clinician that a patient’s health status is dangerously compromised, even when physical examinations and conventional diagnostic tests reveal no alarming abnormalities. It functions as an internal cognitive and physiological alarm bell. Clinicians experiencing a sense of alarm report an acute need to maintain clinical vigilance, escalate diagnostic investigation, initiate emergency management, or avoid sending the patient home without a contingency safety-net plan.

This dimension is characterized by specific psychological features:

• Cognitive Dissonance: An awareness of an incongruence between the patient’s objective clinical presentation and their underlying vulnerability or demeanor.
• Somatic Manifestations: Physical sensations such as autonomic nervous system arousal, visceral discomfort, or tension in the clinician.
• Action Orientation: An impulse to break standardized, step-by-step clinical protocols to implement protective measures, urgent second opinions, or hospital admissions.

2. The Sense of Reassurance (Pluis Gevoel)

The Sense of Reassurance is defined as a confident, calm cognitive-affective state in which the GP feels secure about the patientu2019s prognosis and the benign trajectory of the presenting complaint, even in the presence of dramatic, uncomfortable, or distressing symptoms. It is not merely the absence of fear; it represents an active cognitive appraisal that the clinical picture fits a known, non-threatening pattern.

Key psychological markers of the sense of reassurance include:

• Pattern Congruence: The rapid mental matching of the patient’s narrative, vital signs, and contextual history with safe, self-limiting clinical archetypes.
• Affective Equanimity: The absence of physiological stress responses in the practitioner, accompanied by confidence in a “watchful waiting” management plan.
• Reassurance Transference: The clinician’s ability to communicate calm and clarity to the patient and their family, reducing unnecessary healthcare consumption.

3. The Determinants and Modulating Factors

The construct encompasses the contextual cues that trigger these sensations. These determinants include non-verbal behaviors (e.g., changes in eye contact, complexion, muscle tone, or breathing pattern), parental concerns (particularly in pediatric cases), unexpected alterations in patient behavior, and subtle deviations from a patientu2019s baseline functional health that only a primary care physician with longitudinal familiarity can identify.

Theoretical Framework

The conceptual architecture of the Gut Feelings Questionnaire is anchored in several established frameworks of cognitive science and naturalistic decision-making.

Dual-Process Theory of Cognition

The primary theoretical foundation is the Dual-Process Theory of human reasoning, articulated by cognitive psychologists such as Jonathan Evans, Keith Stanovich, and Nobel laureate Daniel Kahneman. Dual-process theory posits that human decision-making is governed by two complementary cognitive modes:

• System 1 (Heuristic, Non-Analytical): Fast, automatic, effortless, associative, and emotionally charged. It operates largely beneath conscious awareness, drawing rapidly on stored archetypes, illness scripts, and pattern recognition.
• System 2 (Analytical, Deliberative): Slow, effortful, rule-governed, logical, and computationally demanding. It is engaged during formal hypothetico-deductive diagnostic reasoning.

The GFQ captures the direct experiential manifestation of System 1 reasoning in clinical medicine. Rather than framing System 1 as an erroneous cognitive pathway responsible for cognitive biases, the theoretical framework of the GFQ recognizes System 1 as an evolved, expert heuristic system. When clinicians encounter subtle micro-patterns that do not conform to normative diagnostic criteria, System 1 generates an affective signal (the gut feeling) that serves as an interrupt mechanism, forcibly recruiting System 2 to review the case with heightened scrutiny.

Somatic Marker Hypothesis

The physiological grounding of gut feelings aligns with Antonio Damasiou2019s Somatic Marker Hypothesis. Damasio demonstrated that emotional and bioregulatory processes are integral to rational choice. When humans face complex, uncertain environments, the brain’s ventromedial prefrontal cortex associates past scenarios and their outcomes with bodily feelings (somatic markers). In general practice, repeated exposure to thousands of patient interactions creates a repository of somatic memories. When a GP encounters a patient with subtle or masked indicators of severe illness, somatic markers are reactivated, producing visceral sensationsu2014such as an accelerated heart rate, muscle tension, or an instinctive knot in the stomachu2014that precede conscious diagnostic verbalization.

Recognition-Primed Decision (RPD) Model

Gary Kleinu2019s Recognition-Primed Decision (RPD) Model of naturalistic decision-making also informs the GFQ. Under the RPD framework, operational experts (such as firefighters, intensive care nurses, and seasoned GPs) do not systematically weigh exhaustive lists of alternatives. Instead, they rapidly assess environmental cues, recognize a typical pattern, and instantly simulate a workable course of action. When pattern recognition detects an anomalyu2014an atypical omission or commission in the clinical narrativeu2014the RPD model predicts an immediate intuitive alarm response, precisely matching the construct captured by the GFQ.

Validity

The validation of the Gut Feelings Questionnaire has been documented through rigorous, multi-stage psychometric evaluations involving international primary care networks.

Content and Face Validity

Content validity was established through a comprehensive, pan-European Delphi consensus procedure conducted across six European countries: the Netherlands, Belgium, France, Germany, Spain, and the United Kingdom (Stolper et al., 2009, 2011). The consensus panels included academic GPs, practicing clinicians, and qualitative researchers. Over several consensus rounds, participants refined the linguistic definitions, psychological markers, and behavioral indicators of both the sense of alarm and sense of reassurance, achieving agreement rates exceeding 80% on core item definitions and operational constructs. Face validity was confirmed via cognitive debriefing interviews with general practitioners evaluating actual patient consultations, confirming that the questionnaire accurately reflects real-world clinical experience.

Construct and Discriminant Validity

Construct validity has been corroborated in observational studies comparing GPs’ intuitive ratings with subsequent clinical courses. A pivotal validation study by Stolper et al. (2013) assessed the psychometric properties of the GFQ across 27 general practices involving hundreds of consultations. Construct validity was supported by demonstrating that the Sense of Alarm and Sense of Reassurance represent distinct, negatively correlated constructs rather than opposing poles of a single unidimensional continuum. Clinicians rarely experience high levels of both sensations simultaneously, confirming distinct psychometric boundaries. Furthermore, discriminant validity was demonstrated by testing the scale against generic measures of physician anxiety and clinical intolerance of uncertainty; the GFQ correlated weakly with generalized trait anxiety, indicating that it measures a context-specific diagnostic cognitive response rather than physician-specific neurosis.

Predictive and Criterion Validity

The predictive validity of the GFQ has been demonstrated across several primary care domains, particularly in pediatric acute illnesses and suspected oncology:

• Pediatric Serious Infections: In prospective cohort studies evaluating febrile children in primary care (e.g., Van den Bruel et al., 2012), the presence of a GP’s gut feeling that “something is wrong” exhibited high sensitivity and specificity for identifying serious bacterial infections (including pneumonia, sepsis, and meningitis). The positive predictive value of the sense of alarm was found to significantly increase the post-test probability of severe disease, independent of traditional clinical symptoms and fever height.
• Cancer Diagnosis: Studies investigating early cancer presentations showed that the GFQ’s sense of alarm is an independent predictor of subsequent malignancy, frequently identifying patients needing referral before they satisfy official guideline criteria for urgent investigation.

Reliability

Psychometric evaluations of the Gut Feelings Questionnaire have yielded consistent evidence regarding its internal consistency and reproducibility across European primary care settings.

Internal Consistency

Internal consistency for the instrument’s subscales has been examined using Cronbachu2019s alpha. In the initial validation study of the Dutch GFQ (Stolper et al., 2013), the Sense of Alarm subscale demonstrated a Cronbachu2019s alpha of .74 to .82 across diverse consultation types, indicating strong internal consistency without excessive item redundancy. The Sense of Reassurance subscale similarly demonstrated satisfactory reliability, with alpha coefficients consistently observed between .68 and .78. In multinational translation and cross-cultural validation studies (including French, German, and Polish cohorts), the internal consistency estimates for the consolidated Sense of Alarm items remained robust, regularly exceeding the accepted psychometric threshold of .70.

Test-Retest Reliability and Stability

Evaluating traditional test-retest reliability presents conceptual challenges for consultation-specific measurement instruments, as a patient’s clinical situation evolves dynamically over time. However, reliability assessments using standardized clinical video vignettes and written case simulations have established satisfactory stability. When general practitioners were presented with identical, complex patient scenarios at two- to four-week intervals, inter-temporal concordance for the presence of a sense of alarm remained high, with intra-class correlation coefficients (ICC) ranging between .72 and .84. Inter-rater reliability across distinct clinicians evaluating the same standardized patient cases showed moderate-to-high agreement (Cohen’s kappa ranging from .55 to .71), demonstrating that while individual cognitive thresholds vary, the instrument captures consistent clinical patterns across observers.

Factor Analysis

The structural dimensionality of the Gut Feelings Questionnaire has been evaluated using both Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA).

Exploratory Factor Analysis (EFA)

During the initial psychometric derivation by Stolper and colleagues, EFA using principal axis factoring with oblimin (oblique) rotation was conducted on items reflecting intuitive diagnostic reasoning. The scree plot and Kaiser criterion (eigenvalues > 1.0) consistently pointed to a stable two-factor solution, which accounted for approximately 52% to 61% of the total variance across datasets:

• Factor 1: Sense of Alarm. Items measuring clinical concern, unexplained unease, the perceived need for urgent diagnostic action, and somatic tension loaded heavily onto this factor (factor loadings ranging from .62 to .86).
• Factor 2: Sense of Reassurance. Items reflecting diagnostic confidence, perceived stability of the patient, alignment with familiar benign illness patterns, and the appropriateness of watchful waiting loaded onto this factor (factor loadings ranging from .58 to .81).

Cross-loadings between the two factors were consistently low (typically < .25), demonstrating the distinct psychometric nature of the two constructs.

Confirmatory Factor Analysis (CFA)

Subsequent validation studies tested alternative structural models, contrasting a single-factor unidimensional model against a two-factor correlated model and a two-factor orthogonal model. Confirmatory factor analysis demonstrated that the two-factor correlated model exhibited superior fit indices compared to any unidimensional configuration:

• Chi-Square / Degrees of Freedom Ratio ($\chi^2/df$): Values consistently fell below 2.5, indicating good model parsimony.
• Root Mean Square Error of Approximation (RMSEA): Reported between .042 and .058, well below the conservative .06 threshold for excellent fit.
• Comparative Fit Index (CFI): Reached values between .94 and .97.
• Tucker-Lewis Index (TLI): Consistently exceeded .93.

These findings confirm that the Sense of Alarm and Sense of Reassurance are related yet structurally independent dimensions of intuitive diagnostic appraisal.

Instrument / Measurement Tool

The Gut Feelings Questionnaire is a standardized, self-administered clinician-rated instrument structured for rapid completion immediately following a patient consultation.

• Instrument Type: Clinician-reported outcome measure / diagnostic cognitive assessment tool.
• Target Population: General practitioners, family physicians, primary care residents, and pediatric primary care providers.
• Administration Time: Approximately 1 to 2 minutes per clinical encounter.
• Structural Composition:
  • Screening Questions: Dichotomous or categorical items assessing whether a Sense of Alarm, a Sense of Reassurance, or neither sensation was present during the consultation.
  • Dimensional Subscales: Detailed items exploring the components, determinants, and intensity of the respective sensation.
  • Action/Management Items: Items recording the subsequent clinical interventions triggered by the intuitive sensation (e.g., watchful waiting, laboratory testing, emergency referral).
• Response Formats:
  • Categorical selection: Present, Not Present, or Not Applicable.
  • Likert-type scales: 5-point or 6-point agreement/intensity scales ranging from 1 (Strongly Disagree / Not at all) to 5 or 6 (Strongly Agree / Very Strong).
• Scoring Principles:
  • Subscale scores for Sense of Alarm and Sense of Reassurance are calculated by summing or averaging item responses within their respective dimensions.
  • High scores on the Sense of Alarm dimension indicate heightened diagnostic unease and the need to reassess the diagnostic workup.
  • High scores on the Sense of Reassurance dimension indicate strong clinical confidence in a benign, self-limiting course, supporting a watchful waiting strategy.

Permissions & Fee and Test Year

The core developmental and validation work for the Gut Feelings Questionnaire was published in 2013 (Stolper et al., 2013). The instrument was generated through research funded by academic institutions and public health research organizations in the Netherlands and Belgium (including Maastricht University and the University of Antwerp).

The questionnaire is generally accessible for non-commercial academic research, medical education, and quality improvement initiatives in healthcare. Clinicians and researchers wishing to utilize, translate, or adapt the Gut Feelings Questionnaire in clinical trials or systematic studies are advised to contact the corresponding author, Dr. C. Erik Stolper, or the Department of Family Medicine at Maastricht University to obtain the official manual, validated language translations, and formal permission. Commercial applications, integration into proprietary electronic health record (EHR) systems, or copyrighted clinical decision support algorithms may require licensing agreements.

References

• Damasio, A. R. (1994). Descartes’ error: Emotion, reason, and the human brain. G.P. Putnam’s Sons.
• Evans, J. S. B., & Stanovich, K. E. (2013). Dual-process theories of higher cognition: Advancing the debate. Perspectives on Psychological Science, 8(3), 223–241. https://doi.org/10.1177/1745691612460685
• Kahneman, D. (2011). Thinking, fast and slow. Farrar, Straus and Giroux.
• Klein, G. (1998). Sources of power: How people make decisions. MIT Press.
• Stolper, C. F., van de Wiel, M. W., de Bont, M. A., Ratcliffe, M., Dinant, G. J., & Van Royen, P. (2009). Gut feelings in general practice: A European Delphi study. European Journal of General Practice, 15(4), 211–216. https://doi.org/10.3109/13814780903433696
• Stolper, C. F., van de Wiel, M. W., Shenxian, Z., Rottier, J. D., van Bokhoven, M. A., Van Royen, P., & Dinant, G. J. (2011). Consensus on gut feelings in general practice in six European countries: A Delphi study. BMJ Open, 1(2), e000444. https://doi.org/10.1136/bmjopen-2011-000444
• Stolper, C. F., Van Royen, P., Dinant, G. J., & van de Wiel, M. W. (2013). The gut feelings questionnaire: Development and validation of an instrument to assess gut feelings in general practice. BMC Family Practice, 14, Article 175. https://doi.org/10.1186/1471-2296-14-175
• Van den Bruel, A., Thompson, M., Buntinx, F., & Mant, D. (2012). Clinicians’ ‘gut feeling’ about serious infections in children: Systematic review and meta-analysis of diagnostic accuracy. BMJ, 345, e6144. https://doi.org/10.1136/bmj.e6144

Items of the Scale