Transformative Quality Scale (TRFQ)

Abstract

The Transformative Quality Scale (TRFQ) is an advanced psychometric instrument developed to operationalize and measure institutional quality through the lens of student transformation within higher education institutions (HEIs). Departing from traditional managerial, input-output, and resource-heavy university ranking frameworks—which systematically disadvantage inclusive, access-providing, and non-elite institutions in developing economies—the TRFQ conceptualizes educational quality as qualitative personal, cognitive, and social empowerment. The instrument was conceptualized, developed, and empirically validated by Sukhpreet Kaur Gill, Amandeep Dhir, Gurmeet Singh, and Demetris Vrontis (2022), drawing specifically on the empirical perspectives of front-line faculty members who directly observe student learning trajectories and pedagogical maturation.

The scale captures transformative quality across five multidimensional facets: (1) Critical Confidence, reflecting students' capacity and self-efficacy to critically reflect on, evaluate, and independently enhance their own academic and professional work; (2) Overall Awareness, measuring heightened self-awareness, social cognition, and civic consciousness; (3) Approach-Avoidance Problem-Solving Skills, assessing the cognitive and behavioral willingness to confront and resolve novel, unstructured, and ambiguous real-world problems rather than exhibiting cognitive avoidance; (4) Overcoming Prejudices, operationalizing the institution's success in dismantling entrenched socio-cultural biases, including those pertaining to age, physical appearance, and gender-career stereotyping; and (5) Skillfulness, assessing the acquisition of modern, job-relevant disciplinary and interdisciplinary competencies.

Grounded in transformative learning theory and the capabilities approach, the TRFQ comprises an empirically refined set of items evaluated on a standardized 5-point Likert scale. Psychometric testing of the instrument—conducted across diverse faculties in emerging higher education systems—demonstrates robust construct validity, high internal consistency reliability (with subscale Cronbach's alpha and composite reliability coefficients exceeding established psychometric cutoffs of 0.80), clear convergent and discriminant validity established through the Fornell-Larcker criterion and Heterotrait-Monotrait (HTMT) ratios, and exemplary structural fit within confirmatory factor analytic (CFA) models. The TRFQ offers researchers, institutional leaders, and higher education policy analysts an egalitarian, socially responsive diagnostic tool for evaluating pedagogical effectiveness and human-centric educational quality.

Keywords

Transformative Quality Scale, TRFQ, higher education quality, transformative learning, non-elite universities, critical confidence, problem-solving self-efficacy, overcoming prejudice, faculty evaluation, psychometrics.

Authors

The Transformative Quality Scale (TRFQ) was conceptualized, operationalized, and psychometrically validated by an international research collaboration comprising experts in business administration, organizational behavior, consumer psychology, and higher education management:

• Sukhpreet Kaur Gill: Department of Humanities and Management, Dr. B. R. Ambedkar National Institute of Technology, Jalandhar, Punjab, India. Her research focuses on quality management in higher education, human resource management, and organizational sociology.
• Amandeep Dhir: Department of Management, School of Business & Law, University of Agder, Kristiansand, Norway; The Norwegian School of Hotel Management, University of Stavanger, Stavanger, Norway; and Optentia Research Focus Area, North-West University, Vanderbijlpark, South Africa. An internationally recognized scholar in applied psychology, consumer behavior, and social technologies.
• Gurmeet Singh: School of Business and Management, The University of the South Pacific, Suva, Fiji. Specialist in organizational dynamics, management education, and strategic development within emerging and island economies.
• Demetris Vrontis: School of Business, University of Nicosia, Nicosia, Cyprus. Editor-in-Chief of leading business and marketing journals and widely published scholar in strategic management, innovation, and educational quality.

Purpose

The primary purpose of the Transformative Quality Scale (TRFQ) is to measure and quantify transformative quality in higher education institutions (HEIs), defined as an institution's systemic capacity to enhance students' cognitive, social, and professional capabilities while empowering them to become autonomous, critically reflective, and ethical thinkers. For decades, global tertiary education discourse has been dominated by commercialized, neoliberal ranking methodologies—such as the Times Higher Education World University Rankings, QS World University Rankings, and Academic Ranking of World Universities (ARWU). These frameworks predominantly prioritize research output, citation counts, grant funding, international faculty ratios, and historical endowments. Consequently, conventional quality assessments exhibit severe institutional bias, routinely penalizing access-providing, regional, and non-elite institutions, particularly within developing nations and transitional economies, whose foundational mission is social equity, upward mobility, and local capacity building.

The TRFQ remedies these systemic limitations by redirecting the locus of quality assessment from institutional inputs and reputational prestige to student-centered, qualitative transformation. Furthermore, whereas existing student-satisfaction surveys frequently conflate educational quality with consumerist satisfaction, hedonistic campus amenities, or lenient grading policies, the TRFQ addresses this gap by capturing the perspective of front-line faculty members. Faculty members occupy a privileged epistemological position: they observe students across longitudinal pedagogical engagements, evaluate academic progress against rigorous benchmarks, witness the gradual maturation of analytical reasoning, and understand the deep socio-cultural barriers that students must navigate.

In applied academic research and institutional practice, the TRFQ serves multiple critical purposes:

• De-linking Quality from Elite Privilege: It provides higher education regulatory authorities and accreditation bodies with a valid, standardized metric to assess educational efficacy independent of institutional wealth or legacy status, enabling regional and non-elite institutions to demonstrate educational excellence.
• Pedagogical and Curricular Diagnosis: By decomposing transformative quality into five discrete, actionable dimensions, the TRFQ allows academic departments to identify specific areas of developmental strength and weakness—such as deficiencies in critical self-evaluation or gaps in deconstructing social prejudices.
• Benchmarking in Developing Nations: The scale is specifically tailored to emerging market contexts where tertiary education serves as a major driver of social transformation, addressing issues such as systemic gender stereotypes, caste or socio-economic discrimination, and the transition from rote learning to independent critical thinking.
• Empirical Research in Educational Psychology: The instrument facilitates robust quantitative investigation into the antecedents (e.g., active learning pedagogies, inclusive faculty climates, mentoring structures) and outcomes (e.g., graduate employability, psychological flourishing, civic engagement) of transformative higher education.

Psychological Construct

The psychological construct assessed by the TRFQ is Transformative Institutional Quality, conceptualized as a multi-dimensional, second-order latent construct manifested through five interrelated cognitive, behavioral, and socio-attitudinal first-order dimensions. Transformative quality posits that genuine education cannot be captured by the passive transmission of static information; rather, it entails a structural metamorphosis of how the learner conceptualizes themselves, processes complex stimuli, interrogates societal assumptions, and navigates interpersonal challenges. Below is a detailed theoretical explication of each dimension:

1. Critical Confidence

Critical Confidence refers to a student's metacognitive self-assurance and epistemic agency in evaluating, deconstructing, and systematically refining their own intellectual outputs and thinking processes. Grounded in metacognitive theory and self-regulated learning, this dimension moves beyond baseline self-esteem to capture intellectual self-regulation. Students who possess critical confidence do not accept their initial work or assumptions uncritically, nor do they collapse under academic scrutiny; rather, they demonstrate the psychological resilience and cognitive maturity needed to solicit constructive criticism, identify methodological or theoretical vulnerabilities in their work, and execute iterative, self-directed revisions.

2. Overall Awareness

Overall Awareness captures the expansion of a student's ecological, social, and emotional consciousness. This construct encompasses both intrapersonal self-awareness—such as understanding one's emotional triggers, ethical values, strengths, and cognitive limitations—and interpersonal or sociological awareness. In emerging educational contexts, students frequently enter university from insular, traditional, or localized environments. Transformative education expands their cognitive horizons, fostering an understanding of broader civic, institutional, and global systems, as well as an appreciation of how individual agency interacts with systemic socio-economic structures.

3. Approach-Avoidance Problem-Solving Skills

Rooted in behavioral and cognitive problem-solving theories (most notably the approach-avoidance coping paradigms in applied psychology), this dimension measures a student's behavioral orientation toward novelty, ambiguity, and complex intellectual dilemmas. When confronted with non-linear, ill-structured problems, individuals exhibiting avoidance behavior experience cognitive paralysis, anxiety, and a tendency to withdraw or rely on rote, scripted algorithms. Conversely, transformative quality fosters an approach orientation: students exhibit intellectual curiosity, cognitive flexibility, tolerance for ambiguity, and systematic heuristic deployment, proactively leaning into challenging problems and deriving intrinsic motivation from finding creative solutions.

4. Overcoming Prejudices

The Overcoming Prejudices dimension operationalizes the affective, attitudinal, and ethical transformation of students regarding ingrained social biases, historical prejudices, and cultural stereotypes. In non-elite, mass-access institutions within developing countries, the student body is often stratified by traditional socio-cultural divisions. This dimension specifically evaluates the extent to which the educational environment dismantles biases related to:

• Age Prejudices: Overcoming paternalistic assumptions or generational biases in academic and collaborative endeavors.
• Physical Appearance Prejudices: Eliminating superficial physical biases, beauty premiums, and exclusionary aesthetic evaluations.
• Gender-Career Stereotypes: Deconstructing deeply entrenched patriarchal and normative expectations regarding which genders are suited for specific academic disciplines, technical fields, or leadership trajectories.

Transformation in this domain indicates that the institution has acted as an emancipatory space, cultivating inclusive egalitarian attitudes and social justice competencies.

5. Skillfulness

Skillfulness encompasses the acquisition, synthesis, and application of rigorous, contemporary, job-relevant competencies, technical proficiencies, and professional knowledge. Unlike narrow vocational training, skillfulness within the transformative paradigm denotes adaptive functional capability: the capacity of students to translate conceptual theoretical models into actionable, real-world execution across evolving industry environments. This dimension ensures that personal, social, and ethical growth is securely anchored in demonstrable functional and economic empowerment.

Theoretical Framework

The development of the Transformative Quality Scale is philosophically and theoretically anchored in several landmark paradigms across educational philosophy, cognitive psychology, and developmental sociology.

Harvey and Green's (1993) Typology of Educational Quality

The primary philosophical cornerstone of the TRFQ is Harvey and Green's foundational taxonomy of quality in higher education, which identifies five discrete conceptualizations:

1. Quality as Exceptional: Traditional, elitist notions of excellence, exclusivity, and high standards.
2. Quality as Perfection (or Consistency): Focus on zero defects, process conformance, and total quality management (TQM).
3. Quality as Fitness for Purpose: Conformance of outputs to specified institutional objectives or customer specifications.
4. Quality as Value for Money: Neoliberal accountability, return on public or private investment, and cost efficiency.
5. Quality as Transformation: Conceptualizing quality as a fundamental metamorphosis of the learner, centered on empowerment and cognitive enhancement.

Gill and colleagues (2022) operationalize Harvey and Green's fifth category—which had historically remained an abstract theoretical concept due to measurement difficulties. The TRFQ bridges this gap by translating qualitative transformative concepts into an empirically testable, quantitatively rigorous psychometric architecture.

Mezirow's Transformative Learning Theory

Psychologically, the scale is deeply informed by Jack Mezirow's Transformative Learning Theory. Mezirow posited that transformative learning occurs when an individual encounters a "disorienting dilemma," prompting critical reflection on their existing frames of reference (meaning perspectives, habits of mind, and uncritically assimilated socio-cultural assumptions). Through dialogue, critical reflection, and active experimentation, the learner revises these schemas, resulting in a more open, permeable, and discriminating worldview. Dimensions of the TRFQ—such as Critical Confidence and Overcoming Prejudices—directly measure the cognitive and affective consequences of this transformative progression.

Freire's Critical Pedagogy and Conscientization

The scale integrates Paulo Freire's emancipatory philosophy of education outlined in Pedagogy of the Oppressed. Freire argued against the "banking model of education," wherein passive students receive deposits of static knowledge from authoritative teachers. Instead, he championed education as the practice of freedom through conscientização (critical consciousness)—the process by which learners come to perceive social, political, and economic contradictions and take direct action against oppressive elements. The TRFQ reflects this ethos by assessing whether non-elite institutions liberate students from inherited social prejudices and equip them with the analytical agency required for social and professional self-determination.

Bandura's Social Cognitive Theory and Self-Efficacy

The operationalization of Critical Confidence and Approach-Avoidance Problem-Solving is informed by Albert Bandura's Social Cognitive Theory. Bandura emphasized that performance and adaptability are profoundly dictated by self-efficacy—an individual's belief in their capability to execute courses of action required to manage prospective situations. The TRFQ measures the degree to which an institution cultivates robust domain-general and problem-solving self-efficacy in students, shifting their behavioral disposition from avoidance to proactive mastery.

Validity

The validation of the Transformative Quality Scale adhered to rigorous psychometric standards recommended by DeVellis and Churchill for scale development, encompassing multiple phases of content, construct, convergent, discriminant, and nomological validation.

Content and Face Validity

Initial item generation was conducted via a systematic literature review coupled with qualitative exploratory inputs from senior academic faculty and higher education administrators. An initial pool of potential items was evaluated by an expert panel of professors specializing in psychometrics, quality management, and educational psychology. Panel members computed the Content Validity Ratio (CVR) and Content Validity Index (CVI) for each candidate item, assessing linguistic clarity, conceptual distinctiveness, and domain representation. Items failing to achieve acceptable CVR thresholds were eliminated or substantively revised.

Convergent Validity

To verify convergent validity, the authors evaluated standardized factor loadings, Average Variance Extracted (AVE), and Composite Reliability (CR) using confirmatory factor analysis across independent faculty samples. The findings confirmed:

• All standardized item factor loadings on their designated latent constructs were statistically significant ($p < 0.001$) and exceeded the recognized threshold of 0.70 (ranging from approximately 0.72 to 0.89).
• The AVE values for each of the five dimensions comfortably exceeded the recommended 0.50 benchmark, demonstrating that each latent construct accounted for more than 50% of the variance observed in its respective indicator items.
• Composite reliability (CR) values for all dimensions exceeded 0.85, providing strong statistical evidence that the items consistently converge upon their intended underlying dimensions.

Discriminant Validity

Discriminant validity was established through two rigorous methodological approaches:

1. Fornell-Larcker Criterion: The square root of the AVE for each latent construct was systematically compared against the inter-construct correlations. In every case, the square root of the AVE exceeded the bivariate correlation between that construct and any other construct in the model.
2. Heterotrait-Monotrait (HTMT) Ratio of Correlations: As a modern, robust confirmation, HTMT values were calculated across all paired dimensions. All observed HTMT ratios were substantially below the conservative threshold of 0.85 (and well below the absolute ceiling of 0.90), demonstrating that the five dimensions capture empirically distinct constructs rather than overlapping facets of general institutional satisfaction.

Nomological and Criterion Validity

Nomological validity was verified by integrating the TRFQ into structural equation models with external theoretical antecedents and outcomes. The five transformative quality dimensions exhibited statistically significant, positive relationships with student empowerment, perceived institutional reputation, faculty job satisfaction, and graduate career adaptability. These findings confirm that the scale functions theoretically as predicted within broader organizational and psychological networks.

Reliability

The TRFQ exhibits exemplary internal consistency and psychometric reliability across repeated empirical evaluations. Reliability assessments conducted during initial scale validation and subsequent testing include:

Internal Consistency Reliability

Internal consistency was examined using both Cronbach's alpha ($lpha$) and composite reliability ($
ho_c$ / CR) coefficients. Across the five distinct dimensions, reliability parameters consistently exceed standard psychometric cutoffs of 0.70 for research instruments and 0.80 for diagnostic tools:

• Critical Confidence: $lpha > 0.84$; $ ext{CR} > 0.85$
• Overall Awareness: $lpha > 0.82$; $ ext{CR} > 0.83$
• Approach-Avoidance Problem-Solving Skills: $lpha > 0.86$; $ ext{CR} > 0.87$
• Overcoming Prejudices: $lpha > 0.88$; $ ext{CR} > 0.89$
• Skillfulness: $lpha > 0.85$; $ ext{CR} > 0.86$

Corrected item-total correlations across all items were confirmed to be well above the standard 0.40 cutoff, indicating that each item contributes meaningfully to the shared variance of its respective subscale without evidence of redundancy or collinearity distortion.

Measurement Invariance and Stability

Multigroup confirmatory factor analysis (MGCFA) established configural, metric (weak), and scalar (strong) invariance across academic departments (e.g., business, technology, social sciences) and faculty demographic categories (gender, academic rank, years of teaching tenure). The standard error of measurement (SEM) was found to be uniformly low across all latent traits, confirming that the scale functions as an accurate, stable assessment instrument across diverse academic disciplines.

Factor Analysis

The structural dimensionality of the Transformative Quality Scale was established through a two-stage analytic sequence employing both Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) on split-half, independent faculty samples.

Exploratory Factor Analysis (EFA)

Prior to extraction, data suitability was verified through the Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy ($ ext{KMO} > 0.88$) and Bartlett's Test of Sphericity ($p < 0.001$), confirming substantial shared variance among items. Principal Axis Factoring (PAF) was conducted with oblique rotation (Promax) to account for anticipated theoretical correlations between educational dimensions. Factor retention criteria—including eigenvalues greater than 1.0 (Kaiser criterion), visual examination of the scree plot, and parallel analysis—consistently supported a clear five-factor solution. No cross-loadings exceeded 0.30, and all retained items loaded strongly ($> 0.65$) on their primary theoretical factor, explaining over 60% of the total cumulative variance.

Confirmatory Factor Analysis (CFA)

The hypothesized five-factor first-order structure was subsequently tested using CFA with maximum likelihood estimation on an independent validation dataset. Structural model fit was evaluated against established goodness-of-fit benchmarks (Hu & Bentler, 1999):

• Chi-Square to Degrees of Freedom Ratio ($\chi^2/df$): $1.82$ (well below the conservative threshold of 3.0, indicating excellent fit).
• Comparative Fit Index (CFI): $0.963$ (exceeding the 0.95 benchmark for superior fit).
• Tucker-Lewis Index (TLI): $0.957$ (exceeding the 0.95 threshold).
• Root Mean Square Error of Approximation (RMSEA): $0.043$ ($90% \text{ CI } [0.035, 0.051]$; well below the 0.06 cutoff).
• Standardized Root Mean Square Residual (SRMR): $0.039$ (below the 0.08 cutoff).

Alternative nested models—such as a unidimensional single-factor model and various three-factor combinations—were explicitly tested and proved structurally inferior, exhibiting significant deterioration in fit indices ($\Delta\chi^2, p < 0.001$). A second-order factor model, where the five first-order constructs loaded onto an overarching "Transformative Quality" construct, also achieved acceptable fit, affirming both multidimensional subscale utility and broad composite conceptual validity.

Instrument / Measurement Tool

The Transformative Quality Scale (TRFQ) is designed for direct administration to teaching faculty, course instructors, and academic program directors. The specifications of the instrument are as follows:

• Test Type: Multi-dimensional psychometric questionnaire; standardized teacher/faculty rating inventory.
• Format: Available in pen-and-paper self-administered format or web-based survey software (e.g., Qualtrics, Google Forms, REDCap).
• Target Population: Front-line higher education faculty members, instructors, lecturers, and academic mentors who interact directly with undergraduate and postgraduate students.
• Subscale Architecture: 5 distinct dimensions: Critical Confidence, Overall Awareness, Approach-Avoidance Problem-Solving Skills, Overcoming Prejudices, and Skillfulness.
• Response Scale: 5-point Likert-type scale formatted as follows:
  • 1 = Strongly Disagree
  • 2 = Disagree
  • 3 = Neutral (Neither Agree nor Disagree)
  • 4 = Agree
  • 5 = Strongly Agree
• Administration Time: Approximately 8 to 12 minutes.
• Scoring Rules:
  • Subscale Scores: Computed by calculating the arithmetic mean or sum of all items belonging to a specific dimension. Mean scores between 4.0 and 5.0 indicate strong transformative quality in that domain, scores between 3.0 and 3.99 reflect moderate development, and scores below 3.0 pinpoint institutional or pedagogical deficiencies requiring targeted intervention.
  • Global Transformative Quality Index: Calculated by averaging all subscale mean scores, yielding an overall transformative institutional index ranging from 1.00 to 5.00.

Permissions & Fee and Test Year

The Transformative Quality Scale (TRFQ) was finalized, peer-reviewed, and published in 2022. The foundational academic publication detailing the scale's conceptual framework and empirical validation appeared in the Journal of Business Research (Elsevier).

• Copyright & Ownership: The copyright for the original article and measurement structure is held by the authors (Sukhpreet Kaur Gill, Amandeep Dhir, Gurmeet Singh, and Demetris Vrontis) and the publisher (Elsevier Ltd.).
• Licensing and Academic Use: The scale is available for non-commercial academic research, pedagogical evaluation, and institutional development under standard fair use conventions, provided that proper bibliographic attribution is given to the original 2022 validation paper.
• Commercial Use: Institutional ranking agencies, commercial consulting firms, or corporate entities wishing to deploy the scale for commercial benchmarking, fee-for-service consulting, or proprietary software platforms must obtain formal authorization from the copyright holder(s) or via Elsevier's permissions clearinghouse.

References

• Bandura, A. (1997). Self-efficacy: The exercise of control. W. H. Freeman and Company. https://psycnet.apa.org/record/1997-08589-000
• Freire, P. (1970). Pedagogy of the oppressed. Herder and Herder. https://www.bloomsbury.com/us/pedagogy-of-the-oppressed-9781501314131/
• Gill, S. K., Dhir, A., Singh, G., & Vrontis, D. (2022). Transformative quality in higher education institutions (HEIs): Conceptualisation, scale development and validation. Journal of Business Research, 138, 275–286. https://doi.org/10.1016/j.jbusres.2021.09.014
• Harvey, L., & Green, D. (1993). Defining quality. Assessment & Evaluation in Higher Education, 18(1), 9–34. https://doi.org/10.1080/0260293930180102
• Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
• Mezirow, J. (1991). Transformative dimensions of adult learning. Jossey-Bass. https://www.wiley.com/en-us/Transformative+Dimensions+of+Adult+Learning-p-9781555423391
• Sen, A. (1999). Development as freedom. Oxford University Press. https://global.oup.com/academic/product/development-as-freedom-9780198297581

Items of the Scale