Patient‐ and community‐centered approaches as the cornerstone of health services evaluation in the 21st century
Bibliographic record
Abstract
This year (2022), the conference of the Canadian Evaluation Society centred on ‘providing a safe and reflective space’ to explore diversity of evaluative approaches and methods within the evaluation community. Gathered in Winnipeg (Canada), evaluation scholars, students, practitioners, and experts addressed uncomfortable topics, such as the so-called ‘neutrality’ of evaluation and evaluators—acknowledging that the dominance of Western-centred epistemologies,1 theories, axioms, and ways of doing represents a major limitation of the current evaluative world. They also discussed the true meaning of collaborative evaluation, inspired by Nan Wehipeihana’s vision for Indigenous evaluation, that is, from evaluation ‘for’ or ‘with’, to evaluation ‘by’ and ‘as’ through Indigenous self-determination.2 Applying this long-overdue lens to health services involves championing communities’ and patients’ involvement as legitimate experts and co-producers of evaluation processes. This is the most promising avenue for delivering meaningful and relevant health services evaluation. As we stated in the original call for paper for this special issue, communities and patients push us, evaluation researchers and practitioners, to rethink the mainstream determinants of performant health services, for example, by recentering on respectfulness, trustworthiness and cultural humility. This involves going beyond the canons of traditional scientific research, while safeguarding principles of confirmability and dependability (e.g., through the provision of accountable, thick descriptions of each research stage, from initial stages to reporting of findings).3 In the field of health services research, the complementarity of analytical angles, particularly between researchers and the targeted communities or populations, is an essential principle.4 This special issue offers a collection of 16 insightful papers, including short communications, evidence-informed opinion pieces about the future of health services evaluation, review articles, and original research articles. Many of these papers embrace theoretical perspectives that revisit the evaluation notion, by suggesting innovative ways to look at evaluation through this recentering on patients and communities. In tune with our inclusive purpose, our special issue also features a geographically diverse range of authorship—with authors affiliated with organisations from across four continents and representing 12 countries in total. A first category of papers embraces the need to do research differently, by acknowledging the dominant scientific community’s Western biases, and by taking actions to shift epistemic power towards patients and communities, that is, involving them as co-producers of evaluative knowledge to deliver effective participatory evaluation. Our first category of papers thus offers powerful views about securing community ownership in health services evaluation,6 ensuring the systematic and meaningful inclusion of socially-excluded and/or historically-oppressed patients and communities,6 engaging in culturally-reflective and responsive evaluation,7 and decolonising realist evaluation.8 A second category of papers, looks at patient- and community-centred care and evaluative knowledge coproduction through the eyes of the providers, that is, health frontline workers and/or health decision-makers. For instance, Becerril-Montekio et al. offer a useful scoping review of terminologies referring to research-practice collaborations.9 The authors emphasise diverse tools of integrated knowledge translation that enable for such coproduction processes. In the Canadian context, Wood and colleagues developed a conceptual framework for describing and evaluating socially accountable health professional education.10 Couturier et al. examine patient-centred care from the providers’ side within health facilities in six provinces of Indonesia.11 Sepp et al. assess, from the perspective of community pharmacists, the extent to which person-centered care principles are included in Estonia's Community Pharmacy Services Quality Guidelines.12 Based on in-depth, repeated interviews with Australian rural physicians, O'Sullivan highlights several innovations in physicians' practice to better match patients' needs in the context of COVID-19.13 Also featuring the pandemic context, Zafra-Tanaka and colleagues investigate health care workers adaptations for managing type 1-diabetes patients in Peru.14 These papers also highlighted some significant positive lessons on innovation and resilience of health services. These papers add to the bulk of literature assessing the consequences of COVID-19 and providing suggestions on how to prepare better for the next health crises. Yet, given that there have been many articles in the context of the pandemic, there is still much work to be done to better describe how they are formulated so that their content is as evidence-based as possible and rigorously collected and analysed. A third category of papers comprises original research findings that review, and/or test innovative patient-centred frameworks for analysis and/or measurement of diverse health services, with several papers centring on health systems performance determinants as a whole and directly involving communities or patients in identifying and analysing these.15, 16 Other papers in this category focused on specific determinants, namely, responsiveness,17 receptiveness,18 accessibility,19 and care friendliness for adolescent patients.20 The experimentation of these measurement instruments provides invaluable information that can inform patient-centered health care standards. A caveat or limitation associated with these new measurement tools and assessment frameworks for specific determinants often involve the absence of cross-validation of the key components (performance concepts and analytical dimensions, question formulation, scales, etc.) by health service users themselves. We invite authors to engage more often in such participatory exercises, especially through going beyond the mere ‘consultative’ process for producing these new measurements and frameworks. Another key takeaway message for the current special issue is that the context of the COVID-19 pandemic made it difficult to do patient- and/or community-centred health services evaluation, mainly because of physical distancing and other disease prevention measures. These surely precluded the development of many patient- and community-centred innovations. Indeed, doing evaluative research with these patient, user, or practitioner communities often require trust building through close, regular contacts in situ. In fact, none of the authors were able to collect empirical data for evaluating health services with service users in 2020 or 2021. In this regard, our special issue offers yet another demonstration that the pandemic significantly reduced the participation of health service users in research.21, 22 In a nutshell, the present special issue consecrates the paradigm of patients- and community-centred research as the cornerstone of the new era of participatory health services evaluation globally, regionally, nationally, and locally—and at multiple scales of health systems. We strongly invite the health services research and evaluation community to embrace this paradigm to produce relevant, valid, community-endorsed health services research and evaluation findings, including new measurement tools and new ways of thinking certain determinants of health service performance. The authors declare no conflict of interest.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.353 | 0.190 |
| Meta-epidemiology (narrow) | 0.002 | 0.001 |
| Meta-epidemiology (broad) | 0.003 | 0.002 |
| Bibliometrics | 0.008 | 0.007 |
| Science and technology studies | 0.014 | 0.070 |
| Scholarly communication | 0.041 | 0.029 |
| Open science | 0.007 | 0.028 |
| Research integrity | 0.016 | 0.032 |
| Insufficient payload (model declined to judge) | 0.007 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".