MétaCan
Menu
Retour à la cohorte
Enregistrement W2903691445 · doi:10.1111/medu.13778

Tensions that define the State of our Science in 2019

2018· editorial· en· W2903691445 sur OpenAlexaff
Kevin W. Eva

Notice bibliographique

RevueMedical Education · 2018
Typeeditorial
Langueen
DomaineMedicine
ThématiqueInnovations in Medical Education
Établissements canadiensUniversity of British Columbia
Organismes subventionnairesnon disponible
Mots-clésCynicismMistakeNothingSkepticismEnthusiasmCriticismConversationEpistemologySociologyPolitical sciencePublic relationsPsychologyLawSocial psychologyPoliticsPhilosophy

Résumé

récupéré en direct d'OpenAlex

“That's just the latest fad” - someone at every education conference ever “There has been nothing new for over 30 years” - an unfortunately curmudgeonly senior statesman at my first education conference As I imagine ways to introduce the theme of this year's State of the Science issue, I find myself wanting to cover ground that has already been trod in this space.1 I risk repetitiveness, however, because I continue to be reminded of the duelling banjos that seem present in every conversation about education research and innovation: contagious enthusiasm and dampening criticism. Used carefully, the caution represented by the quotes above indicates an appropriate and rational scepticism that should form the foundation for any truly scholarly enterprise. Used reflexively, they represent a problematic cynicism that prevents generative discussion from taking place regarding the contextually bound strengths and weaknesses of educational strategy. Why might such cynicism arise? For one thing, the longer one has been in the field the more ‘solutions’ one will have seen come and go and the more frustrated one might become by the field continuing to grapple with the same issues. Problems that have been recognised for decades continue to exist, allowing negativity to seep in from many directions and making it easy to mistake long-term and ongoing struggle for lack of progress.2 Further, it is easy to lose sight of the fact that not everyone shares the same perspective or priorities. As a result, ‘solutions’ can always be criticised for not addressing every aspect of multifaceted problems by not prioritising ‘the right’ aspect relative to one's own perspective (and can easily harken back to other things that failed for the same reasons). I would argue that the very fact we continue to struggle with long-term problems is by itself an indication that the field is evolving, given that no field or discipline dries up as quickly as those that stop generating new and useful ideas.1 Counter-intuitively, we continue to make progress by sensibly grappling with problems that may be unsolvable in any universal sense. With countless perspectives being brought to bear on any particular issue, there is always an opportunity to develop new understanding by identifying new holes that open whenever we attempt to patch particular leaks. That is not a particularly comfortable position for those who desire ‘the’ answer. However, as the field has matured and come to recognise the value that a variety of perspectives has to offer, many have begun to recognise complexity and turned a lens inward to shine light on the underlying reasons why many of the problems with which we grapple do seem unsolvable. To use an increasingly popular enactment of that notion, such problems are ‘wicked’ in that they resist resolution because there are many complex interdependencies that cause each effort to solve one aspect of the problem to create or reveal other problems.3, 4 This can create a series of tensions as different priorities yield different ‘solutions’. It is the existence (and perhaps inevitability) of the tensions that wicked problems create that this year's State of the Science issue was constructed to highlight. When the deputy editors brainstormed topics that warranted a deliberate examination of where the field stands in 2019, it became apparent that many suggestions, either alone or in combination, highlighted tensions that seem omnipresent in our field and are unlikely to ever simply go away. By ‘tensions’ I mean pressures that contradict each other in manners that can make important issues unresolvable or at least lead inevitably to conflicting yet equally valuable opinions/priorities. That is, they are competing perspectives that aren't necessarily right or wrong, but need always to be balanced in one way or another.5 As Moroz points out in his commentary, there are a variety of ways in which we respond to tension, some of which lead us around in circles, and some of which hold the potential to offer new insights by offering a change of perspective or re-framing of the problem being considered.6 The ‘wickedity’ of our problems, after all, need not disempower efforts to engage in quality improvement. Rather, wickedity reinforces the requirement that we shift focus away from trying to prove any one solution correct towards scholarship that seeks to better understand the problem.7 That enables local efforts to take into account broader insights regarding when, where and how different interventions might be applied most effectively. This is not an argument for prioritising theory over practice, but is instead the logic behind continuing the movement towards collectively addressing how we might better anticipate and reflect upon the unintended consequences that will arise with any practical intervention. Similarly, the purpose of placing tensions at the centre of our 2019 State of the Science discussion is not to resolve the tension by weighing the value of competing arguments. Rather, it is to offer explicit reflection on tensions that might be used more effectively if more clearly elaborated. To that end, the editors curated a series of articles looking at tensions in our field that address educational programming (e.g. the tension between standardisation and contextualisation8), learning practices (e.g. the tension in presenting oneself as both credible and vulnerable9) and assessment issues (e.g. the tension between focusing on what we know we can measure and what we think we should measure10), as well as medical education research itself.11 Our hope in doing so is that the efforts made by each set of authors (and their peer reviewers) help to strengthen the utility inherent in each of the factors responsible for creating tension and move us some degree beyond committing the error Einstein warned against of attempting to ‘solve our problems with the same thinking we used when we created them’.

Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.

Comment cette classification a été obtenuedéplier

Prédiction machine sur la base complète

Imitation des enseignants

Ni prévalence calibrée, ni vérité terrain. Validation humaine à venir. Le volet Gemma est une étiquette directe du modèle pour chaque travail de la base, lue sur la notice réduite au titre. Le volet Codex est un classifieur appris des 10 348 étiquettes directes de Codex et calibré sur les taux pondérés de l'échantillon; les champs sans appui suffisant ne portent aucun appel Codex. Le mode candidate est l'union des deux volets; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont pas des étiquettes humaines.

score de la tête « metaresearch » (Codex)0,030
score de la tête « metaresearch » (Gemma)0,040
Version: metacan-v3-hybrid-931329e0061cStatut de validation: machine_predicted_unvalidated
Catégories candidatesaucune
Catégories consensuellesaucune
DomaineSignal candidat: aucune · Signal consensuel: aucune
Devis d'étudeSignal candidat: Sans objet · Signal consensuel: aucune
GenreSignal candidat: Éditorial · Signal consensuel: aucune
Score de désaccord entre enseignants0,033
Score d'incertitude au seuil0,157

Scores du classifieur distillé par catégorie (deux têtes)

CatégorieCodexGemma
Métarecherche0,0300,040
Méta-épidémiologie (sens strict)0,0000,001
Méta-épidémiologie (sens large)0,0010,001
Bibliométrie0,0030,003
Études des sciences et des technologies0,0220,063
Communication savante0,0330,028
Science ouverte0,0020,020
Intégrité de la recherche0,0110,022
Charge utile insuffisante (le modèle a refusé de juger)0,0080,002

Scores machine (provisoires)

Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.

Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.

Tête enseignante Opus0,014
Tête enseignante GPT0,381
Écart entre enseignants0,367 · la distance entre les deux têtes enseignantes sur ce seul travail
Statut de validationscore_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découle

Classification

machine, non validée

Prédiction automatique; un appel candidat d’une seule source (Gemma direct ou Codex distillé), pas un consensus.

Les modèles n’ont appliqué aucune catégorie : rien dans la taxonomie ne correspondait à ce travail.
Devis d'étudeSans objet
Domainenon disponible
GenreÉditorial

Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».

En bref

Citations6
Publié2018
Routes d'admission1
Résumé présentoui

Explorer davantage

Même revueMedical EducationMême sujetInnovations in Medical EducationTravaux en français237 207