Interpretive collaborative review: enabling multi-perspectival dialogues to generate collaborative assignments of relevance to information resources in a dedicated problem domain
Notice bibliographique
Résumé
Interpretive Collaborative Review (ICR) is a process designed to assemble electronically accessible research papers and other forms of information into collaboratively interpreted guides to information artefacts relevant to particular problems. The purpose of ICR is to enable collective understanding of a selected problem area that can be developed and represented by evaluating (reviewing) selected artefacts through a collaborative deliberation process. ICR has been conceptually formalized as an online environment enabling collaborative evaluation of relevancy relationships articulated in the triad of: 1) specific problems (topic), 2) diverse stakeholders and reviewer perspectives (context), and 3) particular settings where the problem matters (task). We define relevance as a cognitive recognition of proximal meaning relationships among the triad nodes of topic, task, and context. Three necessary dimensions of relevance relationships are proposed: 1) precedence, 2) validity, and 3) maturity. Based on experience with other forms of collaborative knowledge construction such as structured dialogue and cooperative learning, we conceptualized the ICR process as encompassing three phases: 1) discovery, promoting initial interpretations and definition, 2) deliberation, promoting emerging understanding and acceptance of degrees of interpretation within the group and 3) dissemination, promoting summation, validation, and distribution or publication of conclusions. The ICR method starts by recruiting a community of reviewers with necessarily diverse perspectives who agree to collaborate in identifying and evaluating information artefacts that can inform knowledge construction centered on a problem of common interest. A discovery phase allows reviewers to declare perspectives that are further delimited and explored collaboratively through the use of group dialogue around challenge questions. This is followed by a deliberative phase that facilitates collaborative dialogue aimed at developing a shared understanding of available information artefacts and their significance and of how those sources are relevant to the problem context. A final dissemination phase involves recording and publishing the knowledge synthesis and innovation that emerged from this collaborative dialogical process to affect knowledge transfer. Alignment of perspectives is promoted through collaborative generation of an aggregated report that describes the perceived relevancy relationships for each knowledge artefact evaluated in the review collection. While useful by itself, this report also serves as the raw material for a new form of scholarly publication, the 3D-Review, where relevancy relationships are used to guide suggested actions that could be taken with respect to advancing knowledge of the problem and options for addressing it. Both reports and reviews are indexable and electronically accessible, allowing other communities or individuals to find, retrieve, and act upon the new knowledge associated with the reports and reviews. This process of rigorous and purposeful deliberation enabled through online support of honest dialogue has the potential to develop into a new form of scholarly activity that should be useful in integrative scholarship.
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction machine sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Le volet Gemma est une étiquette directe du modèle pour chaque travail de la base, lue sur la notice réduite au titre. Le volet Codex est un classifieur appris des 10 348 étiquettes directes de Codex et calibré sur les taux pondérés de l'échantillon; les champs sans appui suffisant ne portent aucun appel Codex. Le mode candidate est l'union des deux volets; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont pas des étiquettes humaines.
Scores du classifieur distillé par catégorie (deux têtes)
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,064 | 0,134 |
| Méta-épidémiologie (sens strict) | 0,002 | 0,001 |
| Méta-épidémiologie (sens large) | 0,001 | 0,002 |
| Bibliométrie | 0,006 | 0,003 |
| Études des sciences et des technologies | 0,005 | 0,009 |
| Communication savante | 0,016 | 0,013 |
| Science ouverte | 0,005 | 0,021 |
| Intégrité de la recherche | 0,004 | 0,003 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,008 | 0,002 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; un appel candidat d’une seule source (Gemma direct ou Codex distillé), pas un consensus.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».