Assessing the quality of the OPQ’s Guidelines for the Evaluation of Dyslexia in Children using the Appraisal of Guidelines for Research and Evaluation (AGREE) II: A brief report.
Notice bibliographique
Résumé
Children with dyslexia have difficulties processing language in the areas of reading, writing, and spelling (Lyon, Shaywitz, & Shaywitz, 2003). The Diagnostic and Statistical Manual of Mental Disorders (5th ed.; American Psychiatric Association, 2013) classifies dyslexia as a specific learning disability and considers it to be a type of neurodevelopmental disorder. The Diagnostic and Statistical Manual of Mental Disorders, fifth edition, reports that the prevalence of dyslexia in school-age children is between 3% and 5%, whereas other studies found the prevalence to be between 5% and 15% (Daniel et al., 2006). It is estimated that 80-90% of learning difficulties present themselves in the school system (Leach, Scarborough, & Rescorla, 2003; Lerner, 1989; Lyon et al., 2001). Psychologists in both school and clinical settings may benefit from high-quality professional practice guidelines because they are expected to provide scientifically based recommendations to guide service delivery.The Quebec Order of Psychologists (OPQ), a prolific producer of practice guidelines, published the Guidelines for the evaluation of dyslexia in children (Lignes directrices pour l'evaluation de la dyslexie chez les enfants) in 2014. The production of this guideline began in 2009 with the participation of multiple experts. This 48-page document provides background information on dyslexia and describes so-called best practices for the evaluation of the condition, including the administration of tests. The guideline's stated objectives are to do the following: (a) to encourage rigorous methods that reflect the most up-to-date research; (b) to propose a standardized methodology based on diagnostic consensus; and (c) to identify the specific needs of children affected by dyslexia for support and accommodation (Ordre des psychologues du Quebec [OPQ], 2014).Although such objectives are both important and laudable, the availability of practice guidelines alone does not automatically lead to improved practices or health outcomes (Bergman, 1999; Cabana et al., 1999; Sackett, Rosenberg, Gray, Haynes, & Richardson, 1996; Ward & Grieco, 1996). The potential benefit of a guideline is only as good as the quality of the guideline itself (Burgers, Cluzeau, Hanna, Hunt, & Grol, 2003; Gordon & Cooper, 2010), and appropriate methodologies and rigorous strategies in the guideline development process are important for the successful dissemination and implementation of the clinical recommendations contained in the guideline (Alonso-Coello et al., 2010; Ansari & Rashidian, 2012; Blozik et al., 2012; Cahill & Heyland, 2010; Davis & Taylor-Vaisey, 1997; Grol, 2001; Norris, Holmer, Ogden, & Burda, 2011; Steinert, Richter, & Bergk, 2010). Unfortunately, in recent years, there has been a large volume of guidelines published in which the methodologies used to design the guidelines were inadequately described within the guideline or in related documents made available to professionals and service users (e.g., Rosenfeld, Shiffman, & Robertson, 2013; Stamoulos, Reyes, Trepanier, & Drapeau, 2014). For example, a description of the methods used to gather evidence and formulate recommendations, and whether the guideline was externally reviewed by experts prior to its publication, are considered minimal standards for the proLyane duction of quality guidelines (Brouwers et al., 2010; Burgers, Cluzeau, Hanna, Hunt, & Grol, 2003).The quality of practice guidelines has indeed been closely scrutinized over the past 15 years, especially in the United States and Europe, with reports of high variability in quality, many of which were cited as poor (Graham, Beardall, Carter, Tetroe, & Davies, 2003; Ruszczynski, Horvath, Dziechciarz, & Szajewska, 2016; Shaneyfelt, Mayo-Smith, & Rothwangl, 1999; Stamoulos, Reyes, Trepanier, & Drapeau, 2014). These studies raise concerns about the quality of the guidelines that are available to practitioners, about the value of the advice and recommendations they contain, and ultimately about the quality of the services received by patients and clients. …
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction machine sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Le volet Gemma est une étiquette directe du modèle pour chaque travail de la base, lue sur la notice réduite au titre. Le volet Codex est un classifieur appris des 10 348 étiquettes directes de Codex et calibré sur les taux pondérés de l'échantillon; les champs sans appui suffisant ne portent aucun appel Codex. Le mode candidate est l'union des deux volets; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont pas des étiquettes humaines.
Scores du classifieur distillé par catégorie (deux têtes)
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,129 | 0,229 |
| Méta-épidémiologie (sens strict) | 0,001 | 0,001 |
| Méta-épidémiologie (sens large) | 0,004 | 0,005 |
| Bibliométrie | 0,014 | 0,008 |
| Études des sciences et des technologies | 0,002 | 0,002 |
| Communication savante | 0,004 | 0,003 |
| Science ouverte | 0,003 | 0,005 |
| Intégrité de la recherche | 0,002 | 0,003 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,003 | 0,002 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; un appel candidat d’une seule source (Gemma direct ou Codex distillé), pas un consensus.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».