Elevating the quality of disability and rehabilitation research
Bibliographic record
Abstract
This article was previously published in Archives of Physical Medicine and Rehabilitation 2014; 95:415–417, and reproduced here with journal stylistic modifications and appropriate updates to online information citations under the creative commons license CC BY-NC-ND 4.0 (http://creativecommons.org/licenses/by-nc-nd/4.0/deed.en_US). With the remarkable growth of disability-related and rehabilitation-related research in the last decade, it is imperative that we support the highest quality research possible. With cuts in research funding, rehabilitation research is now under a microscope like never before, and it is critical that we put our best foot forward. To ensure the quality of the disability and rehabilitation research that is published, the 28 rehabilitation journals simultaneously publishing this editorial (see acknowledgments) have agreed to take a more aggressive stance on the use of reporting guidelines*. Research reports must contain sufficient information to allow readers to understand how a study was designed and conducted, including variable definitions, instruments and other measures, and analytical techniques (Moher et al., 2008). For review articles, systematic or narrative, readers should be informed of the rationale and details behind the literature search strategy. Too often, articles fail to include their standard for inclusion and their criteria for evaluating quality of the studies (Simera et al., 2008). As stated by Doug Altman, co-originator of the Consolidated Standards of Reporting Trials (CONSORT) statement and head of the Centre for Statistics in Medicine at Oxford University, ‘Good reporting is not an optional extra: it is an essential component of good research…we all share this obligation and responsibility.’ (Altman, 2008). What are reporting guidelines? Reporting guidelines are documents that assist authors in reporting research methods and findings. They are typically presented as checklists or flow diagrams that lay out the core reporting criteria required to give a clear account of a study’s methods and results. The intent is not just that the authors complete a specific reporting checklist but that they ensure that their articles contain key elements. Reporting guidelines should not be seen as an administrative burden; rather, they are a template on the basis of which authors can construct their articles more completely. Reporting guidelines have been developed for almost every study design. More information on the design, use, and array of reporting guidelines can be found on the website for the Enhancing the Quality and Transparency of Health Research (EQUATOR) network (EQUATOR, 2013), an important organization that promotes improvements in the accuracy and comprehensiveness of reporting. Examples include the following: CONSORT for randomized controlled trials (http://www.consort-statement.org); Strengthening the Reporting of Observational studies in Epidemiology (STROBE) for observational studies (http://strobe-statement.org/); Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) for systematic reviews and meta-analyses (http://www.prisma-statement.org/); Standards for the Reporting of Diagnostic accuracy studies (STARD) for studies on diagnostic accuracy (http://www.stard-statement.org/); and Case Reports (CARE) for case reports (http://www.care-statement.org/). There is accumulating evidence that the use of reporting guidelines improves the quality of research. Turner et al. (2012) established that the use of the CONSORT statement improved the completeness of reporting in randomized controlled trials. Diagnostic accuracy studies appeared to show improvements in reporting standards when the STARD guidelines were applied (Smidt et al., 2006). Early evidence also suggests that inclusion of reporting standards during peer review raises manuscript quality (Cobo et al., 2011). The International Committee of Medical Journal Editors now encourages all journals to monitor reporting standards and collect associated reporting guideline checklists in the process (International Committee of Medical Journal Editors, 2014). Further, the National Library of Medicine also now actively promotes the use of reporting guidelines (U.S. National Library of Medicine, 2013). How will reporting guidelines be integrated into manuscript flow? By 1 January 2015, all of the journals publishing this editorial will have worked through implementation, and the mandatory use of guidelines and checklists will be firmly in place. Because each journal has its unique system for managing submissions, there may be several ways by which these reporting requirements will be integrated into the manuscript flow. Some journals will make adherence to reporting criteria and associated checklists mandatory for all submissions. Other journals may require them only when the article is closer to acceptance for publication. In any case, the onus will be on the author not only to ensure the inclusion of the appropriate reporting criteria but also to document evidence of inclusion through the use of the reporting guideline checklists. Authors should consult the Instructions for Authors of participating journals for more information. We hope that simultaneous implementation of this new reporting requirement will send a strong message to all disability and rehabilitation researchers of the need to adhere to the highest standards when performing and disseminating research. Although we expect that there will be growing pains with this process, we hope that within a short period, researchers will begin to use these guidelines during the design phases of their research, thereby improving their methods. The potential benefits to the authors are obvious: articles are improved through superior reporting of a study’s design and methods and the usefulness of the article to the readers is enhanced. Reporting guidelines also allow for greater transparency in reporting how studies were conducted and can help, hopefully, during the peer review process to expose misleading or selective reporting. Reporting guidelines are an important tool to assist authors in the structural development of a manuscript, eventually allowing an article to realize its full potential. *Physical Therapy, The Journal of Orthopaedic & Sports Physical Therapy, The Journal of Physiotherapy, and The European Journal of Physical and Rehabilitation Medicine have already successfully required reporting guidelines, one for as many as 10 years. Acknowledgements As this issue went to press, the following Editors agreed to participate in the initiative to mandate reporting guidelines and publish this Position Statement in their respective journals. As a collective group, we encourage others to adopt these guidelines and welcome them to share this editorial with their readerships. Sharon A. Gutman, PhD, OTR (Editor-in-Chief), American Journal of Occupational Therapy; Walter R. Frontera, MD, PhD (Editor-in-Chief), American Journal of Physical Medicine and Rehabilitation; Leighton Chan, MD, MPH, and Allen W. Heinemann, PhD (Co-Editors-in-Chief), Archives of Physical Medicine and Rehabilitation; Helene J. Polatajko, PhD, OT(C) (Editor-in-Chief), Canadian Journal of Occupational Therapy; Derick T. Wade, MD (Editor-in-Chief), Clinical Rehabilitation; Suzanne McDermott, PhD, and Margaret A. Turk, MD (Co-Editors-in-Chief), Disability and Health Journal; Stefano Negrini, MD (Editor-in-Chief), European Journal of Physical and Rehabilitation Medicine; Steven Vogel, DO(Hon) (Editor-in-Chief), The International Journal of Osteopathic Medicine; Črt Marinček, MD, PhD (Editor-in-Chief), International Journal of Rehabilitation Research; M. Solomonow, PhD, MD(hon) (Editor-in-Chief), Journal of Electromyography & Kinesiology; Paolo Bonato, PhD (Editor-in-Chief), Journal of Neuro Engineering and Rehabilitation; Edelle [Edee] Field-Fote, PT, PhD (Editor-in-Chief), Journal of Neurologic Physical Therapy; Guy G. Simoneau, PhD, PT (Editor-in-Chief), Journal of Orthopaedic & Sports Physical Therapy (JOSPT); Mark Elkins, PhD, MHSc, BA, BPhty (Editor-in-Chief), Journal of Physiotherapy; Stacieann C. Yuhasz, PhD (Editor-in-Chief), Journal of Rehabilitation Research and Development; Bengt H. Sjölund, MD, DMSc (Editor-in-Chief), Journal of Rehabilitation Medicine; Carl G. Mattacola, PhD, ATC (Editor-in-Chief), Journal of Sport Rehabilitation; Ann Moore, PhD and Gwendolen Jull, PhD (Co-Editors-in-Chief), Manual Therapy; Randolph J. Nudo, PhD (Editor-in-Chief), Neurorehabilitation & Neural Repair; Kathleen Matuska, PhD, OTR/L (Editor-in-Chief), Occupational Therapy Journal of Research: Occupation, Participation, and Health; Ann F Van Sant, PT, PhD (Editor-in-Chief), Pediatric Physical Therapy; Greg Carter, MD (Consulting Editor), Physical Medicine and Rehabilitation Clinics of North America; Rebecca L. Craik, PT, PhD (Editor-in-Chief), Physical Therapy; Dina Brooks, PhD (Scientific Editor), Physiotherapy Canada; Stuart M. Weinstein, MD (Editor-in-Chief), PM&R; Elaine L. Miller, PhD, RN (Editor-in-Chief), Rehabilitation Nursing; Elliot J. Roth, MD (Editor-in-Chief), Topics in Stroke Rehabilitation; Dilşad Sindel, MD (Editor-in-Chief), Turkish Journal of Physical Medicine and Rehabilitation.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.058 | 0.242 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.001 | 0.001 |
| Science and technology studies | 0.000 | 0.005 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.001 | 0.004 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; both teacher heads agree on what is shown here.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".