MétaCan
Menu
Back to cohort
Record W3088774151 · doi:10.1002/cl2.1107

Editorial: Fifty Campbell systematic reviews relevant to the policy response to COVID‐19

2020· editorial· en· W3088774151 on OpenAlexaff
Ariel M. Aloe, Eric Barends, Douglas J. Besharov, Zulfiqar A Bhutta, Xinsheng Cai, Marie Gaarder, Ruth Garside, Neal Haddaway, Elizabeth Kristjansson, Brandy R. Maynard, Lorraine Mazerolle, Robyn Mildon, Sarah Miller, Jan C. Minx, Peter Neyroud, Annette M. O’Connor, Denise M. Rousseau, Ashrita Saran, Joann Starks, Gavin Stewart, Jo Thompson Coon, Peter Tugwell, Jeffrey C. Valentine, Vivian Welch, Oliver Wendt, Howard White

Bibliographic record

VenueCampbell Systematic Reviews · 2020
Typeeditorial
Languageen
FieldPsychology
TopicPsychological Well-being and Life Satisfaction
Canadian institutionsInternational Development Research CentreBruyèreUniversity of OttawaCanadian Nutrition SocietyUniversity of Toronto
Fundersnot available
KeywordsPsychological interventionHarmSystematic reviewPolitical sciencePublic economicsPublic policyPublic relationsEconomicsPsychologyMEDLINELawPsychiatry

Abstract

fetched live from OpenAlex

The global severe acute respiratory syndrome coronavirus 2 pandemic strikingly shows the need for rigorous evidence to inform decisions. During such times of crisis, many decisions are made across multiple sectors and trillions of dollars are spent to deal with its consequences that affect all aspects of economic and societal life. Given the scale of human suffering, thoughtfully designing effective policies, and carefully spending scarce resources on interventions that work during crisis management and recovery, become crucial. However, in many areas of decision making, the use of robust and reliable evidence is not the norm. This has dire consequences: evidence from impact evaluations in different sectors show that about 80% of policy interventions are not effective (White, 2019). Equally, the reliance on an individual study or model rather than evidence synthesis commonly leads to misinformed policy and outright harm. For example, the retracted study on hydroxychloroquine for COVID-19 led to public harm as well as public mistrust (Mehra, Ruschitzka, & Patel, 2020). Now, more than ever, public policy needs to be informed by the most rigorous, comprehensive and up-to-date evidence possible. We, at the Campbell Collaboration, are working on both providing this rigorous evidence and promoting its use to inform decisions about social and public policy. Campbell systematic reviews provide a wealth of rigorous evidence to support social and economic response. These reviews highlight what is known and actionable, and point to critical questions decisionmakers need to ask in planning and implementing social and economic responses. Campbell systematic reviews follow carefully structured, peer-reviewed procedures to produce high-quality, theory-based evaluations of social and economic policies and programmes. They address real-world problems, often in partnership with relevant stakeholders, and seek to answer what works, why and for whom. Our 12 coordinating groups provide broad coverage of social issues, including ageing, business and management, climate solutions, crime and justice, disability, education, international development, knowledge translation and implementation, methods, nutrition and food systems and social welfare. And our international editorial board supervises the process in order to produce rigorous evidence syntheses and strategic partnerships that encourage their timely consideration for policy. Campbell systematic reviews have influenced national policy discussions on over 40 topics. They inform international guidelines and support the design and scaling-up of dozens of evidence-based social and economic policies and programmes (Campbell Collaboration, 2020). Campbell also publishes evidence and gap maps, which provide a thorough overview of the body of evidence. They allow decision makers and planners to quickly identify the best available evidence on a topic, remaining evidence gaps, as well as suitable areas to be converted into living evidence reviews (Thomas et al., 2017). For example, the Campbell evidence and gap map on people with disabilities may be helpful to inform decisions about health, social engagement and employment for people with disabilities (Saran, White, & Kuper, 2020) in the aftermath of COVID-19 stringency measures. With this editorial, we provide a virtual issue of 50 Campbell systematic reviews to inform the social and economic response to COVID-19 (Figure 1). Some reviews have immediate relevance, including how to promote handwashing (De Buck et al., 2017), distribute cash in emergency settings, provide nutrition outreach, intervene for the safety of women and children and implement evidence-based policing. Lockdown measures put pressure on families. We can learn from the large number of reviews on family functioning such as promoting the well-being of children exposed to intimate partner violence (Latzman, Casanueva, Brinton, & Forman-Hoffman, 2019). Reviews provide guidance to support vulnerable populations including the elderly, and others needing assistance in daily living. Other reviews cover programmes to strengthen the social safety net, for example, in food security, cash transfers and care homes. As economies reopen, Campbell reviews offer ideas on how best to get people back to work, including labour activation measures such as youth employment (Kluve et al., 2017), promoting entrepreneurship and providing vocational training. With global shutdowns in food processing plants and agriculture, we need to increase food production and availability through transport, improving retail access and outreach to difficult-to-reach areas such as urban slums. Campbell reviews highlight the effects of technological support for farmers, training and contract farming. Campbell reviews inform how to restructure government services such as schools, community services and prisons to support continued social distancing. New evidence syntheses are needed in some areas to answer questions directly related to COVID-19 policies; for example, evidence on the impacts of reopening of schools on disease burden, learning and achievement and family well-being would be most helpful. Reviews provide evidence on alternatives to prison like noncustodial sentences (Villettaz, Gillieron, & Killias, 2015), noncustodial employment programmes and court diversion programmes to keep youth out of the justice system. Partnership with Evidence Aid to produce COVID-19-relevant summaries of Campbell systematic reviews (Evidence Aid Coronavirus COVID-19, 2020). Highlighting COVID-19-relevant Campbell reviews with blogs and editorials. Partnership with the COVID-END network to coordinate evidence synthesis initiatives. Fast track editorial process for COVID-19 relevant articles. Development of methods to register rapid systematic reviews, followed by living reviews to address high-priority questions with rapidly emerging evidence-bases (ongoing). Initiatives within practitioner and policy communities, such as priority-setting, webinars and training. Campbell Systematic Reviews welcomes registration of new reviews, with a fast-track editorial process, to inform the global COVID-19 social and economic response. Our methodological standards protect against bias and potentially misleading findings. Registration with Campbell protects against research waste since titles and protocols are publicly available and searchable. As the world continues to respond to the COVID-19 crisis, the policy community needs rigorous evidence on options and alternatives. Evidence from Campbell systematic reviews shows what is known on social and economic policies and programmes. Reviews identify the uncertainties to address via policy experiments, pilot tests and trials. And they identify questions to be answered with further evidence synthesis or primary research. Donald Campbell's vision of an Experimenting Society (Campbell, 1991), which conducts and learns from policy experiments, is needed now more than ever.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.051
metaresearch head score (Gemma)0.325
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Meta-epidemiology (narrow), Research integrity, Insufficient payload (model declined to judge)
Consensus categoriesMetaresearch, Meta-epidemiology (narrow), Research integrity
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Editorial · Consensus signal: Editorial
Teacher disagreement score0.274
Threshold uncertainty score0.999

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0510.325
Meta-epidemiology (narrow)0.0020.001
Meta-epidemiology (broad)0.0120.002
Bibliometrics0.0010.003
Science and technology studies0.0010.000
Scholarly communication0.0010.000
Open science0.0040.001
Research integrity0.0030.003
Insufficient payload (model declined to judge)0.0010.087

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.073
GPT teacher head0.405
Teacher spread0.332 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; both teacher heads agree on what is shown here.

Study designNot applicable
Domainnot available
GenreEditorial

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations1
Published2020
Admission routes1
Has abstractyes

Explore more

Same venueCampbell Systematic ReviewsSame topicPsychological Well-being and Life SatisfactionFrench-language works237,207