MétaCan
Menu
Back to cohort
Record W4361285177 · doi:10.1186/s43170-023-00140-y

The effects of outdated data and outliers on Kenya’s 2019 Global Food Security Index score and rank

2023· article· en· W4361285177 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

fundA Canadian funder is recorded on the work.
no affNo Canadian affiliation: this work is invisible to an affiliation-only frame.
No Canadian affiliation. An affiliation-only frame, the usual design, would never have seen this work. It is one of the works that make the case for inverting the frame.

Bibliographic record

VenueCABI Agriculture and Bioscience · 2023
Typearticle
Languageen
FieldAgricultural and Biological Sciences
TopicAgricultural risk and resilience
Canadian institutionsnot available
FundersMastercard Foundation
KeywordsRank (graph theory)OutlierIndex (typography)Food securityStatisticsMathematicsEconometricsGeographyComputer scienceAgricultureCombinatoricsWorld Wide Web

Abstract

fetched live from OpenAlex

While composite indicators are considered robust in measuring food security, outdated data and outliers challenge their reliability. Outdated data can occur when national databases are not frequently updated while outliers are extremely small or large values in a study. Outdated data could be referred to as missing current data in composite indicators used for annual benchmarking exercises, where data must be frequently updated. Besides hindering useful information within an index, outdated data could also result in outliers in a database, especially when the outdated or missing current data are imputed by estimation. Studies that have assessed the robustness of composite indicators highlight that outdated data and outliers could bias results, thereby hindering an index's reliability. However, depending on the methods used when constructing a composite indicator, some methods can be considered robust even with the presence of outliers in a data point. Outdated national data could hinder countries from tracking the progress of international, national or regional commitments, such as the Sustainable Development Goals, while outliers could act as an unintended benchmark. This study assessed the impacts of outdated data and outliers on Kenya's scores and rankings in the Global Food Security Index (GFSI). The study objective was achieved by assessing Kenya's performance in the 2019 GFSI result before and after removing outliers from the GFSI data points and updating Kenya's outdated indicators. Winsorisation was used to remove the outliers from the GFSI database, while the Spearman correlation and Paired t-tests were used to test for the statistical significance of the outdated data and outliers. The study revealed that while Kenya's 2019 GFSI database did not have outliers, outliers in other countries' data points impacted Kenya's score and rank. For example, the winsorisation of outliers for other countries reduced Kenya's 2019 overall GFSI score by six points. Moreover, thirteen indicators in Kenya's 2019 GFSI database were found to be outdated. However, despite Kenya's score improving from updating the outdated data, the impact was minimal to increase the GFSI's mean score for all countries. That is, updating Kenya's outdated indicators was found not to differ significantly from zero. The study concluded that Kenya's score and rank in the 2019 GFSI were affected by the outdated data in Kenya's database and outliers in other countries' data. The study, therefore, recommended that Kenya should update its national database and allow open access to the national data while the GFSI should identify and remove outliers from the data points.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.000
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.619
Threshold uncertainty score0.524

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0000.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.001
Science and technology studies0.0010.001
Scholarly communication0.0000.000
Open science0.0010.001
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.010
GPT teacher head0.218
Teacher spread0.208 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it