MétaCan
Menu
Back to cohort

The Use of Key Performance Indicators for the FAS: Analysis Based on the Statistics of Adjudications

2015· article· en· W4411202528 on OpenAlexaff
Светлана Авдашева, Д. В. Цыцулина, Елена Сидорова

Bibliographic record

VenuePublic Administration Issues · 2015
Typearticle
Languageen
FieldMedicine
TopicDiverse Approaches in Healthcare and Education Studies
Canadian institutionsNatural Sciences and Engineering Research Council of Canada
Fundersnot available
KeywordsAdjudicationStatisticsKey (lock)EconometricsMathematicsComputer sciencePolitical scienceComputer securityLaw

Abstract

fetched live from OpenAlex

Outcomes of the key performance indicators application for the assessment of the public authority performance are ambiguous. Theory of incentive contracts as well as international experience highlight difficulties and possible externalities of KPI setting for the public authority. The motivation system often distorts incentives of the public authorities, and the applied indicators do not correctly reflect the priorities of enforcement for the society. One specific example is the assessment of performance of the Russian competition authority. In the paper we analyze the peculiarities of formation of the ratio of infringement decisions that have come into legal force to all infringement decisions made by the competition authorities applied as one of the key performance indicators. Using the data of the database of judicial reviews of infringement decisions, we show that the assessment of FAS performance based on the share of infringement decisions that have come into legal force, distorts incentives of the authority substantially. It motivates the competition authority for making a large number of infringement decisions with a low probability to reverse but with a low positive impact on consumer surplus and total welfare.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.072
metaresearch head score (Gemma)0.251
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.072
Threshold uncertainty score0.380

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0720.251
Meta-epidemiology (narrow)0.0010.000
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0300.028
Science and technology studies0.0010.003
Scholarly communication0.0050.004
Open science0.0020.003
Research integrity0.0010.002
Insufficient payload (model declined to judge)0.0050.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.333
GPT teacher head0.405
Teacher spread0.072 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations1
Published2015
Admission routes1
Has abstractyes

Explore more

Same venuePublic Administration IssuesSame topicDiverse Approaches in Healthcare and Education StudiesFrench-language works237,207