Problems and Prospects with the Scientonomic Workflow
Notice bibliographique
Résumé
While the scientonomic workflow guiding the development of a general theory of scientific change has been practiced for nearly four years, it has yet to be formally evaluated. The goal of this paper is to fill this gap with a critical appraisal of the practice and theoretical underpinnings of the workflow currently used in scientonomy. First, we consider the traditional workflow which uses publications as the primary vehicle for substantive epistemic change and find that it fails to be sufficiently transparent or inclusive and is ambiguous at decisive points. Conversely, as we argue, the scientonomic workflow has the potential to succeed where the traditional workflow fails and thus provides a promising alternative workflow. We then go on to note a number of practical and theoretical problems that have arisen upon reflection on the scientonomic workflow and suggest some modifications to the workflow and to our practices. This paper takes the first steps in improving the workflow to reach its maximum potential. Suggested Modifications [Sciento-2019-0001]: Accept that the goal of peer-reviews in the scientonomic workflow is evaluation for pursuitworthiness rather than acceptability. [Sciento-2019-0002]: Accept that the discussions concerning a suggested modification are to be published once a communal verdict is available. The discussions are to be published in the journal as special commentary articles co-authored by all participants of the discussion or in special edited collections. [Sciento-2019-0003]: Accept that the commentators of suggested modifications are allowed to suggest reformulations of the original formulations. Also accept that, by default, the new formulation should bear the original author’s name, unless the author decides to give credit to those who significantly contributed to the new reformulation. This should be decided collegially by the author, the commentators, and the editors on a case-by-case basis. [Sciento-2019-0004]: Accept that an annual book prize is to be offered for extensive participation on the encyclopedia. The winner(s) are to be decided by the encyclopedia editors. [Sciento-2019-0005]: Accept that star-ratings are to be introduced for commentators who comment on suggested modifications on the encyclopedia. [Sciento-2019-0006]: Accept that the encyclopedia editors are to be granted official housekeeping rights to handle the ripple effects. Also accept that if the additional required changes are implicit in the suggested modification, the editors should create and alter encyclopedia pages to ensure that the accepted body of scientonomic knowledge is properly documented; if it is conceivable to accept the modification without accepting the ripple effect change in question, the editors should register these changes as new suggested modifications so that the community can discuss and evaluate them in an orderly fashion. [Sciento-2019-0007]: Accept that the verdict on suggested modifications is to be decided by a communal vote that will follow the discussion period. Have a communal discussion and decide as to what percentage of votes it should take for a modification to be accepted – a simple majority (50% +1), or supermajority of three fifths (60%), two thirds (67%), or three quarters (75%). Also discuss to decide as to how long the discussion period and the voting period should be. This modification is incompatible with modification [Sciento-2019-0008]. [Sciento-2019-0008]: Accept that a countdown mechanism is to be introduced, where a modification is accepted by default if there are no objections within a 90-day period following its publication. This modification is incompatible with modification [Sciento-2019-0007].
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction machine sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Le volet Gemma est une étiquette directe du modèle pour chaque travail de la base, lue sur la notice réduite au titre. Le volet Codex est un classifieur appris des 10 348 étiquettes directes de Codex et calibré sur les taux pondérés de l'échantillon; les champs sans appui suffisant ne portent aucun appel Codex. Le mode candidate est l'union des deux volets; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont pas des étiquettes humaines.
Scores du classifieur distillé par catégorie (deux têtes)
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,567 | 0,591 |
| Méta-épidémiologie (sens strict) | 0,002 | 0,002 |
| Méta-épidémiologie (sens large) | 0,003 | 0,005 |
| Bibliométrie | 0,013 | 0,016 |
| Études des sciences et des technologies | 0,038 | 0,160 |
| Communication savante | 0,058 | 0,062 |
| Science ouverte | 0,016 | 0,029 |
| Intégrité de la recherche | 0,026 | 0,040 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,011 | 0,007 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; l’étiquette directe de Gemma et le classifieur distillé Codex s’accordent sur ce qui est montré ici.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».