MétaCan
Menu
Retour à la cohorte
Enregistrement W3004485295 · doi:10.33137/js.v3i0.33509

Problems and Prospects with the Scientonomic Workflow

2019· article· en· W3004485295 sur OpenAlex
Jamie Shaw, Hakob Barseghyan

Pourquoi ce travail est dans la base

Une base qui oublie comment elle a trouvé un travail ne peut pas être vérifiée. Voici les voies qui ont admis celui-ci.

affAu moins un auteur déclare une institution canadienne dans l'instantané OpenAlex épinglé.
venuePublié dans une revue dont le pays d'attache est le Canada.

Notice bibliographique

RevueScientonomy Journal for the Science of Science · 2019
Typearticle
Langueen
DomaineSocial Sciences
ThématiqueClimate Change Communication and Perception
Établissements canadiensUniversity of TorontoToronto Metropolitan University
Organismes subventionnairesnon disponible
Mots-clésWorkflowComputer scienceWorkflow technologyWorkflow engineEpistemologyData sciencePhilosophyDatabase

Résumé

récupéré en direct d'OpenAlex

While the scientonomic workflow guiding the development of a general theory of scientific change has been practiced for nearly four years, it has yet to be formally evaluated. The goal of this paper is to fill this gap with a critical appraisal of the practice and theoretical underpinnings of the workflow currently used in scientonomy. First, we consider the traditional workflow which uses publications as the primary vehicle for substantive epistemic change and find that it fails to be sufficiently transparent or inclusive and is ambiguous at decisive points. Conversely, as we argue, the scientonomic workflow has the potential to succeed where the traditional workflow fails and thus provides a promising alternative workflow. We then go on to note a number of practical and theoretical problems that have arisen upon reflection on the scientonomic workflow and suggest some modifications to the workflow and to our practices. This paper takes the first steps in improving the workflow to reach its maximum potential. Suggested Modifications [Sciento-2019-0001]: Accept that the goal of peer-reviews in the scientonomic workflow is evaluation for pursuitworthiness rather than acceptability. [Sciento-2019-0002]: Accept that the discussions concerning a suggested modification are to be published once a communal verdict is available. The discussions are to be published in the journal as special commentary articles co-authored by all participants of the discussion or in special edited collections. [Sciento-2019-0003]: Accept that the commentators of suggested modifications are allowed to suggest reformulations of the original formulations. Also accept that, by default, the new formulation should bear the original author’s name, unless the author decides to give credit to those who significantly contributed to the new reformulation. This should be decided collegially by the author, the commentators, and the editors on a case-by-case basis. [Sciento-2019-0004]: Accept that an annual book prize is to be offered for extensive participation on the encyclopedia. The winner(s) are to be decided by the encyclopedia editors. [Sciento-2019-0005]: Accept that star-ratings are to be introduced for commentators who comment on suggested modifications on the encyclopedia. [Sciento-2019-0006]: Accept that the encyclopedia editors are to be granted official housekeeping rights to handle the ripple effects. Also accept that if the additional required changes are implicit in the suggested modification, the editors should create and alter encyclopedia pages to ensure that the accepted body of scientonomic knowledge is properly documented; if it is conceivable to accept the modification without accepting the ripple effect change in question, the editors should register these changes as new suggested modifications so that the community can discuss and evaluate them in an orderly fashion. [Sciento-2019-0007]: Accept that the verdict on suggested modifications is to be decided by a communal vote that will follow the discussion period. Have a communal discussion and decide as to what percentage of votes it should take for a modification to be accepted – a simple majority (50% +1), or supermajority of three fifths (60%), two thirds (67%), or three quarters (75%). Also discuss to decide as to how long the discussion period and the voting period should be. This modification is incompatible with modification [Sciento-2019-0008]. [Sciento-2019-0008]: Accept that a countdown mechanism is to be introduced, where a modification is accepted by default if there are no objections within a 90-day period following its publication. This modification is incompatible with modification [Sciento-2019-0007].

Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.

Prédiction distillée sur la base complète

Imitation des enseignants

Ni prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.

score de la tête « metaresearch » (Codex)0,018
score de la tête « metaresearch » (Gemma)0,000
Version: codex-gemma-dda1882f352aStatut de validation: machine_predicted_unvalidated
Catégories candidatesÉtudes des sciences et des technologies, Communication savante
Catégories consensuellesÉtudes des sciences et des technologies
DomaineSignal candidat: aucune · Signal consensuel: aucune
Devis d'étudeSignal candidat: Qualitatif · Signal consensuel: aucune
GenreSignal candidat: Empirique · Signal consensuel: Empirique
Score de désaccord entre enseignants0,506
Score d'incertitude au seuil1,000

Scores Codex et Gemma par catégorie

CatégorieCodexGemma
Métarecherche0,0180,000
Méta-épidémiologie (sens strict)0,0000,000
Méta-épidémiologie (sens large)0,0000,000
Bibliométrie0,0000,004
Études des sciences et des technologies0,0100,027
Communication savante0,0010,002
Science ouverte0,0030,000
Intégrité de la recherche0,0000,000
Charge utile insuffisante (le modèle a refusé de juger)0,0000,000

Scores machine (provisoires)

Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.

Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.

Tête enseignante Opus0,200
Tête enseignante GPT0,393
Écart entre enseignants0,193 · la distance entre les deux têtes enseignantes sur ce seul travail
Statut de validationscore_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découle