Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
While the scientonomic workflow guiding the development of a general theory of scientific change has been practiced for nearly four years, it has yet to be formally evaluated. The goal of this paper is to fill this gap with a critical appraisal of the practice and theoretical underpinnings of the workflow currently used in scientonomy. First, we consider the traditional workflow which uses publications as the primary vehicle for substantive epistemic change and find that it fails to be sufficiently transparent or inclusive and is ambiguous at decisive points. Conversely, as we argue, the scientonomic workflow has the potential to succeed where the traditional workflow fails and thus provides a promising alternative workflow. We then go on to note a number of practical and theoretical problems that have arisen upon reflection on the scientonomic workflow and suggest some modifications to the workflow and to our practices. This paper takes the first steps in improving the workflow to reach its maximum potential. Suggested Modifications [Sciento-2019-0001]: Accept that the goal of peer-reviews in the scientonomic workflow is evaluation for pursuitworthiness rather than acceptability. [Sciento-2019-0002]: Accept that the discussions concerning a suggested modification are to be published once a communal verdict is available. The discussions are to be published in the journal as special commentary articles co-authored by all participants of the discussion or in special edited collections. [Sciento-2019-0003]: Accept that the commentators of suggested modifications are allowed to suggest reformulations of the original formulations. Also accept that, by default, the new formulation should bear the original author’s name, unless the author decides to give credit to those who significantly contributed to the new reformulation. This should be decided collegially by the author, the commentators, and the editors on a case-by-case basis. [Sciento-2019-0004]: Accept that an annual book prize is to be offered for extensive participation on the encyclopedia. The winner(s) are to be decided by the encyclopedia editors. [Sciento-2019-0005]: Accept that star-ratings are to be introduced for commentators who comment on suggested modifications on the encyclopedia. [Sciento-2019-0006]: Accept that the encyclopedia editors are to be granted official housekeeping rights to handle the ripple effects. Also accept that if the additional required changes are implicit in the suggested modification, the editors should create and alter encyclopedia pages to ensure that the accepted body of scientonomic knowledge is properly documented; if it is conceivable to accept the modification without accepting the ripple effect change in question, the editors should register these changes as new suggested modifications so that the community can discuss and evaluate them in an orderly fashion. [Sciento-2019-0007]: Accept that the verdict on suggested modifications is to be decided by a communal vote that will follow the discussion period. Have a communal discussion and decide as to what percentage of votes it should take for a modification to be accepted – a simple majority (50% +1), or supermajority of three fifths (60%), two thirds (67%), or three quarters (75%). Also discuss to decide as to how long the discussion period and the voting period should be. This modification is incompatible with modification [Sciento-2019-0008]. [Sciento-2019-0008]: Accept that a countdown mechanism is to be introduced, where a modification is accepted by default if there are no objections within a 90-day period following its publication. This modification is incompatible with modification [Sciento-2019-0007].
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.018 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.004 |
| Science and technology studies | 0.010 | 0.027 |
| Scholarly communication | 0.001 | 0.002 |
| Open science | 0.003 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it