Information Entropy of Non‐Probabilistic Processes
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
We derive an expression for the entropy of non‐probabilistic distributions encountered in spatial and mathematical mappings. The entropy of non‐probabilistic distributions can be formulated using probabilistic notions of the hypothetical random redistribution of finite information. We show that the discrete approximation to the information content of spatial maps can be based on the discrete hypergeometric distribution. The resultant “associative” entropy is distinct from the Shannon entropy for probability distributions and addresses several shortcomings of the current entropy paradigm as applied to spatial analysis. The associative entropy statistic is distributed approximately as a chi‐squared random variable under limitations of variation. We formulate a univariate logical equivalent of the associative entropy statistic, freeing the paradigm from the degrees of freedom constraint to which it has been traditionally shackled. This entropy has application in spatial analysis and fuzzy set theory. The associative entropy is based on the concept of proportional information and is related to the Getis G‐statistics of spatial association and the Chi‐squared statistics of sample means. We explore the utility of the theory when applied to spatial distribution of vegetation in New Brunswick, Canada. The limitations and implications of the entropy expression are discussed and suggestions are made for future applications of the theory. This work is part of the development of an information theory framework for the analysis of landscape patterns of animal habitat.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.000 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.003 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.002 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it