Decentralized Model Selection for Test-Time Adaptation in Heterogeneous Connected Systems
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
Traditional centralized model training assumes that data samples are readily available and can be processed without constraints. In contrast, decentralized machine learning (DML) addresses the limitation by collaborative model training and inference directly on distributed data sources. The transformation from data centralization to decentralization helps comply with data regulations and improves system scalability with reduced reliance on cloud servers. However, a tradeoff between model personalization and generalization exists: the fine-tuning of local training data distribution sacrifices model generalization on the testing data distribution that differs from the training data distribution. To improve the tradeoff, we propose a DML framework that can inherently make model personalization and generalization easier by selecting a model among multiple ones judiciously. We develop a scalable selector for model selection and use blockchain to achieve model consensus. The personalized model selector is then proposed for test-time adaptation. Using computer simulations, we show that our method not only outperforms competitive personalization benchmarks but also generalizes well for new data distributions with various shifts.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.000 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it