Visualization and Visual Knowledge Discovery from Big Uncertain Data
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
In the current uncertain world, data are kept growing bigger. Big data refer to the data flow of huge volume, high velocity, wide variety, and different levels of veracity (e.g., precise data, imprecise/uncertain data). Embedded in these big data are implicit, previously unknown, but valuable information and knowledge. With huge volumes of information and knowledge that can be discovered by techniques like data mining, a challenge is to validate and visualize the data mining results. To validate data for better data aggregation in estimation and prediction and for establishing trustworthy artificial intelligence, the synergy of visualization models and data mining strategies are needed. Hence, in this paper, we present a solution for visualization and visual knowledge discovery from big uncertain data. Our solution aims to discover knowledge in the form of frequently co-occurring patterns from big uncertain data and visualize the discovered knowledge. In particular, the solution shows the upper and lower bounds on frequency of these patterns. Evaluation with real-life Coronavirus disease 2019 (COVID-19) data demonstrates the effectiveness and practicality of our solution in visualization and visual knowledge discovery from big health informatics data collected from the current uncertain world.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.000 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.001 |
| Open science | 0.001 | 0.003 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it