Application of a Improved Categorization Algorithm in the Malicious Information Filtering
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
The prediction result of classifier was biased towards the class with more samples,because of the samples that including the malicious information were difficult to gain when using the KNN(K Nearest Neighbor) categorization algorithm to filter the malicious information.In order to improve the filter effect of the class with fewer samples,the traditional KNN algorithm was improved from the data angle: the class with fewer samples was grouped by using cluster algorithm,then the genetic crossover operator was used in each cluster to gain the new samples and confirm the validity.The quantity of each kind of sample basic balanced training sample set was gained finally and training the KNN classifier.The result of experiment indicated that this method may distinguish the malicious text effectively.This method is simultaneously suitable for other categorization question on imbalanced data sets that attention the categorization precision of the class with fewer samples.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.000 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.001 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it