Homogenous Ensemble Boosting Approach to Improve the Consistency in the Accuracy of Text Data Classification
Bibliographic record
Abstract
Abstract The rapid growth of the internet in recent years has produced an enormous amount of data. The significant chunk of this data is unstructured. This unstructured data requires critical analysis and modelling to become useful for decision making. Due to the wild spread of internet across the globe, several applications are being developed every day. These applications have direct interaction with end-users, and users can provide their opinions, sentiments, reviews etc. about the products, services, events, etc. These sentiments, reviews and opinions are very useful for individuals, organizations, businesses, and governments for future decision making. Surveys from last few years confer those online opinions have more prominent financial effect compared to traditional media advertisement. The significant task of sentiment analysis is used to locate the useful information from the client sentiment. While this substance is intended to be valuable, most of this client produced content requires using the data mining methods and sentiment analysis. However, a few difficulties are confronting sentiment analysis. Sentiment analysis includes the applications of natural language processing and text analysis methods to recognize and separate the useful information from text data. Machine learning techniques are widely used for sentiment classification. In this paper, we provide a deep understanding of different machine learning systems for sentiment classification. An extensive study of homogenous ensemble-based machine learning techniques in the domain of sentiment classification has been carried out to enhance the efficiency and consistency by implementing various learning algorithms to gain better accuracy that can be attained from any of the individual learning algorithms. Our methodology in this paper is to explore the whole process from data preprocessing to classification accuracy. Various preprocessing steps are applied to selected text data to prepare data for classification. Many classification models (NB, NNET, KNN, RPART, SVM, LDA, CTREE) are explored from a different family of classifiers for classification purpose. Lastly, homogeneous ensemble techniques (Boosting (GBM) and Bagging (RF)) are used and compared with individual classifiers. And results obtained shows that Boosting ensemble model is more consistent and accurate than all other discussed models.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.010 | 0.003 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.002 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.001 | 0.000 |
| Open science | 0.008 | 0.007 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".