Challenges in the Measurement of Gambling Product Risk: A Critical Review of the ASTERIG Assessment Tool
Bibliographic record
Abstract
Recognition of the role of structural characteristics and their potential association with gambling harm has led to the development of protocols to assess the risk of gambling products. Such tools rate products on a range of ‘risk criteria’ and assign classifications that might be used to inform product design or regulatory decision-making. One of published examples of these tools is ASTERIG which assigns ratings of lowest to highest to products based on 10 criteria that include, for example: event frequency, accessibility or scale of jackpot. In this paper, we provide a critical review of this protocol and identify five principal limitations that may limit its validity and reliability. These relate to the validity of some criteria as indicators of risk; definitional issues; scoring and calibration; problems arising from collinearity or duplication; and, the omission of important criteria such as cost of play. In this paper, we highlight the challenges associated with rating product risk using ASTERIG as an example. We argue that further refinement of risk assessment tools requires the development of more rigorous conceptual frameworks both in design and application as well greater validation of risk classifications against independent data relating to the links between products and gambling-related harm.RésuméLa reconnaissance du rôle des caractéristiques structurelles et de leur association potentielle avec les maux liés aux jeux de hasard a entraîné l’élaboration de protocoles visant à évaluer le risque des produits de jeu. De tels outils évaluent les produits sur une échelle de « critères de risque » et leur classement peut servir à orienter la conception de produits ou la prise de décisions réglementaires. L’un des exemples de ces outils est ASTERIG, qui attribue aux produits une cote, de la plus basse à la plus élevée, à l’aide de dix critères, notamment la fréquence de l’événement, l’accessibilité au gros lot ou la taille de ce dernier. Nous présentons dans cet article un examen critique de ce protocole et nous cernons cinq grandes limites pouvant restreindre sa validité et sa fiabilité. Ces limites concernent la validité de certains critères en tant qu’indicateurs de risque, des questions définitionnelles, le pointage et l’étalonnage, les problèmes issus de la colinéarité ou du double compte, et l’omission de critères importants comme le coût du jeu. Nous mettons en évidence dans cet article les enjeux liés à l’évaluation du risque d’un produit à l’aide d’ASTERIG par exemple. Nous soutenons que le peaufinage des outils d’évaluation du risque nécessite la mise sur pied d’un cadre conceptuel plus rigoureux, tant sur le plan de la conception que de l’application, ainsi qu’une plus grande validation des catégories de risque par rapport à des données indépendantes sur les liens entre les produits et les maux associés aux jeux de hasard.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.010 | 0.002 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.003 | 0.002 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".