Evaluating the Construct Validity and Sensitivity to Change of the Klenico Depression Domain in Psychotherapeutic Inpatient Care: Instrument Validation Study
Bibliographic record
Abstract
Background The accurate diagnosis of mental disorders, such as depression, requires comprehensive, valid, and reliable tools to ensure evidence-based treatments and effective outcome monitoring. Existing diagnostic practices often lack standardization, leading to missed comorbidities and variable diagnostic accuracy. The Klenico system is an innovative, web-based diagnostic tool that integrates patient self-reports with clinical validations by mental health professionals. This system covers a broad spectrum of mental disorders, including depression. Objective This research aimed to evaluate the psychometric properties of the Klenico Depression Domain (KDD), the component of the Klenico system that measures depressive symptomatology, in a real-world clinical setting. Specifically, the evaluation focused on the assessment of its construct validity, internal consistency, and sensitivity to change in symptom severity. Methods Anonymized data from 496 inpatients with mental disorders collected between 2019 and 2022 were analyzed. Patients completed the KDD alongside parts of the Patient Health Questionnaire (PHQ), Beck Depression Inventory (BDI-II), and Satisfaction With Life Scale (SWLS) at both admission and discharge. Internal consistency was measured using Cronbach α. Exploratory factor analysis was conducted to examine the factor structure. Construct validity was assessed via Pearson correlations with PHQ-9 and BDI-II, while divergent validity was tested against the PHQ Somatic Symptoms Scale (PHQ-15), PHQ–Generalized Anxiety Disorder-7, and SWLS. Sensitivity to change was evaluated using paired 1-tailed t tests, effect sizes, and repeated measures correlations. Results The KDD demonstrated excellent internal consistency (Cronbach α=0.91 at admission and 0.93 at discharge). Factor analysis revealed a 7-factor structure encompassing dimensions like “inadequacy,” “anhedonia,” and “self-hatred,” aligning with core depressive symptoms outlined in the International Statistical Classification of Diseases, Tenth Revision. The correlations with the convergent questionnaires PHQ-9 (r=0.68; P<.001) and BDI-II (r=0.70; P<.001) were high. While the KDD showed a moderate correlation with the divergent PHQ-15 (r=0.35; P<.001), it was more strongly associated with the divergent SWLS (r=–0.51; P<.001) and Generalized Anxiety Disorder-7 (r=0.51; P<.001). Sensitivity to change was high, with significant reductions in KDD scores for patients with improved symptoms (t27=5.36, P<.001; Cohen d=0.79) and high repeated measures correlation with both the BDI-II (r=0.61; P<.001) and the PHQ-9 (r=0.59; P<.001). Conclusions The KDD shows promise as a reliable and valid instrument for diagnosing depression and monitoring treatment outcomes in psychotherapeutic settings. Its alignment with International Statistical Classification of Diseases, Tenth Revision diagnostic criteria and sensitivity to symptom change underlines its potential utility. These findings highlight the Klenico system’s potential to enhance clinical diagnostics by addressing current gaps in mental health care, thus improving diagnostic accuracy and consistency. Further research is recommended to validate its performance across different populations and settings.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.048 | 0.072 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.002 |
| Bibliometrics | 0.002 | 0.002 |
| Science and technology studies | 0.001 | 0.001 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.001 | 0.002 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".