The writing is on the wall: predicting customers' evaluation of customer-firm interactions using computerized text analysis
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
Purpose This methodological paper demonstrates how service firms can use digital technologies to quantify and predict customer evaluations of their interactions with the firm using unstructured, qualitative data. To harness the power of unstructured data and enhance the customer-firm relationship, the use of computerized text analysis is proposed. Design/methodology/approach Three empirical studies were conducted to exemplify the use of the computerized text analysis tool. A secondary data analysis of online customer reviews ( n = 2,878) in a service industry was used. LIWC was used to conduct the text analysis, and thereafter SPSS was used to examine the predictive capability of the model for the evaluation of customer-firm interactions. Findings A lexical analysis of online customer reviews was able to predict evaluations of customer-firm interactions across the three empirical studies. The authenticity and emotional tone present in the reviews served as the best predictors of customer evaluations of their service interactions with the firm. Practical implications Computerized text analysis is an inexpensive digital tool which, to date, has been sparsely used to analyze customer-firm interactions based on customers' online reviews. From a methodological perspective, the use of this tool to gain insights from unstructured data provides the ability to gain an understanding of customers' real-time evaluations of their service interactions with a firm without collecting primary data. Originality/value This research contributes to the growing body of knowledge regarding the use of computerized lexical analysis to assess unstructured, online customer reviews to predict customers' evaluations of a service interaction. The results offer service firms an inexpensive and user-friendly methodology to assess real-time, readily available reviews, complementing traditional customer research. A tool has been used to transform unstructured data into a numerical format, quantifying customer evaluations of service interactions.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.042 | 0.011 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.002 |
| Science and technology studies | 0.001 | 0.000 |
| Scholarly communication | 0.000 | 0.001 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it