MétaCan
Menu
Back to cohort
Record W294906217

Helpful or Unhelpful: A Linear Approach for Ranking Product Reviews

2010· article· en· W294906217 on OpenAlex
Richong Zhang, Thomas Tran

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueJournal of electronic commerce research · 2010
Typearticle
Languageen
FieldComputer Science
TopicSentiment Analysis and Opinion Mining
Canadian institutionsUniversity of Ottawa
Fundersnot available
KeywordsHelpfulnessComputer scienceProduct (mathematics)Ranking (information retrieval)PurchasingThe InternetWorld Wide WebInformation retrievalData scienceMarketingPsychologyBusinessMathematics
DOInot available

Abstract

fetched live from OpenAlex

ABSTRACT Most E-commerce web sites and online communities provide interfaces and platforms for consumers to express their opinions about a specific product by writing personal reviews. The fast development of E-commerce has caused such a huge amount of online product reviews to become available to consumers that it is impossible for potential consumers to read through all the reviews and to make a quick purchasing decision. Review readers are asked to vote if a review is Helpful or Unhelpful and the most positively voted reviews are placed on the top of product review list. However, the accumulation of votes takes time for a review to be fully voted and newly published reviews are always listed at the bottom of the review list. This paper proposes a linear model to predict the helpfulness of online product reviews. Reviews can be quickly ranked and classified by our model and reviews that may help consumers better than others will be retrieved. We compare our model with several machine learning classification algorithms and our experimental results show that our approach effectively classifies online reviews. Also, we provide an evaluation measurement to judge the performance of the helpfulness modeling algorithm and the results show that the helpfulness scores predicted by our approach consistently follow the changing trend of the true helpfulness values. Keywords: recommender system, online product review, helpfulness, evaluation (ProQuest: ... denotes formulae omitted.) 1. Introduction Due to the fast development of Internet and E-commerce, more and more online reviews aggregation web sites, such as Epinions.com etc., have provided consumers with platforms to exchange their opinions about products, services, and merchants. Online product reviews provided by consumers who previously purchased products have become a major information source for consumers and marketers regarding product [Hu & Zhang 2008]. Park et al. [2007] confirmed that the quality of reviews has a positive effect on product sales and consumers purchase intentions increase with the quantity of product reviews. On the E-commerce web sites, such as Amazon.com and Ebay.com, consumers are asked to write reviews and rate products or services by a number of stars after they finished a transaction. Most of existing recommendation approaches [Goldberg et al. 1992; Resnick et al. 1994; Sarwar et al. 2001] are merely based on the rating of products. With a star rating scale, users can not get `real semantics' of review statements. Since product reviews represent reviewers' feelings, experiences and opinions on a specific product, they are more useful than product ratings and therefore can better help potential consumers make purchase decisions. Search engines are good tools to assist in looking for information; however, there are too many search results returned from a search engine and not all of them are reviews. For instance, if we input `Cyber-shot Digital Camera Review' in Google, 278,000 web pages will be returned. This is absolutely a too huge result set for consumers to go through. Moreover, in an online community, such as Epinion.com or Amazon.com, more than 1000 reviews for a specific product are submitted by different consumers. Therefore, it is important to rank and classify product reviews so that they can be accessed easily and used effectively by consumers. Review aggregation web sites provide a function for consumers to vote whether a review is Helpful or Unhelpful. But this progress takes time far before a really helpful review is discovered and the most recent published reviews will always be the least voted ones. Our goal is to develop a model that filters out reviews which are most likely helpful to consumers and that provide more valuable information for consumer's decision making. Such a model can save a great deal of consumers' effort in surfing for reliable and helpful reviews. …

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.015
metaresearch head score (Gemma)0.001
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Methods · Consensus signal: none
Teacher disagreement score0.795
Threshold uncertainty score0.797

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0150.001
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.000
Bibliometrics0.0010.001
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0020.000
Research integrity0.0000.002
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.164
GPT teacher head0.442
Teacher spread0.278 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it