Leveraging historical information to boost retrieval-augmented generation in conversations
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
Multi-turn interactions between users and information-seeking systems have become a popular paradigm to satisfy complex information needs via a flexible interface and context understanding capacity. However, existing methods primarily adapt single-turn retrieval-augmented generation (RAG) pipelines to conversational settings without effectively incorporating historical information, such as previous search results, turn dependency, and historical evidence grounding. To effectively manage and utilize the information in conversations, we explore the feasibility of boosting response generation by leveraging historical information and propose several strategies to incorporate this information individually or in combination. We conduct experiments on three widely used conversational search benchmarks, each containing thousands of samples. Our method consistently outperforms previous strong baselines across different settings, achieving approximately a 10% absolute improvement over the second-best approach. Besides, our analyses help to understand the behind-the-scenes behavior of our methods. • We investigate the feasibility of leveraging abundant historical information to improve RAG performance in conversations. • We design several training-free strategies from different aspects, that can be used individually or in combination to boost RAG performance. • We conduct thorough experiments on three datasets to demonstrate the effectiveness of our methods, and analyze the potential paradigms behind the model.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.000 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.001 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.001 | 0.006 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it