Unlocking insights - leveraging large language models for enhanced knowledge management in natural gas E&P industry (WGC2025 Regional Gas Award)
Notice bibliographique
Résumé
Decades of natural gas E&P (Exploration and Production) have yielded a vast wealth of knowledge, largely stored in unstructured documents. Harnessing this valuable information can significantly enhance the efficiency and reduce the costs of natural gas exploration and production. The emergence of LLMs (Large Language Models) has enabled the conversion of unstructured knowledge into corpora, which can be leveraged through techniques like fine-tuning and RAG (Retrieval-Augmented Generation) to create a customized LLM for the natural gas industry. This innovative approach offers a solution to the long-standing challenge of effectively managing and utilizing natural gas knowledge, unlocking new opportunities for industry improvement. To develop GasEPChat, a cutting-edge large language model for natural gas exploration and production (E&P) knowledge management, we complied a comprehensive dataset from trusted industry sources. This dataset comprises over 28,000 abstracts from leading publications, including the SPE (Society of Petroleum Engineers) and prominent journals such as Natural Gas Industry, Petroleum Exploration and Development, and Acta Petrolei Sinica. We also integrated more than 3,000 definitions from reputable natural gas encyclopedias and internal industry documents, providing a robust foundation for GasEPChat's knowledge base. Following rigorous data processing, including categorization, deduplication, cleaning, and transformation, this dataset formed the foundation of the GasEPChat corpus. To enable the model to effectively manage natural gas knowledge, we generated 13,000 high-quality QA (Question-Answering) pairs using a combination of automated QA generation and expert review, and split it into training, validating and testing datasets with a ratio of 8:1:1. We then fine-tuned several state-of-the-art open-sourced LLMs, including GLM4-9B, LLaMA3.1-8B, and Qwen2.5-7B-Instruct, on the training dataset, and evaluated their performance on the testing dataset. The GLM4 model demonstrated superior performance and was selected as the foundation model for GasEPChat, providing a strong foundation for accurate and reliable knowledge management in natural gas E&P industry. To overcome the inherent limitations of LLMs, including hallucinations, outdated knowledge, and data security concerns, we leveraged RAG technology to enhance the model's knowledge management capabilities. By integrating RAG, GasEPChat can tap into a vast, curated knowledge base and generate responses that are based on actual data, reducing the risk of hallucinations and ensuring the accuracy of the information provided. Through rigorous quantitative evaluation, we demonstrated significant performance improvements, confirming that GasEPChat, enhanced with fine-tuning and RAG, can serve as a trusted AI assistant for natural gas geoscientists and production engineers, streamlining their workflows and enhancing their productivity. This pioneering study introduces the first application of LLM technology to natural gas exploration and production knowledge management, leveraging fine-tuning and RAG to enhance performance. Fine-tuning allows the model to acquire natural gas knowledge, mitigating hallucination issues. The integration of RAG significantly amplifies the capabilities of GasEPChat, increasing the mean accuracy of knowledge answering from 36% to 64%. This substantial improvement enables GasEPChat to serve as a reliable AI assistant in the natural gas industry. The study's findings offer valuable insights for the practical application of LLMs in other vertical industries.
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction distillée sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.
Scores Codex et Gemma par catégorie
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,000 | 0,000 |
| Méta-épidémiologie (sens strict) | 0,000 | 0,000 |
| Méta-épidémiologie (sens large) | 0,000 | 0,000 |
| Bibliométrie | 0,001 | 0,001 |
| Études des sciences et des technologies | 0,000 | 0,000 |
| Communication savante | 0,000 | 0,000 |
| Science ouverte | 0,000 | 0,000 |
| Intégrité de la recherche | 0,000 | 0,000 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,000 | 0,000 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; un appel candidat d’une seule tête enseignante, pas un consensus.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».