Explainable Hybrid Deep Learning Model with Attention Mechanism for Short-Term Load Forecasting
Bibliographic record
Abstract
Effective energy forecasting is essential for optimizing electricity management, enhancing efficiency, and reducing operational costs. Traditional forecasting models often struggle to capture complex consumption patterns, limiting their reliability in real-world applications. This study introduces a hybrid deep learning model that integrates Hybrid Dilated Convolutional Neural Networks (HyDCNN) and Long Short-Term Networks (LSTNet), enhanced with a multi-head attention mechanism inspired by the Temporal Pattern Attention LSTM (TPA-LSTM). The model is designed to improve both the accuracy and interpretability of short-term load forecasting. The model was evaluated on two real-world datasets from Grenoble and New South Wales. Experimental results show that it outperforms existing deep learning methods by up to 10%, demonstrating improved forecasting accuracy over state-of-the-art models. Additionally, compared to traditional statistical models, the hybrid approach achieves improvements of up to 79.80%, highlighting its superior capability to model complex energy consumption patterns. To enhance transparency, Integrated Gradients was applied, allowing for a deeper understanding of how specific time steps and input features influence predictions. This research contributes to more reliable and explainable energy forecasting by integrating Hybrid Dilated Convolutional Neural Networks (HyDCNN) and Long Short-Term Networks (LSTNet), which together improve both forecasting accuracy and interpretability. This hybrid approach allows for better handling of short-term fluctuations and long-term dependencies, making it particularly suitable for smarter energy management strategies in applications such as smart buildings and real-time grid optimization. The novelty lies in combining high-accuracy deep learning techniques with interpretability tools, ensuring energy predictions are not only precise but also transparent for real-world decision-making. Furthermore, insights gained from this study can aid in the development of scalable forecasting models applicable to diverse energy management scenarios, including grid stability, demand-side response, and operational optimization in electricity markets.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.000 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.001 | 0.000 |
| Scholarly communication | 0.000 | 0.001 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".