A Physics-Constrained TD3 Algorithm for Simultaneous Virtual Inertia and Damping Control of Grid-Connected Variable Speed DFIG Wind Turbines
Bibliographic record
Abstract
This paper proposed a physics-constrained twin delayed deep deterministic policy gradient (TD3) algorithm for simultaneous virtual inertia and damping control of a grid-connected variable speed doubly-fed induction generator (DFIG) wind turbine using a combined deep reinforcement learning (DRL) and quadratic programming as a novel solution to suppress frequency fluctuations caused by the control mechanism which decouples the active power from the system frequency, thus hiding the rotating kinetic energy of the wind generator. The optimization stage modifies the action of the DRL agent, thus preventing the agent from taking certain unsafe actions. We tested the effectiveness of the proposed scheme under various scenarios through simulations on an IEEE 9-bus test system in MATLAB/Simulink. Compared with other virtual inertia controls, the results show that the proposed scheme achieved improved dynamic performance with the lowest system frequency deviation and fastest frequency recovery under wind and load variations and severe grid faults. A further test on the IEEE 39-bus system shows that the grid size does not affect the performance of our proposed technique.Note to Practitioners—Integrating the wind turbine systems into the utility grid results in power quality problems such as frequency fluctuation, voltage dip, power loss, and severe power outages. The unpredictability and uncontrollability of the wind pose a serious problem in integrating wind energy conversion systems. This problem becomes worse with the increasing number of connected wind turbines. Therefore, new control strategies are required to mitigate this issue. The droop-based virtual and damping control method traditionally provides frequency support in grid-tied wind turbine systems. However, the fixed droop gain is a significant drawback of this method. In this paper, we proposed a novel physics-constrained deep-reinforcement learning-based virtual inertial and damping control. The proposed control agent is constrained from unsafe actions and rewarded for maintaining the grid frequency within operational limits. Simulation results with the IEEE 9 bus system validated the feasibility and effectiveness of our proposed approach. A comparison of our method with the conventional control scheme, adaptive droop-based virtual inertia control, etc., carried out under various operational scenarios verified the enhanced performance of our proposed strategy.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.000 | 0.001 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.001 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.002 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".