Adaptive Deep Reinforcement Learning for Coordinated Voltage Control in PV-Rich Distribution Grids

Tarun Kumar ModiDepartment of Electrical Engineering, Sardar Patel University, Balaghat, IndiaNaresh SapateDepartment of Electrical Engineering, Sardar Patel University, Balaghat, IndiaShailendra TurkerDepartment of Electrical Engineering, Sardar Patel University, Balaghat, India

Vol 10 No 5 (2026): Volume 10, Issue 5, May 2026 | Pages: 736-743

International Research Journal of Innovations in Engineering and Technology

OPEN ACCESS | Research Article | Published Date: 31-05-2026

doi Logo doi.org/10.47001/IRJIET/2026.105099

Abstract

The increasing integration of photovoltaic (PV) systems into distribution networks has introduced significant challenges related to voltage regulation, reverse power flow, and power quality. Traditional voltage control methods, which rely on rule-based logic or centralized optimization, often fail to address the dynamic and stochastic nature of PV generation. This paper proposes an adaptive deep reinforcement learning (DRL) framework for coordinated voltage control in PV-rich distribution grids. The proposed method employs a Deep Deterministic Policy Gradient (DDPG) algorithm that learns optimal control policies by interacting with the distribution network environment. The DRL agent coordinates multiple voltage regulation devices, including smart inverters, on-load tap changers (OLTCs), and capacitor banks, to maintain voltage within acceptable limits while minimizing network losses and control actions. The framework incorporates an adaptive mechanism that adjusts the learning process based on changing network conditions, seasonal variations, and PV output patterns. Simulation results on a modified IEEE 33-bus distribution system demonstrate that the proposed approach outperforms conventional methods in terms of voltage profile improvement, loss reduction, and computational efficiency.

Keywords

Deep reinforcement learning, voltage control, photovoltaic systems, distribution networks, smart inverters, DDPG algorithm.


Citation of this Article

Tarun Kumar Modi, Naresh Sapate, & Shailendra Turker. (2026). Impact of Exogenous Variables on Short-Term Electricity Price Forecasting Accuracy: A Deep Learning Approach Using CNN-LSTM Networks in the Indian Energy Exchange. International Research Journal of Innovations in Engineering and Technology - IRJIET, 10(5), 736-743.

References
International Energy Agency, “World Energy Outlook 2023,” IEA Publications, Paris, 2023.

R. Tonkoski, D. Turcotte, and T. H. M. El-Fouly, “Impact of high PV penetration on voltage profiles in residential neighborhoods,” IEEE Trans. Sustain. Energy, vol. 3, no. 3, pp. 518–527, Jul. 2012.

M. E. Baran and I. M. El-Markabi, “A multiagent-based dispatching scheme for distributed generators for voltage support on distribution feeders,” IEEE Trans. Power Syst., vol. 22, no. 1, pp. 52–59, Feb. 2007.

K. Turitsyn, P. Sulc, S. Backhaus, and M. Chertkov, “Options for control of reactive power by distributed photovoltaic generators,” Proc. IEEE, vol. 99, no. 6, pp. 1063–1073, Jun. 2011.

H. Zhu and H. J. Liu, “Fast local voltage control under limited reactive power: Optimality and stability analysis,” IEEE Trans. Power Syst., vol. 31, no. 5, pp. 3794–3803, Sep. 2016.

R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, 2nd ed. Cambridge, MA, USA: MIT Press, 2018.

V. Mnih et al., “Human-level control through deep reinforcement learning,” Nature, vol. 518, no. 7540, pp. 529–533, Feb. 2015.

Q. Yang, G. Wang, A. Sadeghi, G. B. Giannakis, and J. Sun, “Two-timescale voltage control in distribution grids using deep reinforcement learning,” IEEE Trans. Smart Grid, vol. 11, no. 3, pp. 2313–2323, May 2020.

J. H. Harlow, “Transformer tap changing under load: A review of concepts and standards,” in Proc. IEEE PES Transm. Distrib. Conf., 2012, pp. 1–6.

S. Civanlar, J. J. Grainger, H. Yin, and S. S. H. Lee, “Distribution feeder reconfiguration for loss reduction,” IEEE Trans. Power Del., vol. 3, no. 3, pp. 1217–1223, Jul. 1988.

IEEE Standard 1547-2018, “IEEE Standard for Interconnection and Interoperability of Distributed Energy Resources with Associated Electric Power Systems Interfaces,” IEEE, 2018.

P. Jahangiri and D. C. Aliprantis, “Distributed Volt/VAr control by PV inverters,” IEEE Trans. Power Syst., vol. 28, no. 3, pp. 3429–3439, Aug. 2013.

Y. P. Agalgaonkar, B. C. Pal, and R. A. Jabr, “Distribution voltage control considering the impact of PV generation on tap changers and autonomous regulators,” IEEE Trans. Power Syst., vol. 29, no. 1, pp. 182–192, Jan. 2014.

R. Yan and T. K. Saha, “Investigation of voltage stability for residential customers due to high photovoltaic penetrations,” IEEE Trans. Power Syst., vol. 27, no. 2, pp. 651–662, May 2012.

S. H. Low, “Convex relaxation of optimal power flow—Part I: Formulations and equivalence,” IEEE Trans. Control Netw. Syst., vol. 1, no. 1, pp. 15–27, Mar. 2014.

A.Kulmala, S. Repo, and P. J¨arventausta, “Coordinated voltage control in distribution networks including several distributed energy resources,” IEEE Trans. Smart Grid, vol. 5, no. 4, pp. 2010–2020, Jul. 2014.

E. Dall’Anese, H. Zhu, and G. B. Giannakis, “Distributed optimal power flow for smart microgrids,” IEEE Trans. Smart Grid, vol. 4, no. 3, pp. 1464–1475, Sep. 2013.

Y. Y. Hsu and C. C. Su, “Dispatch of direct load control using dynamic programming,” IEEE Trans. Power Syst., vol. 6, no. 3, pp. 1056–1061, Aug. 1991.

Z. Wan, H. Li, and H. He, “Residential energy management with deep reinforcement learning,” in Proc. Int. Joint Conf. Neural Netw., 2018, pp. 1–8.

T. P. Lillicrap et al., “Continuous control with deep reinforcement learning,” arXiv preprint arXiv:1509.02971, 2015.

J. Cao, D. Harrold, Z. Fan, T. Sheridan, and J. Sheridan, “Deep reinforcement learning-based energy storage arbitrage,” IEEE Trans. Smart Grid, vol. 11, no. 5, pp. 4513–4521, Sep. 2020.

W. Wang et al., “Safe off-policy deep reinforcement learning algorithm for Volt-VAR control,” IEEE Trans. Smart Grid, vol. 11, no. 4, pp. 3008–3018, Jul. 2020.

Y. Zhang, X. Wang, J. Wang, and Y. Zhang, “Deep reinforcement learning based Volt-VAR optimization,” IEEE Trans. Smart Grid, vol. 12, no. 1, pp. 361–371, Jan. 2021.

M. E. Baran and F. F. Wu, “Network reconfiguration in distribution systems for loss reduction and load balancing,” IEEE Trans. Power Del., vol. 4, no. 2, pp. 1401–1407, Apr. 1989.