Overview of the Application of Neuroevolution and Genetic Algorithms in the Control of Power Grids with Renewable Energy
A. Alarcón(1), N. Lapuente(1), N. Galan(1), A. Talayero(1) and V. Lacerda(2) 1. CIRCE Foundation: Parque Empresarial Dinamiza, Zaragoza (Spain) 2 ETSEIB (CITCEA-UPC), Barcelona (Spain) 2026-02-15

Abstract

The integration of renewable energy sources intoelectrical grids introduces significant challenges, particularly in ensuring stability and reliability in dynamic, nonlinear environments. These sources create fluctuations, uncertainties, and voltage regulation issues that traditional control systems struggle to manage, compromising the grid’s ability to deliver a stable power supply. Addressing these challenges requires advanced, adaptive control solutions capable of responding to the variable nature of renewable energy.

This article explores advanced techniques, focusing on reinforcement learning and Neuroevolution, to develop innovative control strategies for electrical systems. Neuroevolution, which combines neural networks with evolutionary algorithms, optimizes control without relying on gradient-based methods, making it suitable for complex, unpredictable scenarios. These approaches enhance grid stability, improve response times, and enable real-time anomaly detection and corrective actions, offering a resilient and efficient solution to the limitations of traditional control methods.

Key words: Renewable energy integration, Reinforcement learning, Neuroevolution, Electrical grid stability, Control systems.

References

[1] P. I. N. Barbalho, V. A. Lacerda, R. A. S. Fernandes, and D. V. Coury, “Deep reinforcement learning-based secondary control for microgrids in islanded mode,” Electric Power Systems Research, vol. 212, Nov. 2022, doi: 10.1016/j.epsr.2022.108315.

[2] Y. Gao, N. Yu, and S. Member, “Deep Reinforcement Learning in Power Distribution Systems: Overview, Challenges, and Opportunities.”

[3] B. L. Thayer and T. J. Overbye, “Deep Reinforcement Learning for Electric Transmission Voltage Control,” Jun. 2020, [Online]. Available: http://arxiv.org/abs/2006.06728

[4] H. van Hasselt, A. Guez, and D. Silver, “Deep Reinforcement Learning with Double Q-learning,” Sep. 2015, [Online]. Available: http://arxiv.org/abs/1509.06461

[5] M. Ángel, C. Quevedo, and F. G. Donoso, “Escuela Politécnica Superior Algoritmos genéticos para conducción autónoma,” 2023.

[6] B. Shabash and K. C. Wiese, “EvoNN - A customizable evolutionary neural network with heterogenous activation functions,” in GECCO 2018 Companion - Proceedings of the 2018 Genetic and Evolutionary Computation Conference Companion, Association for Computing Machinery, Inc, Jul. 2018, pp. 1449–1456. doi: 10.1145/3205651.3208282.

[7] F. Zúbek, M. Ernek, I. Kenický, and I. Sekaj, “Neuro-Evolution of Frequency Controllers in the Power-Electricity System Island,” in IFAC-PapersOnLine, Elsevier B.V., Jun. 2024, pp. 49–54. doi: 10.1016/j.ifacol.2024.07.370.

[8] S. Gadgil, Y. Xin, and C. Xu, “Solving The Lunar Lander Problem under Uncertainty using Reinforcement Learning,” Nov. 2020, [Online]. Available: http://arxiv.org/abs/2011.11850

[9] A. Khan, Y. Wang, S. Khan, I. Khan, and M. Sajjad, “Genetic algorithm-based optimization for power system operation: case study on a multi-bus network,” International Journal of Advances in Electrical Engineering, vol. 5, no. 1, pp. 76–85, Jan. 2024, doi: 10.22271/27084574.2024.v5.i1a.56.

[10] A. Munozã and F. Rubio, “Evaluating Genetic Algorithms through the Approximability Hierarchy 1.”

[11] A. Dukkipati, M. Narasimha Murty, and S. Bhatnagar, “Cauchy Annealing Schedule: An Annealing Schedule for Boltzmann Selection Scheme in Evolutionary Algorithms,” 2004.

[12] H. Verdejo, V. Pino, W. Kliemann, C. Becker, and J. Delpiano, “Implementation of particle swarm optimization (PSO) algorithm for tuning of power system stabilizers in multimachine electric power systems,” Energies (Basel), vol. 13, no. 8, Apr. 2020, doi: 10.3390/en13082093.

[13] M. Ángel, C. Quevedo, and F. G. Donoso, “Escuela Politécnica Superior Algoritmos genéticos para conducción autónoma,” 2023.

[14] J. Kennedy, R. Eberhart, and bls gov, “Particle Swarm Optimization.”