Reinforcement Learning based Proactive Control for Enabling Power Grid Resilience to Wildfire

January 2024·
Salah Uddin Kadir
Salah Uddin Kadir
,
Subir Majumder
,
Anurag Srivastava
,
Ajay Chokra
,
Himanshu Neema
,
Abhishek Dubey
Aron Laszka
Aron Laszka
Abstract
Industrial electric power grid operation subject to an extreme event requires decision making by human operators under stressful conditions. Decision making using system data informatics under adverse dynamic events, especially if forecasted, should be supplemented by intelligent proactive control. Power transmission system operation during wildfires requires resiliency-driven proactive control for load shedding, line switching, and resource allocation considering the dynamics of the wildfire and failure propagation to minimize the impact on the system. However, the possible number of line and load switching in an extensive industrial system during an event make the traditional prediction-driven and stochastic approaches computationally intractable, leading operators to often use preplanned or greedy algorithms. In this article, we model and solve the proactive control problem as a Markov decision process (MDP) and introduce an integrated testbed for spatiotemporal wildfire propagation and proactive power-system operation. Our approach allows the controller to provide setpoints for all generation fleets in the power grid. We evaluate our approach utilizing the IEEE test system mapped onto a hypothetical terrain. Our results show that the proposed approach can help the operator to reduce load outage during an extreme event. It reduces power flow through lines that are to be de-energized and adjusts the load demand by increasing power flow through other lines.
Type
Venue
IEEE Transactions on Industrial Informatics, 20(1), 795–805
publications

Impact Factor: 11.7

Authors

Salah Uddin Kadir
Ph.D. 2023
Salah Uddin joined the department of Computer Science at the University of Houston as a Ph.D. student in fall 2018 and started working in the Resilient Networks and Systems Lab in spring 2020. He defended his Ph.D. dissertation in 2023. Earlier, he graduated with a Bachelors’s Degree in Computer Science and Engineering from Daffodil International University, Bangladesh. He graduated first in his class (highest CGPA in class). He worked as a Software engineer at Eyeball Networks Inc. and IPvision Canada Inc. from 2014 to 2018. He mainly worked with VoIP and messaging protocols like STUN, TURN, XMPP servers, and client-side SDKs. His research interest includes cybersecurity and artificial intelligence. Currently, his research work focuses on IoT Remote Attestation, which includes exploring IoT vulnerabilities and attack detection.
Aron Laszka
Associate Professor

Aron Laszka is an Associate Professor in the College of Information Sciences and Technology at the Pennsylvania State University. Previously, he was an Assistant Professor at the University of Houston, a Research Assistant Professor at Vanderbilt University, and a Postdoctoral Scholar at the University of California, Berkeley.

His research interests revolve around artificial intelligence and cyber-physical systems, focusing on machine learning for decision making and optimization, with applications in smart and connected communities, critical infrastructure, and cybersecurity.

His research is funded by the National Science Foundation, the Department of Energy, the Department of Transportation, and other agencies.