论文标题
基于增强学习的微电网控制算法的渗透测试
Reinforcement Learning Based Penetration Testing of a Microgrid Control Algorithm
论文作者
论文摘要
微电网(MGS)是小型电源系统,它们在明确定义的区域内互连分布式能源和负载。但是,由于有能力的对手的网络攻击,在MG中使用的数字基础架构可能会损害。 MG操作员有兴趣了解其系统中的固有漏洞,并应定期执行渗透测试(PT)活动以为此类事件做准备。 PT通常涉及在软件和硬件基础架构中寻找防御性覆盖的盲点,但是在PT活动中也应考虑对控制算法的逻辑。本文展示了通过使用增强学习(RL)揭示损害控制器有效性的恶意输入的PT案例研究,用于MG控制算法。通过与模拟MG的反复试验性发作相互作用,我们训练RL代理以发现恶意输入,从而降低了MG控制器的有效性。
Microgrids (MGs) are small-scale power systems which interconnect distributed energy resources and loads within clearly defined regions. However, the digital infrastructure used in an MG to relay sensory information and perform control commands can potentially be compromised due to a cyberattack from a capable adversary. An MG operator is interested in knowing the inherent vulnerabilities in their system and should regularly perform Penetration Testing (PT) activities to prepare for such an event. PT generally involves looking for defensive coverage blindspots in software and hardware infrastructure, however the logic in control algorithms which act upon sensory information should also be considered in PT activities. This paper demonstrates a case study of PT for an MG control algorithm by using Reinforcement Learning (RL) to uncover malicious input which compromises the effectiveness of the controller. Through trial-and-error episodic interactions with a simulated MG, we train an RL agent to find malicious input which reduces the effectiveness of the MG controller.