论文标题

批发能源和辅助服务市场中的风力和能源存储协调的深入强化学习

Deep Reinforcement Learning for Wind and Energy Storage Coordination in Wholesale Energy and Ancillary Service Markets

论文作者

Li, Jinhao, Wang, Changlong, Wang, Hao

论文摘要

风能越来越多地采用以减轻气候变化。但是,风能的可变性会导致风力减少,从而造成了风电场所有者的大量经济损失。可以使用电池能量存储系统(BES)作为现场备用来源来减少限制。然而,这种辅助作用可能会大大削弱贝斯在能源交易中的经济潜力。理想的BESS计划应平衡现场减少降低和市场招标,但是由于协调复杂性以及能源价格和发电的随机性质,实践实施是具有挑战性的。我们调查了现场共同确定的风票系统的联合市场招标策略,并调节频率控制辅助服务市场。我们提出了一种基于深厚的深入学习方法,将系统的市场参与分为每个设施的两个相关的马尔可夫决策过程,从而使Bess能够吸收现场风力减少,同时进行联合市场竞标,以最大程度地提高整体运营收入。使用现实的风电场数据,我们验证了协调的招标策略,其结果超过了基于优化的基准,即较高的收入约为25 \%,减少了2.3倍。我们的结果表明,与分别参与每个市场相比,联合市场竞标可以显着改善风投入系统的财务绩效。模拟还表明,使用限制的风发电作为向贝斯收取的电源,可能会带来额外的财务收益。我们的算法的成功实施将鼓励共同设置发电和存储资产,以释放更广泛的系统利益。

Wind energy has been increasingly adopted to mitigate climate change. However, the variability of wind energy causes wind curtailment, resulting in considerable economic losses for wind farm owners. Wind curtailment can be reduced using battery energy storage systems (BESS) as onsite backup sources. Yet, this auxiliary role may significantly weaken the economic potential of BESS in energy trading. Ideal BESS scheduling should balance onsite wind curtailment reduction and market bidding, but practical implementation is challenging due to coordination complexity and the stochastic nature of energy prices and wind generation. We investigate the joint-market bidding strategy of a co-located wind-battery system in the spot and Regulation Frequency Control Ancillary Service markets. We propose a novel deep reinforcement learning-based approach that decouples the system's market participation into two related Markov decision processes for each facility, enabling the BESS to absorb onsite wind curtailment while performing joint-market bidding to maximize overall operational revenues. Using realistic wind farm data, we validated the coordinated bidding strategy, with outcomes surpassing the optimization-based benchmark in terms of higher revenue by approximately 25\% and more wind curtailment reduction by 2.3 times. Our results show that joint-market bidding can significantly improve the financial performance of wind-battery systems compared to participating in each market separately. Simulations also show that using curtailed wind generation as a power source for charging the BESS can lead to additional financial gains. The successful implementation of our algorithm would encourage co-location of generation and storage assets to unlock wider system benefits.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源