Dual-timescale Active and Reactive Power Coordinated Optimization for Active Distribution Network Based on Data-driven and Physical Model

ZHANG Jian; CUI Mingjian; YAO Xiaoyi; HE Yigang

doi:10.7500/AEPS20221215004

您当前的位置：

首页 >

文章列表页 >

Dual-timescale Active and Reactive Power Coordinated Optimization for Active Distribution Network Based on Data-driven and Physical Model

Basic Research | 更新时间：2025-06-16

- Dual-timescale Active and Reactive Power Coordinated Optimization for Active Distribution Network Based on Data-driven and Physical Model
- Automation of Electric Power Systems Vol. 47, Issue 20, Pages: 64-71(2023)
- 作者机构：
  
  1.合肥工业大学电气与自动化工程学院,安徽省合肥市 230009
  2.天津大学电气自动化与信息工程学院,天津市 300072
  3.国网安徽省电力有限公司蚌埠供电公司,安徽省蚌埠市 233000
  4.武汉大学电气与自动化学院,湖北省武汉市 430072
- 作者简介：
- 基金信息：
  
  National Natural Science Foundation of China(52207130)
- DOI：10.7500/AEPS20221215004
  CLC：
- Received：15 December 2022，
  
  Revised：2023-04-27，
  
  Published Online：25 August 2023，
  
  Published：25 October 2023
- 稿件说明：
移动端阅览
张剑,崔明建,姚潇毅等.基于数据驱动与物理模型的主动配电网双时间尺度协调优化[J].电力系统自动化,2023,47(20):64-71.

ZHANG Jian,CUI Mingjian,YAO Xiaoyi,et al.Dual-timescale Active and Reactive Power Coordinated Optimization for Active Distribution Network Based on Data-driven and Physical Model[J].Automation of Electric Power Systems,2023,47(20):64-71.
张剑,崔明建,姚潇毅等.基于数据驱动与物理模型的主动配电网双时间尺度协调优化[J].电力系统自动化,2023,47(20):64-71. DOI： 10.7500/AEPS20221215004.

ZHANG Jian,CUI Mingjian,YAO Xiaoyi,et al.Dual-timescale Active and Reactive Power Coordinated Optimization for Active Distribution Network Based on Data-driven and Physical Model[J].Automation of Electric Power Systems,2023,47(20):64-71. DOI： 10.7500/AEPS20221215004.

摘要

高比例间歇性分布式电源与电动汽车接入配电网时，容易导致功率与电压频繁、快速、剧烈波动。文中结合数据驱动与物理建模方法，提出了一种配电网双时间尺度有功无功协调优化策略。针对短时间尺度（分钟级或秒级）的功率波动，以静止无功补偿器、分布式电源无功功率为决策变量，以网损最小为目标函数，计及物理约束，针对平衡与不平衡配电网分别构建了二阶锥与二次规划模型。针对长时间尺度（小时级）的优化，以有载调压变压器分接头变比、可投切电容电抗器挡位、储能系统充放电功率为动作，以网损为代价，计及节点电压越限惩罚，构建了马尔可夫决策过程。为克服连续-离散动作空间维数灾，采用一种基于松弛-预报-校正的深度确定性策略梯度强化学习求解算法。通过IEEE 33节点与IEEE 123节点配电系统验证了所提方法的有效性。

Abstract

When a high proportion of intermittent distributed generators (DGs) and electric vehicles are connected to the distribution network

it is easy to cause frequent

fast and dramatic fluctuations in power and voltage. This paper combines both the data-driven and physical modeling approaches to propose a coordinated optimal strategy for dual-timescale active and reactive power in distribution networks. For the short-timescale (minute or second) power fluctuations

a second-order cone programming (SOCP) model and a quadratic programming model are constructed for balanced and unbalanced distribution networks

respectively

with static var compensator (SVC) and reactive power of DG as decision variables and network loss minimization as the objective function

taking into account physical constraints. For the long-timescale (hour scale) optimization

the Markov decision process (MDP) is constructed with the tap ratio of on-load transformer changers (OLTCs)

the tap position of switchable capacitors reactors (SCRs)

and the charging/discharging power of energy storage systems (ESSs) as the actions

network loss as the cost

taking into account the crossing penalty of bus voltage. To overcome dimension curses in continuous-discrete action space

this paper uses a relaxation-prediction-correction based deep deterministic policy gradient (DDPG) reinforcement learning algorithm. The effectiveness of the proposed method is verified by IEEE 33-bus and IEEE 123-bus distribution systems.

关键词

Keywords

references

ZHANG J ， CUI M J ， HE Y G ， et al . Multi-period two-stage robust optimization of radial distribution system with cables considering time-of-use price ［J］. Journal of Modern Power Systems and Clean Energy ， 2023 ， 11 （ 1 ）： 312 - 323 .

王枭，何怡刚，马恒瑞，等 . 考虑规模化储能的配电网电压分布式控制［J］. 电力自动化设备， 2022 ， 42 （ 2 ）： 25 - 30 .

WANG Xiao ， HE Yigang ， MA Hengrui ， et al . Distributed voltage control of distribution network considering large-scale energy storage ［J］. Electric Power Automation Equipment ， 2022 ， 42 （ 2 ）： 25 - 30 .

刘其辉，逄思敏，吴林林，等 . 大规模风电汇集系统电压不平衡机理、因素及影响规律［J］. 电工技术学报， 2022 ， 37 （ 21 ）： 5435 - 5450 .

LIU Qihui ， PANG Simin ， WU Linlin ， et al . The mechanism， factors and influence rules of voltage imbalance in wind power integration areas ［J］. Transactions of China Electrotechnical Society ， 2022 ， 37 （ 21 ）： 5435 - 5450 .

徐博涵，向月，潘力，等 . 基于深度强化学习的含高比例可再生能源配电网就地分散式电压管控方法［J］. 电力系统保护与控制， 2022 ， 50 （ 22 ）： 100 - 109 .

XU Bohan ， XIANG Yue ， PAN Li ， et al . Local decentralized voltage management of a distribution network with a high proportion of renewable energy based on deep reinforcement learning ［J］. Power System Protection and Control ， 2022 ， 50 （ 22 ）： 100 - 109 .

冯昌森，张瑜，谢路耀，等 . 配电系统双时间尺度电压管理的深度强化学习方法［J］. 电力系统自动化， 2022 ， 46 （ 12 ）： 202 - 209 .

FENG Changsen ， ZHANG Yu ， XIE Luyao ， et al . Deep reinforcement learning approach for dual-timescale voltage management in distribution system ［J］. Automation of Electric Power Systems ， 2022 ， 46 （ 12 ）： 202 - 209 .

习伟，李鹏，李鹏，等 . 基于深度强化学习的分布式电源就地自适应电压控制方法［J］. 电力系统自动化， 2022 ， 46 （ 22 ）： 25 - 31 .

XI Wei ， LI Peng ， LI Peng ， et al . Adaptive local voltage control method for distributed generator based on deep reinforcement learning ［J］. Automation of Electric Power Systems ， 2022 ， 46 （ 22 ）： 25 - 31 .

蒲天骄，杜帅，李烨，等 . 面向隐私保护基于联邦强化学习的分布式电源协同优化策略［J］. 电力系统自动化， 2023 ， 47 （ 8 ）： 62 - 70 .

PU Tianjiao ， DU Shuai ， LI Ye ， et al . Collaborative optimization strategy of distributed generators based on federated reinforcement learning for privacy preservation ［J］. Automation of Electric Power Systems ， 2023 ， 47 （ 8 ）： 62 - 70 .

胡丹尔，彭勇刚，韦巍，等 . 多时间尺度的配电网深度强化学习无功优化策略［J］. 中国电机工程学报， 2022 ， 42 （ 14 ）： 5034 - 5044 .

HU Daner ， PENG Yonggang ， WEI Wei ， et al . Multi-time scale reactive power optimization strategy for deep reinforcement learning in distribution network ［J］. Proceedings of the CSEE ， 2022 ， 42 （ 14 ）： 5034 - 5044 .

WANG W ， YU N P ， SHI J ， et al . Volt-var control in power distribution systems with deep reinforcement learning ［C］// 2019 IEEE International Conference on Communications， Control， and Computing Technologies for Smart Grids （SmartGridComm）， October 21-23 ， 2019 ， Beijing， China ： 1 - 7 .

XU H C ， DOMÍNGUEZ-GARCÍA A D ， SAUER P W . Optimal tap setting of voltage regulation transformers using batch reinforcement learning ［J］. IEEE Transactions on Power Systems ， 2020 ， 35 （ 3 ）： 1990 - 2001 .

AL-SAFFAR M ， MUSILEK P . Reinforcement learning-based distributed BESS management for mitigating overvoltage issues in systems with high PV penetration ［J］. IEEE Transactions on Smart Grid ， 2020 ， 11 （ 4 ）： 2980 - 2994 .

李琦，乔颖，张宇精 . 配电网持续无功优化的深度强化学习方法［J］. 电网技术， 2020 ， 44 （ 4 ）： 1473 - 1480 .

LI Qi ， QIAO Ying ， ZHANG Yujing . Deep reinforcement learning method for continuous reactive power optimization of distribution network ［J］. Power System Technology ， 2020 ， 44 （ 4 ）： 1473 - 1480 .

WANG W ， YU N P ， GAO Y Q ， et al . Safe off-policy deep reinforcement learning algorithm for volt-var control in power distribution systems ［J］. IEEE Transactions on Smart Grid ， 2020 ， 11 （ 4 ）： 3008 - 3018 .

CAO D ， HU W H ， ZHAO J B ， et al . A multi-agent deep reinforcement learning based voltage regulation using coordinated PV inverters ［J］. IEEE Transactions on Power Systems ， 2020 ， 35 （ 5 ）： 4120 - 4123 .

倪爽，崔承刚，杨宁，等 . 基于深度强化学习的配电网多时间尺度在线无功优化［J］. 电力系统自动化， 2021 ， 45 （ 10 ）： 77 - 85 .

NI Shuang ， CUI Chenggang ， YANG Ning ， et al . Multi-time-scale online optimization for reactive power of distribution network based on deep reinforcement learning ［J］. Automation of Electric Power Systems ， 2021 ， 45 （ 10 ）： 77 - 85 .

ZHANG Y ， WANG X N ， WANG J H ， et al . Deep reinforcement learning based volt-var optimization in smart distribution systems ［J］. IEEE Transactions on Smart Grid ， 2021 ， 12 （ 1 ）： 361 - 371 .

刘朝阳，穆朝絮，孙长银 . 深度强化学习算法与应用研究现状综述［J］. 智能科学与技术学报， 2020 ， 2 （ 4 ）： 314 - 326 .

LIU Zhaoyang ， MU Chaoxu ， SUN Changyin . An overview on algorithms and applications of deep reinforcement learning ［J］. Chinese Journal of Intelligent Science and Technology ， 2020 ， 2 （ 4 ）： 314 - 326 .

孙长银，穆朝絮 . 多智能体深度强化学习的若干关键科学问题［J］. 自动化学报， 2020 ， 46 （ 7 ）： 1301 - 1312 .

SUN Changyin ， MU Chaoxu . Important scientific problems of multi-agent deep reinforcement learning ［J］. Acta Automatica Sinica ， 2020 ， 46 （ 7 ）： 1301 - 1312 .

ZHANG L ， WANG G ， GIANNAKIS G B . Real-time power system state estimation and forecasting via deep unrolled neural networks ［J］. IEEE Transactions on Signal Processing ， 2019 ， 67 （ 15 ）： 4069 - 4077 .

DULAC-ARNOLD G ， EVANS R ， HASSELT H V ， et al . Deep reinforcement learning in large discrete action spaces ［EB/OL］. ［ 2022-12-15 ］. https：//arxiv.org/abs/1512.07679 https://arxiv.org/abs/1512.07679 .

MUJA M ， LOWE D G . Scalable nearest neighbor algorithms for high dimensional data ［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence ， 2014 ， 36 （ 11 ）： 2227 - 2240 .

ZHANG J ， CUI M J ， LI B ， et al . Fast solving method based on linearized equations of branch power flow for coordinated charging of EVs （EVCC）［J］. IEEE Transactions on Vehicular Technology ， 2019 ， 68 （ 5 ）： 4404 - 4418 .

ZHANG J ， CUI M J ， HE Y G . Multi-period fast robust optimization for partial distributed generators （DGs） providing ancillary services ［J］. Energies ， 2021 ， 14 （ 16 ）： 4911 .

ZHANG J ， HE Y G . Fast solving method for two-stage multi-period robust optimization of active and reactive power coordination in active distribution networks ［J］. IEEE Access ， 2022 ， 11 ： 30208 - 30222 .

DING T ， LIU S Y ， YUAN W ， et al . A two-stage robust reactive power optimization considering uncertain wind power integration in active distribution networks ［J］. IEEE Transactions on Sustainable Energy ， 2016 ， 7 （ 1 ）： 301 - 311 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Voltage Regulation Strategy for Active Distribution Network Based on Multi-agent Deep Reinforcement Learning

Coordinated Optimal Scheduling of Transmission and Distribution Networks Based on Multiple Agents and Improved Target Cascading Method

Voltage Control for Active Distribution Network Based on Bayesian Deep Reinforcement Learning

Coordinated Optimization of Active Distribution Network Based on Deep Deterministic Policy Gradient Algorithm

Related Author

HUANG Yu

ZHANG Xiaoxiao

YUE Dong

HU Songlin

WANG Juan

LI Zhukun

JI Xingquan

SUN Chenhao

Related Institution

Institute of Advanced Technology for Carbon Neutrality, Nanjing University of Posts and Telecommunications

NARI Technology Co., Ltd.

College of Electrical Engineering and Automation, Shandong University of Science and Technology

Key Laboratory of Power System Intelligent Dispatch and Control of Ministry of Education (Shandong University)

College of Energy Storage Technology, Shandong University of Science and Technology

⁰