JIN Zongshuai,ZHANG Hengxu.Fast and Robust Regression Smoothing Denoising of Power System Measurement Data with Strong Noise[J].Automation of Electric Power Systems,2023,47(3):169-176.
JIN Zongshuai,ZHANG Hengxu.Fast and Robust Regression Smoothing Denoising of Power System Measurement Data with Strong Noise[J].Automation of Electric Power Systems,2023,47(3):169-176. DOI: 10.7500/AEPS20211214005.
Fast and Robust Regression Smoothing Denoising of Power System Measurement Data with Strong Noise
For the problem that the measurement data in the power system is seriously polluted by noise
a fast robust regression smoothing denoising method is proposed. First
the background noise is suppressed by the local regression smoothing process. And then the outlier data is detected adaptively according to the global smoothing residual. Finally
the outlier data is denoised by the robust regression smoothing process
and the local smoothing distortions caused by the outlier data are repaired.The proposed method realizes the fast regression smoothing of global data
the adaptive detection of random impulsive noise and the fast repair of local smoothing distortions
which greatly reduces the computational complexity. The simulation analysis and the field measurement data analysis show that
compared with the traditional robust local regression smoothing method
the proposed method not only maintains a good denoising ability against the background noise and the high-intensity random impulsive noise
but also can effectively identify the pseudo impulsive noise caused by the step change due to disturbance. The proposed method improves the preservation ability of the disturbance response information
and it also shows the obvious advantage of computational efficiency.
JIA Ke , CHEN Cong , LIU Ziyi , et al . Protection of flexible DC distribution network based on single-end current transient and its setting [J]. Automation of Electric Power Systems , 2022 , 46 ( 6 ): 144 - 152 .
LI Hui , LIU Dong , YAO Danyang . Analysis and reflection on the development of power system towards the goal of carbon emission peak and carbon neutrality [J]. Proceedings of the CSEE , 2021 , 41 ( 18 ): 6245 - 6259 .
XIAO Xiangning , LIAO Kunyu , TANG Songhao , et al . Development of power-electronized distribution grids and the new supraharmonics issues [J]. Transactions of China Electrotechnical Society , 2018 , 33 ( 4 ): 707 - 720 .
DUAN Gang , YAN Yaqin , XIE Xiaodong , et al . Development status quo and tendency of wide area phasor measuring technology [J]. Automation of Electric Power Systems , 2015 , 39 ( 1 ): 73 - 80 .
ZHANG Hengxu , JIN Zongshuai , LIU Yutian . Wide-area measurement system light and its application in China [J]. Automation of Electric Power Systems , 2014 , 38 ( 22 ): 85 - 90 .
ZHANG Y C , MARKHAM P , XIA T , et al . Wide-area frequency monitoring network (FNET) architecture and applications [J]. IEEE Transactions on Smart Grid , 2010 , 1 ( 2 ): 159 - 167 .
LIU Hao , BI Tianshu , XU Quan , et al . Scheme and prospect of high-precision synchrophasor measurement technology for distribution network [J]. Automation of Electric Power Systems , 2020 , 44 ( 18 ): 23 - 29 .
WANG Fuping , LIU Shuxiang , HUANG Songling , et al . Synchrophasor measurement under bursty impulsive noise [J]. Proceedings of the CSEE , 2020 , 40 ( 5 ): 1673 - 1683 .
JIN Zongshuai , ZHANG Hengxu , SHI Fang , et al . Synchronized wideband measurement technology and its applications [J]. Proceedings of the CSEE , 2022 , 42 ( 7 ): 2497 - 2508 .
CHERNIAKOV Mikhail . An introduction to parametric digital filters and oscillators [M]. Hoboken, USA : John Wiley & Sons , 2003 .
ZHANG X M , XIONG Y L . Impulse noise removal using directional difference based noise detector and adaptive weighted mean filter [J]. IEEE Signal Processing Letters , 2009 , 16 ( 4 ): 295 - 298 .
AYSAL T C , BARNER K E . Generalized mean-median filtering for robust frequency-selective applications [J]. IEEE Transactions on Signal Processing , 2007 , 55 ( 3 ): 937 - 948 .
ARCE G R . A general weighted median filter structure admitting negative weights [J]. IEEE Transactions on Signal Processing , 1998 , 46 ( 12 ): 3195 - 3205 .
QU Zhenggeng , NIU Shaoqing . Research on an improved adaptive weighted median filtering algorithm [J]. Computer Technology and Development , 2018 , 28 ( 12 ): 86 - 90 .
CHAKHCHOUKH Y , LEI H T , JOHNSON B K . Diagnosis of outliers and cyber attacks in dynamic PMU-based power state estimation [J]. IEEE Transactions on Power Systems , 2020 , 35 ( 2 ): 1188 - 1197 .
KALLUMMIL S , KALYANI S . Noise statistics oblivious GARD for robust regression with sparse outliers [J]. IEEE Transactions on Signal Processing , 2019 , 67 ( 2 ): 383 - 398 .
MA J L , CHAN J C W , CANTERS F . Robust locally weighted regression for superresolution enhancement of multi-angle remote sensing imagery [J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing , 2014 , 7 ( 4 ): 1357 - 1371 .
GUO C L , LI X , TAULU S , et al . Real-time robust signal space separation for magnetoencephalography [J]. IEEE Transactions on Bio-Medical Engineering , 2010 , 57 ( 8 ): 1856 - 1866 .
RUCKSTUHL A F , JACOBSON M P , FIELD R W , et al . Baseline subtraction using robust local regression estimation [J]. Journal of Quantitative Spectroscopy and Radiative Transfer , 2001 , 68 ( 2 ): 179 - 193 .
CLEVELAND W S . Robust locally weighted regression and smoothing scatterplots [J]. Journal of the American Statistical Association , 1979 , 74 : 829 - 836 .
ZHANG H X , JIN Z S , TERZIJA V . An adaptive decomposition scheme for wideband signals of power systems based on the modified robust regression smoothing and Chebyshev-II IIR filter bank [J]. IEEE Transactions on Power Delivery , 2019 , 34 ( 1 ): 220 - 230 .
NURUNNABI A , WEST G , BELTON D . Robust locally weighted regression techniques for ground surface points filtering in mobile laser scanning three dimensional point cloud data [J]. IEEE Transactions on Geoscience and Remote Sensing , 2016 , 54 ( 4 ): 2181 - 2193 .
JIN Z S , ZHANG H X , SHI F , et al . A robust and adaptive detection scheme for interharmonics in active distribution network [J]. IEEE Transactions on Power Delivery , 2018 , 33 ( 5 ): 2524 - 2534 .