English
Related papers

Related papers: A Direct Classification Approach for Reliable Wind…

200 papers

To address the challenges of imbalanced multi-class datasets typically used for rare event detection in critical cyber-physical systems, we propose an optimal, efficient, and adaptable mixed integer programming (MIP) ensemble weighting…

Machine Learning · Computer Science 2025-04-16 Georgios Tertytchny , Georgios L. Stavrinides , Maria K. Michael

Random Forest is a machine learning method that offers many advantages, including the ability to easily measure variable importance. Class balancing technique is a well-known solution to deal with class imbalance problem. However, it has…

Machine Learning · Statistics 2023-12-19 Yunbi Nam , Sunwoo Han

Recent statistical postprocessing methods for wind speed forecasts have incorporated linear models and neural networks to produce more skillful probabilistic forecasts in the low-to-medium wind speed range. At the same time, these methods…

Applications · Statistics 2025-04-18 Simon Hakvoort , Bastien Francois , Kirien Whan , Sjoerd Dirksen

Class-imbalance refers to classification problems in which many more instances are available for certain classes than for others. Such imbalanced datasets require special attention because traditional classifiers generally favor the…

Machine Learning · Statistics 2018-11-30 Rafael M. O. Cruz , Robert Sabourin , George D. C. Cavalcanti

Many real-world applications reveal difficulties in learning classifiers from imbalanced data. The rising big data era has been witnessing more classification tasks with large-scale but extremely imbalance and low-quality datasets. Most of…

Machine Learning · Computer Science 2020-10-20 Zhining Liu , Wei Cao , Zhifeng Gao , Jiang Bian , Hechang Chen , Yi Chang , Tie-Yan Liu

Deep Learning methods have significantly advanced various data-driven tasks such as regression, classification, and forecasting. However, much of this progress has been predicated on the strong but often unrealistic assumption that training…

Machine Learning · Computer Science 2023-10-12 Josias Moukpe

Class imbalance in real-world data poses a common bottleneck for machine learning tasks, since achieving good generalization on under-represented examples is often challenging. Mitigation strategies, such as under or oversampling the data…

Disordered Systems and Neural Networks · Physics 2025-02-03 Emanuele Loffredo , Mauro Pastore , Simona Cocco , Rémi Monasson

Forecasting global precipitation patterns and, in particular, extreme precipitation events is of critical importance to preparing for and adapting to climate change. Making accurate high-resolution precipitation forecasts using traditional…

Machine Learning · Computer Science 2022-10-25 James Duncan , Shashank Subramanian , Peter Harrington

Wind energy is becoming an increasingly crucial component of a sustainable grid, but its inherent variability and limited predictability present challenges for grid operators. The energy sector needs novel forecasting techniques that can…

Applications · Statistics 2023-12-05 Zheng Dong , Hanyu Zhang , Shixiang Zhu , Yao Xie , Pascal Van Hentenryck

Training classifiers is difficult with severe class imbalance, but many rare events are the culmination of a sequence with much more common intermediate outcomes. For example, in online marketing a user first sees an ad, then may click on…

Methodology · Statistics 2023-05-31 Gregory Faletto , Jacob Bien

This paper studies robust event classification using imperfect real-world phasor measurement unit (PMU) data. By analyzing the real-world PMU data, we find it is challenging to directly use this dataset for event classifiers due to the low…

Machine Learning · Computer Science 2021-10-20 Yunchuan Liu , Lei Yang , Amir Ghasemkhani , Hanif Livani , Virgilio A. Centeno , Pin-Yu Chen , Junshan Zhang

Predictions of the uncertainty associated with extreme events are a vital component of any prediction system for such events. Consequently, the prediction system ought to be probabilistic in nature, with the predictions taking the form of…

Applications · Statistics 2012-10-26 Petra Friederichs , Thordis L. Thorarinsdottir

Accurate forecasting is critical for reliable power grid operations, particularly as the share of renewable generation, such as wind and solar, continues to grow. Given the inherent uncertainty and variability in renewable generation,…

Applications · Statistics 2025-10-20 Alireza Moradi , Mathieu Tanneau , Reza Zandehshahvar , Pascal Van Hentenryck

Class imbalance induces systematic bias in deep neural networks by imposing a skewed effective class prior. This work introduces the Neural Prior Estimator (NPE), a framework that learns feature-conditioned log-prior estimates from latent…

Machine Learning · Computer Science 2026-02-23 Masoud Yavari , Payman Moallem

Rare event prediction involves identifying and forecasting events with a low probability using machine learning (ML) and data analysis. Due to the imbalanced data distributions, where the frequency of common events vastly outweighs that of…

Artificial Intelligence · Computer Science 2024-10-08 Chathurangi Shyalika , Ruwan Wickramarachchi , Amit Sheth

Class-imbalance refers to classification problems in which many more instances are available for certain classes than for others. Such imbalanced datasets require special attention because traditional classifiers generally favor the…

Machine Learning · Computer Science 2018-11-30 Rafael M. O. Cruz , Mariana A. Souza , Robert Sabourin , George D. C. Cavalcanti

Despite extensive research spanning several decades, class imbalance is still considered a profound difficulty for both machine learning and deep learning models. While data oversampling is the foremost technique to address this issue,…

Machine Learning · Computer Science 2025-02-12 Sukumar Kishanthan , Asela Hevapathige

Short-term (0-24 hours) precipitation forecasting is highly valuable to socioeconomic activities and public safety. However, the highly complex evolution patterns of precipitation events, the extreme imbalance between precipitation and…

Machine Learning · Computer Science 2026-03-30 Shuangliang Li , Siwei Li , Li Li , Weijie Zou , Jie Yang , Maolin Zhang

With the fast growth of wind power penetration, power systems need additional flexibility to cope with wind power ramping. Several electricity markets have established requirements for flexible ramping capacity (FRC) reserves. This paper…

Physics and Society · Physics 2017-12-05 Zhiwen Wang , Chen Shen , Feng Liu , Jianhui Wang , Xiangyu Wu

In this manuscript we continue the thread of [M. Chertkov, F. Pan, M. Stepanov, Predicting Failures in Power Grids: The Case of Static Overloads, IEEE Smart Grid 2011] and suggest a new algorithm discovering most probable extreme stochastic…

Systems and Control · Computer Science 2011-09-08 Michael Chertkov , Mikhail Stepanov , Feng Pan , Ross Baldick