English
Related papers

Related papers: Deep learning based on Transformer architecture fo…

200 papers

While linear-complexity attention mechanisms offer a promising alternative to Softmax attention for overcoming the quadratic bottleneck, training such models from scratch remains prohibitively expensive. Inheriting weights from pretrained…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yining Li , Dongchen Han , Zeyu Liu , Hanyi Wang , Yulin Wang , Gao Huang

Deep classifiers may encounter significant performance degradation when processing unseen testing data from varying centers, vendors, and protocols. Ensuring the robustness of deep models against these domain shifts is crucial for their…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Yuhao Huang , Xin Yang , Xiaoqiong Huang , Xinrui Zhou , Haozhe Chi , Haoran Dou , Xindi Hu , Jian Wang , Xuedong Deng , Dong Ni

Electromagnetic transient (EMT) simulation is a crucial tool for power system dynamic analysis because of its detailed component modeling and high simulation accuracy. However, it suffers from computational burdens for large power grids…

Systems and Control · Electrical Eng. & Systems 2023-12-21 Min Xiong , Kaiyang Huang , Yang Liu , Rui Yao , Kai Sun , Feng Qiu

Despite recent advancements in deep learning, deep neural networks continue to suffer from performance degradation when applied to new data that differs from training data. Test-time adaptation (TTA) aims to address this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sanghun Jung , Jungsoo Lee , Nanhee Kim , Amirreza Shaban , Byron Boots , Jaegul Choo

With the increase of uncertain and intermittent renewable energy supply on the grid, the power system has become more vulnerable to instability. In this paper, we develop a demand response strategy to improve power system small-signal…

Systems and Control · Electrical Eng. & Systems 2023-04-17 Mengqi Yao , Sandip Roy , Johanna L. Mathieu

With the rapid growth of power market reform and power demand, the power transmission capacity of a power grid is approaching its limit, and the secure and stable operation of power systems becomes increasingly important. In particular, in…

Systems and Control · Electrical Eng. & Systems 2022-01-19 Jiting Cao , Meng Zhang , Yang Li

Fault diagnosis plays an essential role in reducing the maintenance costs of rotating machinery manufacturing systems. In many real applications of fault detection and diagnosis, data tend to be imbalanced, meaning that the number of…

Machine Learning · Computer Science 2022-03-30 Masoud Jalayer , Amin Kaboli , Carlotta Orsenigo , Carlo Vercellis

Dealing with severe class imbalance poses a major challenge for real-world applications, especially when the accurate classification and generalization of minority classes is of primary interest. In computer vision, learning from long…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Zidi Xiu , Junya Chen , Ricardo Henao , Benjamin Goldstein , Lawrence Carin , Chenyang Tao

Transformer-based models have recently shown success in representation learning on graph-structured data beyond natural language processing and computer vision. However, the success is limited to small-scale graphs due to the drawbacks of…

Machine Learning · Computer Science 2022-10-05 Jinyoung Park , Seongjun Yun , Hyeonjin Park , Jaewoo Kang , Jisu Jeong , Kyung-Min Kim , Jung-woo Ha , Hyunwoo J. Kim

Time series data, characterized by its intrinsic long and short-range dependencies, poses a unique challenge across analytical applications. While Transformer-based models excel at capturing long-range dependencies, they face limitations in…

Machine Learning · Computer Science 2024-05-07 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Xiaoli Li

We propose the joint graph attention neural network (GAT), clustering with adaptive neighbors (CAN) and probabilistic graphical model for dynamic power flow analysis and fault characteristics. In fact, computational efficiency is the main…

Machine Learning · Computer Science 2025-03-25 Tan Le , Van Le

Supervised learning has been widely used for attack categorization, requiring high-quality data and labels. However, the data is often imbalanced and it is difficult to obtain sufficient annotations. Moreover, supervised models are subject…

Cryptography and Security · Computer Science 2022-09-05 Zihan Li , Wentao Chen , Zhiqing Wei , Xingqi Luo , Bing Su

Accurate forecasting of solar power output is essential for efficient integration of renewable energy into the grid. In this study, an attention-based deep learning model, inspired by transformer architecture, is used for short-term solar…

Machine Learning · Computer Science 2026-04-28 Ankan Basu , Jyotiraditya Roy , Aditya Datta , Prayas Sanyal , Sumanta Banerjee

Continual Test-Time Adaptation (CTTA) task investigates effective domain adaptation under the scenario of continuous domain shifts during testing time. Due to the utilization of solely unlabeled samples, there exists significant uncertainty…

Machine Learning · Computer Science 2025-12-18 Fan Lyu , Kaile Du , Yuyang Li , Hanyu Zhao , Fuyuan Hu , Zhang Zhang , Guangcan Liu , Liang Wang

In order to improve the classification accuracy of transient stability assessment of power systems, a novel method based on local learning machine and an improved bacterial colony chemotaxis (BCC) algorithm is proposed, where local learning…

Signal Processing · Electrical Eng. & Systems 2024-12-20 Xueping Gu , Yang Li

This paper presents a complex systems overview of a power grid network. In recent years, concerns about the robustness of the power grid have grown because of several cascading outages in different parts of the world. In this paper,…

Adaptation and Self-Organizing Systems · Physics 2010-06-24 Sakshi Pahwa , Amelia Hodges , Caterina Scoglio , Sean Wood

Classifiers trained with class-imbalanced data are known to perform poorly on test data of the "minor" classes, of which we have insufficient training data. In this paper, we investigate learning a ConvNet classifier under such a scenario.…

Machine Learning · Computer Science 2022-07-12 Han-Jia Ye , Hong-You Chen , De-Chuan Zhan , Wei-Lun Chao

Class imbalance is an inherent problem in many machine learning classification tasks. This often leads to trained models that are unusable for any practical purpose. In this study we explore an unsupervised approach to address these…

Machine Learning · Computer Science 2021-08-20 Ademola Okerinde , Lior Shamir , William Hsu , Tom Theis , Nasik Nafi

Modern power systems with high penetration of inverter-based resources exhibit complex dynamic behaviors that challenge the scalability and generalizability of traditional stability assessment methods. This paper presents a dynamic…

Systems and Control · Electrical Eng. & Systems 2025-11-18 Guang An Ooi , Otavio Bertozzi , Mohd Asim Aftab , Charalambos Konstantinou , Shehab Ahmed

This paper presents a novel method for transient stability analysis (TSA) that circumvents the limitations of sequential numerical integration and energy functions. The proposed method begins by constructing a trajectory-dependent stability…

Systems and Control · Electrical Eng. & Systems 2025-11-18 Wenhao Wu , Dan Wu , Bin Wang , Jiabing Hu