English
Related papers

Related papers: The Devil Is in Gradient Entanglement: Energy-Awar…

200 papers

Graph clustering is a fundamental task which discovers communities or groups in networks. Recent studies have mostly focused on developing deep learning approaches to learn a compact graph embedding, upon which classic clustering methods…

Machine Learning · Computer Science 2019-06-18 Chun Wang , Shirui Pan , Ruiqi Hu , Guodong Long , Jing Jiang , Chengqi Zhang

Sharpness-aware and gradient-alignment methods have been shown to improve generalization, however each family of methods targets a single geometric property of the loss landscape, while ignoring the other. In this paper, we show that this…

Machine Learning · Computer Science 2026-05-11 Aristotelis Ballas , Christos Diou

Data imbalance and open-ended distribution are two intrinsic characteristics of the real visual world. Though encouraging progress has been made in tackling each challenge separately, few works dedicated to combining them towards real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Jianhong Bai , Zuozhu Liu , Hualiang Wang , Ruizhe Chen , Lianrui Mu , Xiaomeng Li , Joey Tianyi Zhou , Yang Feng , Jian Wu , Haoji Hu

Training on class-imbalanced data usually results in biased models that tend to predict samples into the majority classes, which is a common and notorious problem. From the perspective of energy-based model, we demonstrate that the free…

Machine Learning · Computer Science 2021-06-08 Bowen Zhao , Chen Chen , Qi Ju , ShuTao Xia

Deep neural networks have achieved state-of-the-art performance in a wide range of recognition/classification tasks. However, when applying deep learning to real-world applications, there are still multiple challenges. A typical challenge…

Machine Learning · Computer Science 2021-02-10 Xin Sun , Zhenning Yang , Chi Zhang , Guohao Peng , Keck-Voon Ling

Human analysts that use anomaly detection systems in practice want to retain the use of simple and explainable global anomaly detectors. In this paper, we propose a novel human-in-the-loop learning algorithm called GLAD (GLocalized Anomaly…

Machine Learning · Computer Science 2020-07-17 Md Rakibul Islam , Shubhomoy Das , Janardhan Rao Doppa , Sriraam Natarajan

The electrocardiogram (ECG) is one of the most commonly-used tools to diagnose cardiovascular disease in clinical practice. Although deep learning models have achieved very impressive success in the field of automatic ECG analysis, they…

Machine Learning · Computer Science 2024-07-26 Linpeng Jin

Gradient descent algorithms are widely used in machine learning. In order to deal with huge volume of data, we consider the implementation of gradient descent algorithms in a distributed computing setting where multiple workers compute the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-29 Haozhao Wang , Song Guo , Bin Tang , Ruixuan Li , Chengjie Li

Driver drowsiness is one of main factors leading to road fatalities and hazards in the transportation industry. Electroencephalography (EEG) has been considered as one of the best physiological signals to detect drivers drowsy states, since…

Signal Processing · Electrical Eng. & Systems 2021-06-02 Jian Cui , Zirui Lan , Yisi Liu , Ruilin Li , Fan Li , Olga Sourina , Wolfgang Mueller-Wittig

Domain generalization (DG) aims to improve the generalizability of computer vision models toward distribution shifts. The mainstream DG methods focus on learning domain invariance, however, such methods overlook the potential inherent in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Shaocong Long , Qianyu Zhou , Xiangtai Li , Chenhao Ying , Yunhai Tong , Lizhuang Ma , Yuan Luo , Dacheng Tao

We propose to utilize gradients for detecting adversarial and out-of-distribution samples. We introduce confounding labels -- labels that differ from normal labels seen during training -- in gradient generation to probe the effective…

Machine Learning · Computer Science 2022-07-05 Jinsol Lee , Mohit Prabhushankar , Ghassan AlRegib

Cross-graph Relational Learning (CGRL) refers to the problem of predicting the strengths or labels of multi-relational tuples of heterogeneous object types, through the joint inference over multiple graphs which specify the internal…

Machine Learning · Computer Science 2016-05-09 Hanxiao Liu , Yiming Yang

While supervised deep learning has achieved great success in a range of applications, relatively little work has studied the discovery of knowledge from unlabeled data. In this paper, we propose an unsupervised deep learning framework to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Jinghua Wang , Jianmin Jiang

Automatic emotion recognition based on multichannel Electroencephalography (EEG) holds great potential in advancing human-computer interaction. However, several significant challenges persist in existing research on algorithmic emotion…

Machine Learning · Computer Science 2023-10-24 Hongxiang Gao , Xiangyao Wang , Zhenghua Chen , Min Wu , Zhipeng Cai , Lulu Zhao , Jianqing Li , Chengyu Liu

Generalized Class Discovery (GCD) plays a pivotal role in discerning both known and unknown categories from unlabeled datasets by harnessing the insights derived from a labeled set comprising recognized classes. A significant limitation in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Ziyun Li , Christoph Meinel , Haojin Yang

Objective. Supervised learning paradigms are often limited by the amount of labeled data that is available. This phenomenon is particularly problematic in clinically-relevant data, such as electroencephalography (EEG), where labeling can be…

Machine Learning · Statistics 2020-08-03 Hubert Banville , Omar Chehab , Aapo Hyvärinen , Denis-Alexander Engemann , Alexandre Gramfort

In complex multivariate systems, interactions among variables are defined by dependency structures, often encoded as directed acyclic graphs ($\text{DAGs}$). However, dependency structures can vary across subjects, and ignoring this…

Machine Learning · Statistics 2026-05-20 Honglin Du , Muxuan Liang , Xiang Zhong

Multi-label classification (MLC) offers a more comprehensive semantic understanding of Remote Sensing (RS) imagery compared to traditional single-label classification (SLC). However, obtaining complete annotations for MLC is particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Chenying Liu , Gianmarco Perantoni , Lorenzo Bruzzone , Xiao Xiang Zhu

Category discovery (CD) is an emerging open-world learning task, which aims at automatically categorizing unlabelled data containing instances from unseen classes, given some labelled data from seen classes. This task has attracted…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zhenqi He , Yuanpei Liu , Kai Han

In the realm of Adversarial Distillation (AD), strategic and precise knowledge transfer from an adversarially robust teacher model to a less robust student model is paramount. Our Dynamic Guidance Adversarial Distillation (DGAD) framework…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Hyejin Park , Dongbo Min