English
Related papers

Related papers: Unsupervised optimal deep transfer learning for cl…

200 papers

Transfer learning is beneficial for survival analysis, especially when the target study has a limited number of events. However, existing transfer learning methods rely on the restrictive assumption that the target and source studies share…

Methodology · Statistics 2026-03-13 Yu Gu , Donglin Zeng , D. Y. Lin

In this paper, we propose a novel self-supervised transfer learning method called \underline{\textbf{D}}istribution \underline{\textbf{M}}atching (DM), which drives the representation distribution toward a predefined reference distribution…

Machine Learning · Statistics 2025-07-03 Yuling Jiao , Wensen Ma , Defeng Sun , Hansheng Wang , Yang Wang

Deep neural networks (DNNs) trained with the logistic loss (i.e., the cross entropy loss) have made impressive advancements in various binary classification tasks. However, generalization analysis for binary classification with DNNs and…

Machine Learning · Statistics 2024-04-23 Zihan Zhang , Lei Shi , Ding-Xuan Zhou

Unregularized deep neural networks (DNNs) can be easily overfit with a limited sample size. We argue that this is mostly due to the disriminative nature of DNNs which directly model the conditional probability (or score) of labels given the…

Machine Learning · Computer Science 2016-01-11 Shuangfei Zhai , Zhongfei Zhang

Sequential sensor data is generated in a wide variety of practical applications. A fundamental challenge involves learning effective classifiers for such sequential data. While deep learning has led to impressive performance gains in recent…

Machine Learning · Computer Science 2020-10-07 Nauman Ahad , Mark A. Davenport

Optimal transmission switching (OTS) improves optimal power flow (OPF) by selectively opening transmission lines, but its mixed-integer formulation increases computational complexity, especially on large grids. To address this, we propose a…

Systems and Control · Electrical Eng. & Systems 2026-03-05 Minsoo Kim , Matthew Brun , Andy Sun , Jip Kim

Graph Neural Networks (GNNs) have been widely applied in the semi-supervised node classification task, where a key point lies in how to sufficiently leverage the limited but valuable label information. Most of the classical GNNs solely use…

Machine Learning · Computer Science 2022-12-26 Le Yu , Leilei Sun , Bowen Du , Tongyu Zhu , Weifeng Lv

Most existing Graph Neural Networks (GNNs) are proposed without considering the selection bias in data, i.e., the inconsistent distribution between the training set with test set. In reality, the test data is not even available during the…

Machine Learning · Computer Science 2022-01-27 Shaohua Fan , Xiao Wang , Chuan Shi , Kun Kuang , Nian Liu , Bai Wang

Unsupervised domain adaptation aims to generalize the supervised model trained on a source domain to an unlabeled target domain. Marginal distribution alignment of feature spaces is widely used to reduce the domain discrepancy between the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Pengfei Ge , Chuan-Xian Ren , Dao-Qing Dai , Hong Yan

In graph neural networks (GNNs), both node features and labels are examples of graph signals, a key notion in graph signal processing (GSP). While it is common in GSP to impose signal smoothness constraints in learning and estimation tasks,…

Signal Processing · Electrical Eng. & Systems 2023-04-10 Feng Ji , See Hian Lee , Kai Zhao , Wee Peng Tay , Jielong Yang

The uncertainty estimation is critical in real-world decision making applications, especially when distributional shift between the training and test data are prevalent. Many calibration methods in the literature have been proposed to…

Machine Learning · Computer Science 2019-11-27 Azadeh Sadat Mozafari , Hugo Siqueira Gomes , Christian Gagne

Graph neural networks (GNNs) have shown great ability for node classification on graphs. However, the success of GNNs relies on abundant labeled data, while obtaining high-quality labels is costly and challenging, especially for newly…

Machine Learning · Computer Science 2025-06-02 Yilong Wang , Tianxiang Zhao , Zongyu Wu , Suhang Wang

Rates of missing data often depend on record-keeping policies and thus may change across times and locations, even when the underlying features are comparatively stable. In this paper, we introduce the problem of Domain Adaptation under…

Machine Learning · Computer Science 2023-05-05 Helen Zhou , Sivaraman Balakrishnan , Zachary C. Lipton

Domain adaptation aims to leverage a labeled source domain to learn a classifier for the unlabeled target domain with a different distribution. Previous methods mostly match the distribution between two domains by global or class alignment.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Mei Wang , Weihong Deng

Overfitting commonly occurs when applying deep neural networks (DNNs) on small-scale datasets, where DNNs do not generalize well from existing data to unseen data. The main reason resulting in overfitting is that small-scale datasets cannot…

Machine Learning · Computer Science 2024-08-12 Yangdi Wang , Zhi-Hai Zhang , Su Xiu Xu , Wenming Guo

Statistical analysis of network data has attracted considerable attention in recent years, due to the rapid advancement of well-trained network models and the accessibility of large public network datasets. In this article, we propose a…

Methodology · Statistics 2026-04-22 Yong He , Kangxiang Qin , Haoran Tang

Statistical machine learning methods often face the challenge of limited data available from the population of interest. One remedy is to leverage data from auxiliary source populations, which share some conditional distributions or are…

Methodology · Statistics 2024-06-11 Hongxiang Qiu , Eric Tchetgen Tchetgen , Edgar Dobriban

Minimizing expected loss measured by a proper scoring rule, such as Brier score or log-loss (cross-entropy), is a common objective while training a probabilistic classifier. If the data have experienced dataset shift where the class…

Machine Learning · Computer Science 2021-11-05 Theodore James Thibault Heiser , Mari-Liis Allikivi , Meelis Kull

Understanding why deep neural networks (DNNs) fail to generalize to unseen samples remains a long-standing challenge. Existing studies mainly examine changes in externally observable factors such as data, representations, or outputs, yet…

Machine Learning · Computer Science 2026-05-14 Huiqi Deng , Yibo Li , Quanshi Zhang , Peng Zhang , Hongbin Pei , Xia Hu

Deep neural networks have shown promising results for various clinical prediction tasks. However, training deep networks such as those based on Recurrent Neural Networks (RNNs) requires large labeled data, significant hyper-parameter tuning…

Machine Learning · Computer Science 2021-03-05 Priyanka Gupta , Pankaj Malhotra , Jyoti Narwariya , Lovekesh Vig , Gautam Shroff