English
Related papers

Related papers: An Adaptive sampling and domain learning strategy …

200 papers

Unsupervised Domain Adaptation for Regression (UDAR) aims to adapt models from a labeled source domain to an unlabeled target domain for regression tasks. Traditional feature alignment methods, successful in classification, often prove…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Ismail Nejjar , Gaetan Frusque , Florent Forest , Olga Fink

Domain adversarial training has been ubiquitous for achieving invariant representations and is used widely for various domain adaptation tasks. In recent times, methods converging to smooth optima have shown improved generalization for…

Machine Learning · Computer Science 2022-06-17 Harsh Rangwani , Sumukh K Aithal , Mayank Mishra , Arihant Jain , R. Venkatesh Babu

We study the generalization error of randomized learning algorithms -- focusing on stochastic gradient descent (SGD) -- using a novel combination of PAC-Bayes and algorithmic stability. Importantly, our generalization bounds hold for all…

Machine Learning · Computer Science 2020-06-23 Ben London

Although stochastic gradient descent (SGD) method and its variants (e.g., stochastic momentum methods, AdaGrad) are the choice of algorithms for solving non-convex problems (especially deep learning), there still remain big gaps between the…

Optimization and Control · Mathematics 2019-03-07 Zaiyi Chen , Zhuoning Yuan , Jinfeng Yi , Bowen Zhou , Enhong Chen , Tianbao Yang

We consider unconstrained stochastic optimization problems with no available gradient information. Such problems arise in settings from derivative-free simulation optimization to reinforcement learning. We propose an adaptive sampling…

Optimization and Control · Mathematics 2021-09-28 Raghu Bollapragada , Stefan M. Wild

We introduce an algorithm for tackling the problem of unsupervised domain adaptation (UDA) in continual learning (CL) scenarios. The primary objective is to maintain model generalization under domain shift when new domains arrive…

Machine Learning · Computer Science 2024-02-02 Mohammad Rostami

In this paper, we study the formalism of unsupervised multi-class domain adaptation (multi-class UDA), which underlies a few recent algorithms whose learning objectives are only motivated empirically. Multi-Class Scoring Disagreement (MCSD)…

Machine Learning · Computer Science 2020-11-24 Yabin Zhang , Bin Deng , Hui Tang , Lei Zhang , Kui Jia

In the era of big astronomical surveys, our ability to leverage artificial intelligence algorithms simultaneously for multiple datasets will open new avenues for scientific discovery. Unfortunately, simply training a deep neural network on…

Graph anomaly detection (GAD) aims to identify nodes that deviate from normal patterns in structure or features. While recent GNN-based approaches have advanced this task, they struggle with two major challenges: 1) homophily disparity,…

Machine Learning · Computer Science 2026-03-10 Yunhui Liu , Qizhuo Xie , Yinfeng Chen , Xudong Jin , Tao Zheng , Bin Chong , Tieke He

Non-adaptive geostatistical designs (NAGD) offer standard ways of collecting and analysing geostatistical data in which sampling locations are fixed in advance of any data collection. In contrast, adaptive geostatistical designs (AGD) allow…

Methodology · Statistics 2015-09-16 Michael G. Chipeta , Dianne J. Terlouw , Kamija Phiri , Peter J. Diggle

Domain Adaptation (DA), the process of effectively adapting task models learned on one domain, the source, to other related but distinct domains, the targets, with no or minimal retraining, is typically accomplished using the process of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Behnam Gholami , Pritish Sahu , Minyoung Kim , Vladimir Pavlovic

Unsupervised domain adaptation (UDA) aims to learn transferable knowledge from a labeled source domain and adapts a trained model to an unlabeled target domain. To bridge the gap between source and target domains, one prevailing strategy is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Xu Ma , Junkun Yuan , Yen-wei Chen , Ruofeng Tong , Lanfen Lin

Adaptive optimization methods such as AdaGrad, RMSprop and Adam have been proposed to achieve a rapid training process with an element-wise scaling term on learning rates. Though prevailing, they are observed to generalize poorly compared…

Machine Learning · Computer Science 2019-04-22 Liangchen Luo , Yuanhao Xiong , Yan Liu , Xu Sun

We study the problem of differentially private linear regression where each data point is sampled from a fixed sub-Gaussian style distribution. We propose and analyze a one-pass mini-batch stochastic gradient descent method (DP-AMBSSGD)…

Machine Learning · Computer Science 2022-07-14 Prateek Varshney , Abhradeep Thakurta , Prateek Jain

Robust segmentation is critical for deriving quantitative measures from large-scale, multi-center, and longitudinal medical scans. Manually annotating medical scans, however, is expensive and labor-intensive and may not always be available…

We propose a simple but effective source-free domain adaptation (SFDA) method. Treating SFDA as an unsupervised clustering problem and following the intuition that local neighbors in feature space should have more similar predictions than…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Shiqi Yang , Yaxing Wang , Kai Wang , Shangling Jui , Joost van de Weijer

A major bottleneck in the real-world applications of machine learning models is their failure in generalizing to unseen domains whose data distribution is not i.i.d to the training domains. This failure often stems from learning…

Machine Learning · Computer Science 2021-09-28 Soroosh Shahtalebi , Jean-Christophe Gagnon-Audet , Touraj Laleh , Mojtaba Faramarzi , Kartik Ahuja , Irina Rish

Convolutional neural networks (CNNs) can learn directly from raw data, resulting in exceptional performance across various research areas. However, factors present in non-controllable environments such as unlabeled datasets with varying…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Lucas Fernando Alvarenga e Silva , Samuel Felipe dos Santos , Nicu Sebe , Jurandy Almeida

Unsupervised Domain Adaptation (UDA) refers to the problem of learning a model in a target domain where labeled data are not available by leveraging information from annotated data in a source domain. Most deep UDA approaches operate in a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Massimiliano Mancini , Lorenzo Porzi , Samuel Rota Bulò , Barbara Caputo , Elisa Ricci

State-of-the-art stereo matching (SM) models trained on synthetic data often fail to generalize to real data domains due to domain differences, such as color, illumination, contrast, and texture. To address this challenge, we leverage data…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Shuangli Du , Jing Wang , Minghua Zhao , Zhenyu Xu , Jie Li