English
Related papers

Related papers: Provable Domain Generalization via Invariant-Featu…

200 papers

Although recent advances in machine learning have shown its success to learn from independent and identically distributed (IID) data, it is vulnerable to out-of-distribution (OOD) data in an open world. Domain generalization (DG) deals with…

Machine Learning · Computer Science 2024-05-14 Thai-Hoang Pham , Xueru Zhang , Ping Zhang

We provide the first global model recovery results for the IRLS (iteratively reweighted least squares) heuristic for robust regression problems. IRLS is known to offer excellent performance, despite bad initializations and data corruption,…

Machine Learning · Computer Science 2020-06-26 Bhaskar Mukhoty , Govind Gopakumar , Prateek Jain , Purushottam Kar

Object recognition from images means to automatically find object(s) of interest and to return their category and location information. Benefiting from research on deep learning, like convolutional neural networks~(CNNs) and generative…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Zhize Wu , Xiaofeng Wang , Tong Xu , Xuebin Yang , Le Zou , Lixiang Xu , Thomas Weise

Magnetic Resonance Imaging (MRI) is widely used in clinical practice, but suffered from prolonged acquisition time. Although deep learning methods have been proposed to accelerate acquisition and demonstrate promising performance, they rely…

Image and Video Processing · Electrical Eng. & Systems 2025-12-30 Hao Zhang , Qi Wang , Jian Sun , Zhijie Wen , Jun Shi , Shihui Ying

Domain generalization aims to learn knowledge invariant across different distributions while semantically meaningful for downstream tasks from multiple source domains, to improve the model's generalization ability on unseen target domains.…

Machine Learning · Computer Science 2021-06-03 Yunqi Wang , Furui Liu , Zhitang Chen , Qing Lian , Shoubo Hu , Jianye Hao , Yik-Chung Wu

Domain generalization (DG) methods aim to achieve generalizability to an unseen target domain by using only training data from the source domains. Although a variety of DG methods have been proposed, a recent study shows that under a fair…

Machine Learning · Computer Science 2021-11-04 Junbum Cha , Sanghyuk Chun , Kyungjae Lee , Han-Cheol Cho , Seunghyun Park , Yunsung Lee , Sungrae Park

Kernel dimensionality reduction (KDR) algorithms find a low dimensional representation of the original data by optimizing kernel dependency measures that are capable of capturing nonlinear relationships. The standard strategy is to first…

Machine Learning · Statistics 2019-09-26 Chieh Wu , Jared Miller , Yale Chang , Mario Sznaier , Jennifer Dy

We provide here a framework to analyze the phase transition phenomenon of slice inverse regression (SIR), a supervised dimension reduction technique introduced by \cite{Li:1991}. Under mild conditions, the asymptotic ratio $\rho= \lim p/n$…

Statistics Theory · Mathematics 2016-11-22 Qian Lin , Zhigen Zhao , Jun S. Liu

Existing offline reinforcement learning (RL) algorithms typically assume that training data is either: 1) generated by a known policy, or 2) of entirely unknown origin. We consider multi-demonstrator offline RL, a middle ground where we…

Machine Learning · Computer Science 2022-11-29 Alan Clark , Shoaib Ahmed Siddiqui , Robert Kirk , Usman Anwar , Stephen Chung , David Krueger

Generalization capability to unseen domains is crucial for machine learning models when deploying to real-world conditions. We investigate the challenging problem of domain generalization, i.e., training a model on multi-domain source data…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Qi Dou , Daniel C. Castro , Konstantinos Kamnitsas , Ben Glocker

Recent advance in Dense Retrieval (DR) techniques has significantly improved the effectiveness of first-stage retrieval. Trained with large-scale supervised data, DR models can encode queries and documents into a low-dimensional dense space…

Information Retrieval · Computer Science 2022-08-18 Jingtao Zhan , Qingyao Ai , Yiqun Liu , Jiaxin Mao , Xiaohui Xie , Min Zhang , Shaoping Ma

While successful for various computer vision tasks, deep neural networks have shown to be vulnerable to texture style shifts and small perturbations to which humans are robust. In this work, we show that the robustness of neural networks…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Zhenlin Xu , Deyi Liu , Junlin Yang , Colin Raffel , Marc Niethammer

Domain Generalization (DG) aims to learn models whose performance remains high on unseen domains encountered at test-time by using data from multiple related source domains. Many existing DG algorithms reduce the divergence between source…

Machine Learning · Computer Science 2022-06-27 Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Jihun Hamm

Deep learning has revolutionized neuroimage analysis by delivering unprecedented speed and accuracy. However, the narrow scope of many training datasets constrains model robustness and generalizability. This challenge is particularly acute…

Image and Video Processing · Electrical Eng. & Systems 2025-12-08 Malte Hoffmann

We propose distributed solutions to the problem of Robust Subspace Recovery (RSR). Our setting assumes a huge dataset in an ad hoc network without a central processor, where each node has access only to one chunk of the dataset.…

Numerical Analysis · Mathematics 2018-11-07 Vahan Huroyan , Gilad Lerman

Learning models that gracefully handle distribution shifts is central to research on domain generalization, robust optimization, and fairness. A promising formulation is domain-invariant learning, which identifies the key issue of learning…

Machine Learning · Computer Science 2021-07-16 Elliot Creager , Jörn-Henrik Jacobsen , Richard Zemel

Single domain generalization aims to train a generalizable model with only one source domain to perform well on arbitrary unseen target domains. Image augmentation based on Random Convolutions (RandConv), consisting of one convolution layer…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Seokeon Choi , Debasmit Das , Sungha Choi , Seunghan Yang , Hyunsin Park , Sungrack Yun

This paper introduces a new unsupervised method for dimensionality reduction via regression (DRR). The algorithm belongs to the family of invertible transforms that generalize Principal Component Analysis (PCA) by using curvilinear instead…

Machine Learning · Statistics 2016-02-02 Valero Laparra , Jesus Malo , Gustau Camps-Valls

Great successes have been achieved using deep learning techniques for image super-resolution (SR) with fixed scales. To increase its real world applicability, numerous models have also been proposed to restore SR images with arbitrary scale…

Image and Video Processing · Electrical Eng. & Systems 2022-09-28 Zhihong Pan , Baopu Li , Dongliang He , Wenhao Wu , Errui Ding

The generalization with respect to domain shifts, as they frequently appear in applications such as autonomous driving, is one of the remaining big challenges for deep learning models. Therefore, we propose an exemplar-based style synthesis…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Yumeng Li , Dan Zhang , Margret Keuper , Anna Khoreva