English
Related papers

Related papers: Paradise of Forking Paths: Revisiting the Adaptive…

200 papers

Adaptive data analysis is frequently criticized for its pessimistic generalization guarantees. The source of these pessimistic bounds is a model that permits arbitrary, possibly adversarial analysts that optimally use information to bias…

Machine Learning · Computer Science 2019-05-14 Tijana Zrnic , Moritz Hardt

Variable selection and classification are common objectives in the analysis of high-dimensional data. Most such methods make distributional assumptions that may not be compatible with the diverse families of distributions data can take. A…

Methodology · Statistics 2019-08-28 Weichang Yu , Lamiae Azizi , John T. Ormerod

Domain generalization aim to train models to effectively perform on samples that are unseen and outside of the distribution. Adversarial data augmentation (ADA) is a widely used technique in domain generalization. It enhances the model…

Machine Learning · Computer Science 2024-10-16 Byeong Tak Lee , Joon-myoung Kwon , Yong-Yeon Jo

Active Domain Adaptation (ADA) aims to maximally boost model adaptation in a new target domain by actively selecting a limited number of target data to annotate.This setting neglects the more practical scenario where training data are…

Artificial Intelligence · Computer Science 2023-11-23 Wenqiao Zhang , Zheqi Lv , Hao Zhou , Jia-Wei Liu , Juncheng Li , Mengze Li , Siliang Tang , Yueting Zhuang

Active domain adaptation (ADA) aims to improve the model adaptation performance by incorporating active learning (AL) techniques to label a maximally-informative subset of target samples. Conventional AL methods do not consider the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Duojun Huang , Jichang Li , Weikai Chen , Junshi Huang , Zhenhua Chai , Guanbin Li

Test Time Adaptation (TTA) addresses the problem of distribution shift by adapting a pretrained model to a new domain during inference. When faced with challenging shifts, most methods collapse and perform worse than the original pretrained…

Machine Learning · Computer Science 2025-02-25 Sabyasachi Sahoo , Mostafa ElAraby , Jonas Ngnawe , Yann Pequignot , Frederic Precioso , Christian Gagne

This paper considers a distributed adaptive optimization problem, where all agents only have access to their local cost functions with a common unknown parameter, whereas they mean to collaboratively estimate the true parameter and find the…

Optimization and Control · Mathematics 2025-09-03 Yaqun Yang , Jinlong Lei , Guanghui Wen , Yiguang Hong

In adaptive data analysis, a mechanism gets $n$ i.i.d. samples from an unknown distribution $D$, and is required to provide accurate estimations to a sequence of adaptively chosen statistical queries with respect to $D$. Hardt and Ullman…

Machine Learning · Computer Science 2023-11-07 Kobbi Nissim , Uri Stemmer , Eliad Tsfadia

A large-scale recommender system usually consists of recall and ranking modules. The goal of ranking modules (aka rankers) is to elaborately discriminate users' preference on item candidates proposed by recall modules. With the success of…

Information Retrieval · Computer Science 2022-05-24 Xinyan Fan , Jianxun Lian , Wayne Xin Zhao , Zheng Liu , Chaozhuo Li , Xing Xie

Adversarial discriminative domain adaptation (ADDA) is an efficient framework for unsupervised domain adaptation in image classification, where the source and target domains are assumed to have the same classes, but no labels are available…

Computer Vision and Pattern Recognition · Computer Science 2019-11-12 Aaron Chadha , Yiannis Andreopoulos

We develop a belief space planning (BSP) approach that advances the state of the art by incorporating reasoning about data association (DA) within planning, while considering additional sources of uncertainty. Existing BSP approaches…

Robotics · Computer Science 2016-06-17 Shashank Pathak , Antony Thomas , Asaf Feniger , Vadim Indelman

Training Data Attribution (TDA) seeks to trace model predictions back to influential training examples, enhancing interpretability and safety. We formulate TDA as a Bayesian information-theoretic problem: subsets are scored by the…

Machine Learning · Computer Science 2026-04-10 Dharmesh Tailor , Nicolò Felicioni , Kamil Ciosek

Active Domain Adaptation (ADA) queries the labels of a small number of selected target samples to help adapting a model from a source domain to a target domain. The local context of queried data is important, especially when the domain gap…

Machine Learning · Computer Science 2023-08-29 Tao Sun , Cheng Lu , Haibin Ling

Time series forecasting has long been dominated by advances in model architecture, with recent progress driven by deep learning and hybrid statistical techniques. However, as forecasting models approach diminishing returns in accuracy, a…

Machine Learning · Computer Science 2026-01-29 Daojun Liang , Qi Li , Yinglong Wang , Jing Chen , Hu Zhang , Xiaoxiao Cui , Qizheng Wang , Shuo Li

If the aphorism "All models are wrong"- George Box, continues to be true in data analysis, particularly when analyzing real-world data, then we should annotate this wisdom with visible and explainable data-driven patterns. Such annotations…

Machine Learning · Statistics 2020-12-07 Sabrina Enriquez , Fushing Hsieh

Domain adaptation (DA) aims to generalize a learning model across training and testing data despite the mismatch of their data distributions. In light of a theoretical estimation of upper error bound, we argue in this paper that an…

Computer Vision and Pattern Recognition · Computer Science 2018-01-01 Lingkun Luo , Liming Chen , Shiqiang Hu , Ying Lu , Xiaofang Wang

Data Augmentation is a common technique used to enhance the performance of deep learning models by expanding the training dataset. Automatic Data Augmentation (ADA) methods are getting popular because of their capacity to generate policies…

Machine Learning · Computer Science 2024-04-02 Tien-Yu Chang , Hao Dai , Vincent S. Tseng

Retrieval models aim at selecting a small set of item candidates which match the preference of a given user. They play a vital role in large-scale recommender systems since subsequent models such as rankers highly depend on the quality of…

Information Retrieval · Computer Science 2024-02-01 Lei Li , Jianxun Lian , Xiao Zhou , Xing Xie

Data assimilation (DA) aims to estimate the full state of a dynamical system by combining partial and noisy observations with a prior model forecast, commonly referred to as the background. In atmospheric applications, this problem is…

Atmospheric and Oceanic Physics · Physics 2025-05-29 Jing-An Sun , Hang Fan , Junchao Gong , Ben Fei , Kun Chen , Fenghua Ling , Wenlong Zhang , Wanghan Xu , Li Yan , Pierre Gentine , Lei Bai

Test-time adaptation (TTA) refers to adjusting the model during the testing phase to cope with changes in sample distribution and enhance the model's adaptability to new environments. In real-world scenarios, models often encounter samples…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ziqiong Liu , Yushun Tang , Junyang Ji , Zhihai He