English
Related papers

Related papers: Identifying Invariant Factors Across Multiple Envi…

200 papers

We investigate the estimation of the causal effect of a treatment variable on an outcome in the presence of a latent confounder. We first show that the causal effect is identifiable under certain conditions when data is available from…

Artificial Intelligence · Computer Science 2025-06-16 Yaroslav Kivva , Sina Akbari , Saber Salehkaleybar , Negar Kiyavash

Invariant Contrastive Learning (ICL) methods have achieved impressive performance across various domains. However, the absence of latent space representation for distortion (augmentation)-related information in the latent space makes ICL…

Machine Learning · Computer Science 2024-10-11 Sifan Song , Jinfeng Wang , Qiaochu Zhao , Xiang Li , Dufan Wu , Angelos Stefanidis , Jionglong Su , S. Kevin Zhou , Quanzheng Li

Linear regression is effective at identifying interpretable trends in a data set, but averages out potentially different effects on subgroups within data. We propose an iterative algorithm based on the randomized Kaczmarz (RK) method to…

Numerical Analysis · Mathematics 2022-12-09 Erin George , Yotam Yaniv , Deanna Needell

Invariant graph representation learning aims to learn the invariance among data from different environments for out-of-distribution generalization on graphs. As the graph environment partitions are usually expensive to obtain, augmenting…

Machine Learning · Computer Science 2023-10-31 Yongqiang Chen , Yatao Bian , Kaiwen Zhou , Binghui Xie , Bo Han , James Cheng

The deconfounder was proposed as a method for estimating causal parameters in a context with multiple causes and unobserved confounding. It is based on recovery of a latent variable from the observed causes. We disentangle the causal…

Statistics Theory · Mathematics 2024-03-04 Jeffrey Adams , Niels Richard Hansen

We study counterfactual regression, which aims to map input features to outcomes under hypothetical scenarios that differ from those observed in the data. This is particularly useful for decision-making when adapting to sudden shifts in…

Methodology · Statistics 2025-04-08 Kwangho Kim

In continual learning (CL), an AI agent (e.g., autonomous vehicles or robotics) learns from non-stationary data streams under dynamic environments. For the practical deployment of such applications, it is important to guarantee robustness…

Machine Learning · Computer Science 2024-01-11 Minsu Kim , Walid Saad

Long range forecasts are the starting point of many decision support systems that need to draw inference from high-level aggregate patterns on forecasted values. State of the art time-series forecasting methods are either subject to concept…

Machine Learning · Computer Science 2022-05-27 Prathamesh Deshpande , Sunita Sarawagi

Estimating the Kullback-Leibler (KL) divergence between two distributions given samples from them is well-studied in machine learning and information theory. Motivated by considerations of multi-group fairness, we seek KL divergence…

Machine Learning · Computer Science 2022-03-01 Parikshit Gopalan , Nina Narodytska , Omer Reingold , Vatsal Sharan , Udi Wieder

Kink model is developed to analyze the data where the regression function is twostage linear but intersects at an unknown threshold. In quantile regression with longitudinal data, previous work assumed that the unknown threshold parameters…

Methodology · Statistics 2020-09-07 Chuang Wan

We introduce a new approach to prediction in graphical models with latent-shift adaptation, i.e., where source and target environments differ in the distribution of an unobserved confounding latent variable. Previous work has shown that as…

Machine Learning · Statistics 2023-06-26 William I. Walker , Arthur Gretton , Maneesh Sahani

Recent research has turned to Reinforcement Learning (RL) to solve challenging decision problems, as an alternative to hand-tuned heuristics. RL can learn good policies without the need for modeling the environment's dynamics. Despite this…

Machine Learning · Computer Science 2023-01-30 Pouya Hamadanian , Malte Schwarzkopf , Siddartha Sen , Mohammad Alizadeh

Despite ample motivation from costly exploration and limited trajectory data, rapidly adapting to new environments with few-shot reinforcement learning (RL) can remain a challenging task, especially with respect to personalized settings.…

Machine Learning · Computer Science 2020-10-13 Michael Zhang

In this work, we propose a novel algorithmic framework for data sharing and coordinated exploration for the purpose of learning more data-efficient and better performing policies under a concurrent reinforcement learning (CRL) setting. In…

Machine Learning · Statistics 2024-02-01 Tim Tse , Isaac Chan , Zhitang Chen

Large language models (LLMs) have shown strong results on a range of applications, including regression and scoring tasks. Typically, one obtains outputs from an LLM via autoregressive sampling from the model's output distribution. We show…

Computation and Language · Computer Science 2024-11-04 Michal Lukasik , Harikrishna Narasimhan , Aditya Krishna Menon , Felix Yu , Sanjiv Kumar

This paper addresses the covariate shift problem in the context of nonparametric regression within reproducing kernel Hilbert spaces (RKHSs). Covariate shift arises in supervised learning when the input distributions of the training and…

Machine Learning · Statistics 2025-05-21 Andrea Della Vecchia , Arnaud Mavakala Watusadisi , Ernesto De Vito , Lorenzo Rosasco

We investigate statistical properties for a broad class of modern kernel-based regression (KBR) methods. These kernel methods were developed during the last decade and are inspired by convex risk minimization in infinite-dimensional Hilbert…

Statistics Theory · Mathematics 2009-09-29 Andreas Christmann , Ingo Steinwart

The goal of Continual Learning (CL) task is to continuously learn multiple new tasks sequentially while achieving a balance between the plasticity and stability of new and old knowledge. This paper analyzes that this insufficiency arises…

Machine Learning · Computer Science 2024-05-28 Hanxi Xiao , Fan Lyu

Modern machine learning approaches excel in static settings where a large amount of i.i.d. training data are available for a given task. In a dynamic environment, though, an intelligent agent needs to be able to transfer knowledge and…

Machine Learning · Computer Science 2023-03-13 Jonas Wildberger , Siyuan Guo , Arnab Bhattacharyya , Bernhard Schölkopf

Feature transformation enhances downstream task performance by generating informative features through mathematical feature crossing. Despite the advancements in deep learning, feature transformation remains essential for structured data,…

Machine Learning · Computer Science 2026-03-02 Tao Zhe , Huazhen Fang , Kunpeng Liu , Qian Lou , Tamzidul Hoque , Dongjie Wang