中文
相关论文

相关论文: A Wasserstein Minimax Framework for Mixed Linear R…

200 篇论文

Recently, Deng et al. (2026) proposed Generative Modeling via Drifting (GMD), a novel framework for generative tasks. This note presents an analysis of GMD through the lens of Wasserstein Gradient Flows (WGF), i.e., the path of steepest…

We introduce a new approach to a linear-circular regression problem that relates multiple linear predictors to a circular response. We follow a modeling approach of a wrapped normal distribution that describes angular variables and angular…

统计方法学 · 统计学 2019-09-17 Ali Esmaieeli Sikaroudi , Chiwoo Park

The linear regression model with a random variable (RV) measurement matrix, where the mean of the random measurement matrix has full column rank, has been extensively studied. In particular, the quasiconvexity of the maximum likelihood…

信号处理 · 电气工程与系统科学 2025-07-16 Ruohai Guo , Jiang Zhu , Xing Jiang , Fengzhong Qu

This paper addresses a new active learning strategy for regression problems. The presented Wasserstein active regression model is based on the principles of distribution-matching to measure the representativeness of the labeled dataset. The…

机器学习 · 计算机科学 2024-03-25 Benjamin Bobbia , Matthias Picard

Assume that we observe i.i.d.~points lying close to some unknown $d$-dimensional $\mathcal{C}^k$ submanifold $M$ in a possibly high-dimensional space. We study the problem of reconstructing the probability distribution generating the…

统计理论 · 数学 2022-02-15 Vincent Divol

Meta-reinforcement learning (meta-RL) aims to learn from multiple training tasks the ability to adapt efficiently to unseen test tasks. Despite the success, existing meta-RL algorithms are known to be sensitive to the task distribution…

机器学习 · 计算机科学 2021-03-02 Zichuan Lin , Garrett Thomas , Guangwen Yang , Tengyu Ma

Model merging aggregates Large Language Models (LLMs) finetuned on different tasks into a stronger one. However, parameter conflicts between models leads to performance degradation in averaging. While model routing addresses this issue by…

机器学习 · 计算机科学 2025-02-12 Kunfeng Lai , Zhenheng Tang , Xinglin Pan , Peijie Dong , Xiang Liu , Haolan Chen , Li Shen , Bo Li , Xiaowen Chu

We study the problem of regression in a generalized linear model (GLM) with multiple signals and latent variables. This model, which we call a matrix GLM, covers many widely studied problems in statistical learning, including mixed linear…

机器学习 · 统计学 2024-04-10 Nelvin Tan , Ramji Venkataramanan

Approximating a probability distribution using a set of particles is a fundamental problem in machine learning and statistics, with applications including clustering and quantization. Formally, we seek a weighted mixture of Dirac measures…

机器学习 · 统计学 2026-04-24 Ayoub Belhadji , Daniel Sharp , Youssef Marzouk

Self-supervised sequential recommendation significantly improves recommendation performance by maximizing mutual information with well-designed data augmentations. However, the mutual information estimation is based on the calculation of…

机器学习 · 计算机科学 2023-06-21 Ziwei Fan , Zhiwei Liu , Hao Peng , Philip S Yu

Continual learning has emerged as a pivotal area of research, primarily due to its advantageous characteristic that allows models to persistently acquire and retain information. However, catastrophic forgetting can severely impair model…

机器学习 · 计算机科学 2026-01-28 KaiHui Huang , RunQing Wu , JinHui Sheng , HanYi Zhang , Ling Ge , JinYu Guo , Fei Ye

Wasserstein distributionally robust optimization estimators are obtained as solutions of min-max problems in which the statistician selects a parameter minimizing the worst-case loss among all probability models within a certain distance…

统计理论 · 数学 2021-03-04 Jose Blanchet , Karthyek Murthy , Nian Si

This paper considers the problem of regression over distributions, which is becoming increasingly important in machine learning. Existing approaches often ignore the geometry of the probability space or are computationally expensive. To…

机器学习 · 计算机科学 2025-10-31 Maksim Maslov , Alexander Kugaevskikh , Matthew Ivanov

This paper presents a novel distribution-agnostic Wasserstein distance-based estimation framework. The goal is to determine an optimal map combining prior estimate with measurement likelihood such that posterior estimation error optimally…

系统与控制 · 电气工程与系统科学 2024-03-22 Himanshu Prabhat , Raktim Bhattacharya

Restricted maximum likelihood (REML) estimation is a widely accepted and frequently used method for fitting linear mixed models, with its principal advantage being that it produces less biased estimates of the variance components. However,…

统计方法学 · 统计学 2025-05-15 Luca Maestrini , Francis K. C. Hui , Alan H. Welsh

Traffic optimization challenges, such as load balancing, flow scheduling, and improving packet delivery time, are difficult online decision-making problems in wide area networks (WAN). Complex heuristics are needed for instance to find…

网络与互联网体系结构 · 计算机科学 2021-12-01 Shan Sun , Mariam Kiran , Wei Ren

We consider a finite mixture of regressions (FMR) model for high-dimensional inhomogeneous data where the number of covariates may be much larger than sample size. We propose an l1-penalized maximum likelihood estimator in an appropriate…

统计方法学 · 统计学 2012-02-28 Nicolas Städler , Peter Bühlmann , Sara van de Geer

Optimal transportation theory and the related $p$-Wasserstein distance ($W_p$, $p\geq 1$) are widely-applied in statistics and machine learning. In spite of their popularity, inference based on these tools has some issues. For instance, it…

统计理论 · 数学 2024-03-01 Yiming Ma , Hang Liu , Davide La Vecchia , Metthieu Lerasle

Multi-user multiple-input multiple-output (MU-MIMO) beamforming design is typically formulated as a non-convex weighted sum rate (WSR) maximization problem that is known to be NP-hard. This problem is solved either by iterative algorithms,…

信号处理 · 电气工程与系统科学 2022-10-28 Jing-Yuan Xia , Zhixiong Yang , Tong Qiu , Huaizhang Liao , Deniz Gunduz

Low-rank multivariate regression (LRMR) is an important statistical learning model that combines highly correlated tasks as a multiresponse regression problem with low-rank priori on the coefficient matrix. In this paper, we study quantized…

机器学习 · 统计学 2023-10-10 Junren Chen , Yueqi Wang , Michael K. Ng