中文
相关论文

相关论文: Universal MMSE Filtering With Logarithmic Adaptive…

200 篇论文

In online learning problems, exploiting low variance plays an important role in obtaining tight performance guarantees yet is challenging because variances are often not known a priori. Recently, considerable progress has been made by Zhang…

机器学习 · 统计学 2023-02-07 Yeoneung Kim , Insoon Yang , Kwang-Sung Jun

We study the adaptive control of an unknown linear system with a quadratic cost function subject to safety constraints on both the states and actions. The challenges of this problem arise from the tension among safety, exploration,…

系统与控制 · 电气工程与系统科学 2021-11-02 Yingying Li , Subhro Das , Jeff Shamma , Na Li

We consider the problem of online adaptive control of the linear quadratic regulator, where the true system parameters are unknown. We prove new upper and lower bounds demonstrating that the optimal regret scales as…

机器学习 · 计算机科学 2023-10-05 Max Simchowitz , Dylan J. Foster

We consider the problem of sequentially learning to estimate, in the mean squared error (MSE) sense, a Gaussian $K$-vector of unknown covariance by observing only $m < K$ of its entries in each round. We propose two MSE estimators, and…

机器学习 · 计算机科学 2025-05-05 Ayon Ghosh , L. A. Prashanth , Dipayan Sen , Aditya Gopalan

This letter proposes a novel adaptive reduced-rank filtering scheme based on joint iterative optimization of adaptive filters. The novel scheme consists of a joint iterative optimization of a bank of full-rank adaptive filters that forms…

信息论 · 计算机科学 2012-05-22 Rodrigo C. de Lamare , Raimundo Sampaio-Neto

Regret minimization is treated as the golden rule in the traditional study of online learning. However, regret minimization algorithms tend to converge to the static optimum, thus being suboptimal for changing environments. To address this…

机器学习 · 计算机科学 2020-02-07 Lijun Zhang , Shiyin Lu , Tianbao Yang

We address the problem of sequential prediction with expert advice in a non-stationary environment with long-term memory guarantees in the sense of Bousquet and Warmuth [4]. We give a linear-time algorithm that improves on the best known…

机器学习 · 计算机科学 2021-06-25 James Robinson , Mark Herbster

In a noiseless linear estimation problem, one aims to reconstruct a vector x* from the knowledge of its linear projections y=Phi x*. There have been many theoretical works concentrating on the case where the matrix Phi is a random i.i.d.…

机器学习 · 统计学 2020-01-22 Alia Abbara , Antoine Baker , Florent Krzakala , Lenka Zdeborová

State estimation is a fundamental problem in control and signal processing, for which the Kalman Filter provides an optimal solution under linear dynamics, Gaussian noise, and known noise covariances. However, these assumptions often fail…

机器学习 · 计算机科学 2026-05-27 Vasileios Saketos , Ming Xiao

Online machine learning systems need to adapt to domain shifts. Meanwhile, acquiring label at every timestep is expensive. We propose a surprisingly simple algorithm that adaptively balances its regret and its number of label queries in…

机器学习 · 计算机科学 2021-03-01 Yining Chen , Haipeng Luo , Tengyu Ma , Chicheng Zhang

Many practical settings call for the reconstruction of temporal signals from corrupted or missing data. Classic examples include decoding, tracking, signal enhancement and denoising. Since the reconstructed signals are ultimately viewed by…

机器学习 · 计算机科学 2023-06-06 Dror Freirich , Tomer Michaeli , Ron Meir

In this paper, we consider the problem of sequentially optimizing a black-box function $f$ based on noisy samples and bandit feedback. We assume that $f$ is smooth in the sense of having a bounded norm in some reproducing kernel Hilbert…

机器学习 · 统计学 2018-06-01 Jonathan Scarlett , Ilijia Bogunovic , Volkan Cevher

We propose and investigate a method of error detection and noise correction for bosonic linear networks using a method of unitary averaging. The proposed error averaging does not rely on ancillary photons or control and feed-forward…

量子物理 · 物理学 2018-02-21 Ryan J. Marshman , Austin P. Lund , Peter P. Rohde , Timothy C. Ralph

We explore the use of expert-guided bandit learning, which we refer to as online mixture-of-experts (OMoE). In this setting, given a context, a candidate committee of experts must determine how to aggregate their outputs to achieve optimal…

机器学习 · 计算机科学 2025-11-18 Larkin Liu , Jalal Etesami

We study the problem of uncertainty quantification via prediction sets, in an online setting where the data distribution may vary arbitrarily over time. Recent work develops online conformal prediction techniques that leverage regret…

机器学习 · 计算机科学 2023-02-16 Aadyot Bhatnagar , Huan Wang , Caiming Xiong , Yu Bai

Risk-sensitive linear quadratic regulator is one of the most fundamental problems in risk-sensitive optimal control. In this paper, we study online adaptive control of risk-sensitive linear quadratic regulator in the finite horizon episodic…

机器学习 · 计算机科学 2025-02-14 Wenhao Xu , Xuefeng Gao , Xuedong He

This paper gives a broader insight on the application of adaptive filter in noise cancellation during various processes where signal is transmitted. Adaptive filtering techniques like RLS, LMS and normalized LMS are used to filter the input…

声音 · 计算机科学 2020-02-19 Pratibha Balaji , Shruthi Narayan , Durga Sraddha , Bharath K P , Karthik R , Rajesh Kumar Muthu

This paper considers the output prediction problem for an unknown Linear Time-Invariant (LTI) system. In particular, we focus our attention on the OBF-ARX filter, whose transfer function is a linear combination of Orthogonal Basis Functions…

最优化与控制 · 数学 2024-09-10 Jiayun Li , Yiwen Lu , Yilin Mo

We study the linear bandit problem that accounts for partially observable features. Without proper handling, unobserved features can lead to linear regret in the decision horizon $T$, as their influence on rewards is unknown. To tackle this…

机器学习 · 统计学 2025-08-19 Wonyoung Kim , Sungwoo Park , Garud Iyengar , Assaf Zeevi , Min-hwan Oh

The multivariate linear regression model with shuffled data and additive Gaussian noise arises in various correspondence estimation and matching problems. Focusing on the denoising aspect of this problem, we provide a characterization the…

机器学习 · 统计学 2017-04-26 Ashwin Pananjady , Martin J. Wainwright , Thomas A. Courtade