English
Related papers

Related papers: Meta-Learning for Adaptive Filters with Higher-Ord…

200 papers

Millimeter wave (mmWave) communication links for 5G cellular technology require high beamforming gain to overcome channel impairments and achieve high throughput. While much work has focused on estimating mmWave channels and designing…

Signal Processing · Electrical Eng. & Systems 2020-01-08 Stephen G. Larew , David J. Love

This article offers an elaborate description of a Kalman filter code employed in the active control system. Conventional active noise management methods usually employ an adaptive filter, such as the filtered reference least mean square…

Systems and Control · Electrical Eng. & Systems 2024-02-13 Guo Yu

Filtered-X LMS (FxLMS) is commonly used for active noise control (ANC), wherein the soundfield is minimized at a desired location. Given prior knowledge of the spatial region of the noise or control sources, we could improve FxLMS by…

Machine Learning · Computer Science 2026-02-25 Kanad Sarkar , Austin Lu , Manan Mittal , Yongjie Zhuang , Ryan Corey , Andrew Singer

Federated learning (FL) scenarios inherently generate a large communication overhead by frequently transmitting neural network updates between clients and server. To minimize the communication cost, introducing sparsity in conjunction with…

Machine Learning · Computer Science 2022-04-12 Daniel Becking , Heiner Kirchhoffer , Gerhard Tech , Paul Haase , Karsten Müller , Heiko Schwarz , Wojciech Samek

We introduce RE-Adapt, an approach to fine-tuning large language models on new domains without degrading any pre-existing instruction-tuning. We reverse engineer an adapter which isolates what an instruction-tuned model has learned beyond…

Computation and Language · Computer Science 2024-05-27 William Fleshman , Benjamin Van Durme

Learning adaptable policies is crucial for robots to operate autonomously in our complex and quickly changing world. In this work, we present a new meta-learning method that allows robots to quickly adapt to changes in dynamics. In contrast…

Robotics · Computer Science 2020-07-31 Xingyou Song , Yuxiang Yang , Krzysztof Choromanski , Ken Caluwaerts , Wenbo Gao , Chelsea Finn , Jie Tan

This paper presents an adaptive Kalman filter for a linear dynamic system perturbed by an additive disturbance. The objective is to estimate both of the state and the unknown disturbance concurrently, while learning the disturbance as a…

Optimization and Control · Mathematics 2019-10-23 Taeyoung Lee

The Unscented Kalman Filter (UKF) is a ubiquitous tool for nonlinear state estimation; however, its performance is limited by the static parameterization of the Unscented Transform (UT). Conventional weighting schemes, governed by fixed…

Machine Learning · Computer Science 2026-03-05 Kenan Majewski , Michał Modzelewski , Marcin Żugaj , Piotr Lichota

Recursive least squares (RLS) is derived as the recursive minimizer of the least-squares cost function. Moreover, it is well known that RLS is a special case of the Kalman filter. This work presents the Kalman filter least squares (KFLS)…

Systems and Control · Electrical Eng. & Systems 2024-04-18 Brian Lai , Dennis S. Bernstein

Contemporary data assimilation often involves millions of prediction variables. The classical Kalman filter is no longer computationally feasible in such a high dimensional context. This problem can often be resolved by exploiting the…

Statistics Theory · Mathematics 2016-06-30 Andrew J. Majda , Xin T. Tong

Learning new task-specific skills from a few trials is a fundamental challenge for artificial intelligence. Meta reinforcement learning (meta-RL) tackles this problem by learning transferable policies that support few-shot adaptation to…

Machine Learning · Computer Science 2022-11-22 Zhizhou Ren , Anji Liu , Yitao Liang , Jian Peng , Jianzhu Ma

This paper presents the construction of a particle filter, which incorporates elements inspired by genetic algorithms, in order to achieve accelerated adaptation of the estimated posterior distribution to changes in model parameters.…

Machine Learning · Statistics 2018-06-15 Karol Gellert , Erik Schlögl

Biomedical imaging is unequivocally dependent on the ability to reconstruct interpretable and high-quality images from acquired sensor data. This reconstruction process is pivotal across many applications, spanning from magnetic resonance…

Signal Processing · Electrical Eng. & Systems 2019-09-24 Ben Luijten , Regev Cohen , Frederik J. de Bruijn , Harold A. W. Schmeitz , Massimo Mischi , Yonina C. Eldar , Ruud J. G. van Sloun

Cross-lingual speech adaptation aims to solve the problem of leveraging multiple rich-resource languages to build models for a low-resource target language. Since the low-resource language has limited training data, speech recognition…

Computation and Language · Computer Science 2021-12-21 Wenxin Hou , Han Zhu , Yidong Wang , Jindong Wang , Tao Qin , Renjun Xu , Takahiro Shinozaki

Fine-tuning large language models (LLMs) has become essential for adapting pretrained models to specific downstream tasks. In this paper, we propose Linear Chain Transformation (LinChain), a novel approach that introduces a sequence of…

Computation and Language · Computer Science 2024-11-04 Yulong Wang , Chang Zuo , Yin Xuan , Hong Li , Ni Wei

Log messages record important system runtime information and are useful for detecting anomalous behaviors and managing modern software systems. Many supervised and unsupervised learning methods have been proposed recently for log-based…

Machine Learning · Computer Science 2025-04-07 Yiyuan Xiong , Shaofeng Cai

Learning systems deployed in nonstationary and safety-critical environments often suffer from instability, slow convergence, or brittle adaptation when learning dynamics evolve over time. While modern optimization, reinforcement learning,…

Machine Learning · Computer Science 2026-01-05 Akash Samanta , Sheldon Williamson

Recently, deep neural networks such as RNN, CNN and Transformer have been applied in the task of sequential recommendation, which aims to capture the dynamic preference characteristics from logged user behavior data for accurate…

Information Retrieval · Computer Science 2022-03-01 Kun Zhou , Hui Yu , Wayne Xin Zhao , Ji-Rong Wen

Neural networks require a large amount of annotated data to learn. Meta-learning algorithms propose a way to decrease the number of training samples to only a few. One of the most prominent optimization-based meta-learning algorithms is…

Machine Learning · Computer Science 2022-06-14 Kostiantyn Khabarlak

This short note addresses the design of a partially adaptive filter to retrieve a signal of interest in the presence of strong low-rank interference and thermal noise. We consider a generalized sidelobe canceler implementation where the…

Signal Processing · Electrical Eng. & Systems 2022-03-22 Olivier Besson