English
Related papers

Related papers: Robust Low-Rank LCMV Beamforming Algorithms Based …

200 papers

We propose an improved version of the SMO algorithm for training classification and regression SVMs, based on a Conjugate Descent procedure. This new approach only involves a modest increase on the computational cost of each iteration but,…

Optimization and Control · Mathematics 2020-03-20 Alberto Torres-Barrán , Carlos Alaíz , José R. Dorronsoro

In this paper, we propose an adaptive framework for the variable power of the fractional least mean square (FLMS) algorithm. The proposed algorithm named as robust variable power FLMS (RVP-FLMS) dynamically adapts the fractional power of…

Optimization and Control · Mathematics 2017-02-07 Jawwad Ahmad , Muhammad Usman , Shujaat Khan , Imran Naseem , Hassan Jamil Syed

We propose and analyse a reduced-rank method for solving least-squares regression problems with infinite dimensional output. We derive learning bounds for our method, and study under which setting statistical performance is improved in…

Machine Learning · Statistics 2022-11-17 Luc Brogat-Motte , Alessandro Rudi , Céline Brouard , Juho Rousu , Florence d'Alché-Buc

In this paper, we consider the learning of a Reduced-Order Linear Parameter-Varying Model (ROLPVM) of a nonlinear dynamical system based on data. This is achieved by a two-step procedure. In the first step, we learn a projection to a lower…

Systems and Control · Electrical Eng. & Systems 2024-05-21 Patrick J. W. Koelewijn , Rajiv Sing , Peter Seiler , Roland Tóth

Bilinear matrix inequality (BMI) problems in system and control designs are investigated in this paper. A solution method of reduction of variables (MRVs) is proposed. This method consists of a principle of variable classification, a…

Systems and Control · Electrical Eng. & Systems 2026-01-16 Wei-Yu Chiu

This work considers the low-rank approximation of a matrix $A(t)$ depending on a parameter $t$ in a compact set $D \subset \mathbb{R}^d$. Application areas that give rise to such problems include computational statistics and dynamical…

Numerical Analysis · Mathematics 2024-04-18 Daniel Kressner , Hei Yin Lam

In this work, we propose a novel adaptive reduced-rank receive processing strategy based on joint preprocessing, decimation and filtering (JPDF) for large-scale multiple-antenna systems. In this scheme, a reduced-rank framework is employed…

Information Theory · Computer Science 2016-11-15 Y. Cai , R. C. de Lamare , B. Qin , B. Champagne , M. Zhao

We consider the problem of high-dimensional channel estimation in fast time-varying millimeter-wave MIMO systems with a hybrid architecture. By exploiting the low-rank and sparsity properties of the channel matrix, we propose a two-phase…

Signal Processing · Electrical Eng. & Systems 2025-11-04 Tianyu Jiang , Yan Yang , Hongjin Liu , Runyu Han , Bo Ai , Mohsen Guizani

The rapid advancements in large language models (LLMs) have revolutionized natural language processing, creating an increased need for efficient, task-specific fine-tuning methods. Traditional fine-tuning of LLMs involves updating a large…

Computation and Language · Computer Science 2024-11-26 Ayush Singh , Rajdeep Aher , Shivank Garg

Massive MIMO system yields significant improvements in spectral and energy efficiency for future wireless communication systems. The regularized zero-forcing (RZF) beamforming is able to provide good performance with the capability of…

Information Theory · Computer Science 2020-03-31 Hayoung Choi , Tao Jiang , Yuanming Shi , Xuan Liu , Khaled B. Letaief

How to efficiently identify multiple-input multiple-output (MIMO) linear parameter-varying (LPV) discrete-time state-space (SS) models with affine dependence on the scheduling variable still remains an open question, as identification…

Systems and Control · Computer Science 2020-05-11 Pepijn B. Cox , Roland Tóth , Mihály Petreczky

In this paper, the problem of sequential beam construction and adaptive channel estimation based on reduced rank (RR) Kalman filtering for frequency-selective massive multiple-input multiple-output (MIMO) systems employing single-carrier…

Information Theory · Computer Science 2017-03-10 Gokhan M. Guvensen , Ender Ayanoglu

While matrix variate regression models have been studied in many existing works, classical statistical and computational methods for the analysis of the regression coefficient estimation are highly affected by high dimensional and noisy…

Machine Learning · Statistics 2022-05-17 Hsin-Hsiung Huang , Feng Yu , Xing Fan , Teng Zhang

Low-rank approximation of a matrix by means of random sampling has been consistently efficient in its empirical studies by many scientists who applied it with various sparse and structured multipliers, but adequate formal support for this…

Numerical Analysis · Mathematics 2016-06-07 Victor Y. Pan , Liang Zhao

Due to the substantial scale of Large Language Models (LLMs), the direct application of conventional compression methodologies proves impractical. The computational demands associated with even minimal gradient updates present challenges,…

Machine Learning · Computer Science 2023-12-13 Arnav Chavan , Nahush Lele , Deepak Gupta

We study risk-sensitive Reinforcement Learning (RL), where we aim to maximize the Conditional Value at Risk (CVaR) with a fixed risk tolerance $\tau$. Prior theoretical work studying risk-sensitive RL focuses on the tabular Markov Decision…

Machine Learning · Computer Science 2023-11-21 Yulai Zhao , Wenhao Zhan , Xiaoyan Hu , Ho-fung Leung , Farzan Farnia , Wen Sun , Jason D. Lee

Iterative algorithms are ubiquitous in the field of data mining. Widely known examples of such algorithms are the least mean square algorithm, backpropagation algorithm of neural networks. Our contribution in this paper is an improvement…

Machine Learning · Computer Science 2013-10-09 Rangeet Mitra , Amit Kumar Mishra

We propose a dynamical low-rank algorithm for a gyrokinetic model that is used to describe strongly magnetized plasmas. The low-rank approximation is based on a decomposition into variables parallel and perpendicular to the magnetic field,…

Computational Physics · Physics 2023-07-03 Lukas Einkemmer

Due to the demand for efficient fine-tuning of large language models, Low-Rank Adaptation (LoRA) has been widely adopted as one of the most effective parameter-efficient fine-tuning methods. Nevertheless, while LoRA improves efficiency,…

Computation and Language · Computer Science 2025-06-13 Naibin Gu , Zhenyu Zhang , Xiyu Liu , Peng Fu , Zheng Lin , Shuohuan Wang , Yu Sun , Hua Wu , Weiping Wang , Haifeng Wang

Although Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across diverse tasks, they encounter challenges in terms of reasoning efficiency, large model size and overthinking. However, existing lightweight…

Artificial Intelligence · Computer Science 2025-11-21 Qixiang Yin , Huanjin Yao , Jianghao Chen , Jiaxing Huang , Zhicheng Zhao , Fei Su