English
Related papers

Related papers: Block-Sparsity-Induced Adaptive Filter for Multi-C…

200 papers

In this work, a new class of stochastic gradient algorithm is developed based on $q$-calculus. Unlike the existing $q$-LMS algorithm, the proposed approach fully utilizes the concept of $q$-calculus by incorporating time-varying $q$…

Optimization and Control · Mathematics 2018-01-03 Shujaat Khan , Alishba Sadiq , Imran Naseem , Roberto Togneri , Mohammed Bennamoun

In this paper, we propose a new greedy algorithm for sparse approximation, called SLS for Single L_1 Selection. SLS essentially consists of a greedy forward strategy, where the selection rule of a new component at each iteration is based on…

Optimization and Control · Mathematics 2021-02-12 Ramzi Ben Mhenni , Sébastien Bourguignon , Jérôme Idier

Blocking, a special case of rerandomization, is routinely implemented in the design stage of randomized experiments to balance the baseline covariates. This study proposes a regression adjustment method based on the least absolute shrinkage…

Methodology · Statistics 2024-11-15 Ke Zhu , Hanzhong Liu , Yuehan Yang

Accurate channel estimation is essential for broadband wireless communications. As wireless channels often exhibit sparse structure, the adaptive sparse channel estimation algorithms based on normalized least mean square (NLMS) have been…

Information Theory · Computer Science 2013-11-07 Guan Gui , Linglong Dai , Shinya Kumagai , Fumiyuki Adachi

Learned sparse retrieval systems aim to combine the effectiveness of contextualized language models with the scalability of conventional data structures such as inverted indexes. Nevertheless, the indexes generated by these systems exhibit…

Information Retrieval · Computer Science 2024-05-03 Antonio Mallia , Torten Suel , Nicola Tonellotto

Downlink channel estimation with low pilot overhead is an important and challenging problem in large-scale MIMO systems due to the substantially increased MIMO channel dimension. In this letter, we propose a block iterative support…

Information Theory · Computer Science 2015-12-14 Wenqian Shen , Linglong Dai , Zhen Gao , Zhaocheng Wang

Block-sparse regularization is already well-known in active thermal imaging and is used for multiple measurement based inverse problems. The main bottleneck of this method is the choice of regularization parameters which differs for each…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Samim Ahmadi , Jan Christian Hauffen , Linh Kästner , Peter Jung , Giuseppe Caire , Mathias Ziegler

This paper considers the distributed sparse identification problem over wireless sensor networks such that all sensors cooperatively estimate the unknown sparse parameter vector of stochastic dynamic systems by using the local information…

Systems and Control · Electrical Eng. & Systems 2022-03-08 Die Gan , Zhixin Liu

This paper presents novel adaptive space-time reduced-rank interference suppression least squares algorithms based on joint iterative optimization of parameter vectors. The proposed space-time reduced-rank scheme consists of a joint…

Information Theory · Computer Science 2013-01-15 Rodrigo C. de Lamare , Raimundo Sampaio-Neto

In this paper, a low complexity time domain semi-blind algorithm is proposed to estimate and track the time varying MIMO OFDM channels. First, the proposed least mean squares (LMS) based algorithm is developed for the training mode and then…

Signal Processing · Electrical Eng. & Systems 2018-02-02 Ebrahim Karami , Markku Juntti

Large language models (LLMs) have demonstrated outstanding performance in various tasks, such as text summarization, text question-answering, and etc. While their performance is impressive, the computational footprint due to their vast…

Machine Learning · Computer Science 2024-04-22 Peng Xu , Wenqi Shao , Mengzhao Chen , Shitao Tang , Kaipeng Zhang , Peng Gao , Fengwei An , Yu Qiao , Ping Luo

We consider the problem of estimating the parameters of a Gaussian or binary distribution in such a way that the resulting undirected graphical model is sparse. Our approach is to solve a maximum likelihood problem with an added l_1-norm…

Artificial Intelligence · Computer Science 2007-07-06 Onureena Banerjee , Laurent El Ghaoui , Alexandre d'Aspremont

In this work, we propose an adaptive sparse learning algorithm that can be applied to learn the physical processes and obtain a sparse representation of the solution given a large snapshot space. Assume that there is a rich class of…

Machine Learning · Computer Science 2022-07-26 Yating Wang , Wing Tat Leung , Guang Lin

Gaussian processes (GPs) stand as crucial tools in machine learning and signal processing, with their effectiveness hinging on kernel design and hyper-parameter optimization. This paper presents a novel GP linear multiple kernel (LMK) and a…

Machine Learning · Computer Science 2025-01-17 Richard Cornelius Suwandi , Zhidi Lin , Feng Yin , Zhiguo Wang , Sergios Theodoridis

Significant attention has been given to minimizing a penalized least squares criterion for estimating sparse solutions to large linear systems of equations. The penalty is responsible for inducing sparsity and the natural choice is the…

Machine Learning · Statistics 2015-03-20 Goran Marjanovic , Magnus O. Ulfarsson , Alfred O. Hero

The goal of this paper is to achieve a computational model and corresponding efficient algorithm for obtaining a sparse representation of the fitting surface to the given scattered data. The basic idea of the model is to utilize the…

Numerical Analysis · Mathematics 2017-04-27 Yong-Xia Hao , Chong-Jun Li , Ren-Hong Wang

Most studies of adaptive algorithm behavior consider performance measures based on mean values such as the mean-square error. The derived models are useful for understanding the algorithm behavior under different environments and can be…

Methodology · Statistics 2023-12-04 Marcos H. Maruo , José Carlos M. Bermudez

In general, one often encounters the systems that have sparse impulse response, with time varying system sparsity. Conventional adaptive filters which perform well for identification of non-sparse systems fail to exploit the system sparsity…

Systems and Control · Computer Science 2015-09-11 Vinay Chakravarthi Gogineni

The least-absolute shrinkage and selection operator (LASSO) is a regularization technique for estimating sparse signals of interest emerging in various applications and can be efficiently solved via the alternating direction method of…

Information Theory · Computer Science 2022-08-25 Huiyue Yi , Yan Xu , Wuxiong Zhang , Hui Xu

Mixtures of linear mixed models (MLMMs) are useful for clustering grouped data and can be estimated by likelihood maximization through the EM algorithm. The conventional approach to determining a suitable number of components is to compare…

Applications · Statistics 2014-05-26 Siew Li Tan , David J. Nott