English
Related papers

Related papers: StreaMRAK a Streaming Multi-Resolution Adaptive Ke…

200 papers

Continual learning is increasingly sought after in real world machine learning applications, as it enables learning in a more human-like manner. Conventional machine learning approaches fail to achieve this, as incrementally updating the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Joe Khawand , Peter Hanappe , David Colliaux

The divide-and-conquer method has been widely used for estimating large-scale kernel ridge regression estimates. Unfortunately, when the response variable is highly skewed, the divide-and-conquer kernel ridge regression (dacKRR) may…

Machine Learning · Statistics 2021-11-11 Jingyi Zhang , Xiaoxiao Sun

This paper studies transfer learning for ridge-regularized robust linear regression in the moderate-dimensional regime, where the number of predictors is of the same order as the sample size and the regression coefficients are not assumed…

Methodology · Statistics 2026-04-14 Lingfeng Lyu , Xiao Guo , Zongqi Liu

Kernel methods provide a principled approach to nonparametric learning. While their basic implementations scale poorly to large problems, recent advances showed that approximate solvers can efficiently handle massive datasets. A shortcoming…

Machine Learning · Computer Science 2022-01-19 Giacomo Meanti , Luigi Carratino , Ernesto De Vito , Lorenzo Rosasco

In streaming Reinforcement Learning (RL), transitions are observed and discarded immediately after a single update. While this minimizes resource usage for on-device applications, it makes agents notoriously sample-inefficient, since…

Machine Learning · Computer Science 2026-02-11 Nilaksh , Antoine Clavaud , Mathieu Reymond , François Rivest , Sarath Chandar

The main focus of this work is a novel framework for the joint reconstruction and segmentation of parallel MRI (PMRI) brain data. We introduce an image domain deep network for calibrationless recovery of undersampled PMRI data. The proposed…

Image and Video Processing · Electrical Eng. & Systems 2021-02-03 Aniket Pramanik , Mathews Jacob

The exponential growth of data storage demands has necessitated the evolution of hierarchical storage management strategies [1]. This study explores the application of streaming machine learning [3] to revolutionize data prefetching within…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-30 Chiyu Cheng , Chang Zhou , Yang Zhao , Jin Cao

This paper carries out a large dimensional analysis of a variation of kernel ridge regression that we call \emph{centered kernel ridge regression} (CKRR), also known in the literature as kernel ridge regression with offset. This modified…

Machine Learning · Statistics 2020-04-22 Khalil Elkhalil , Abla Kammoun , Xiangliang Zhang , Mohamed-Slim Alouini , Tareq Al-Naffouri

This paper focuses on parameter selection issues of kernel ridge regression (KRR). Due to special spectral properties of KRR, we find that delicate subdivision of the parameter interval shrinks the difference between two successive KRR…

Machine Learning · Computer Science 2023-12-12 Shao-Bo Lin

Streaming rendered content is an attractive way to bring high-quality graphics to billions of mobile devices that do not have sufficient rendering power. Existing solutions render content on a server at a fixed frame rate, typically 30 or…

Image and Video Processing · Electrical Eng. & Systems 2026-05-13 Yaru Liu , Joseph G. March , Rafal K. Mantiuk

Multitask learning, i.e. taking advantage of the relatedness of individual tasks in order to improve performance on all of them, is a core challenge in the field of machine learning. We focus on matrix regression tasks where the rank of the…

Machine Learning · Computer Science 2019-10-29 Yotam Gigi , Ami Wiesel , Sella Nevo , Gal Elidan , Avinatan Hassidim , Yossi Matias

Kernel density estimation is a simple and effective method that lies at the heart of many important machine learning applications. Unfortunately, kernel methods scale poorly for large, high dimensional datasets. Approximate kernel density…

Data Structures and Algorithms · Computer Science 2019-12-06 Benjamin Coleman , Anshumali Shrivastava

Random feature (RF) has been widely used for node consistency in decentralized kernel ridge regression (KRR). Currently, the consistency is guaranteed by imposing constraints on coefficients of features, necessitating that the random…

Machine Learning · Computer Science 2024-09-23 Ruikai Yang , Fan He , Mingzhen He , Jie Yang , Xiaolin Huang

Streaming adaptations of manifold learning based dimensionality reduction methods, such as Isomap, are based on the assumption that a small initial batch of observations is enough for exact learning of the manifold, while remaining…

Machine Learning · Statistics 2020-07-20 Suchismit Mahapatra , Varun Chandola

Kernel analog forecasting (KAF) is a powerful methodology for data-driven, non-parametric forecasting of dynamically generated time series data. This approach has a rigorous foundation in Koopman operator theory and it produces good…

Dynamical Systems · Mathematics 2021-09-22 Dimitris Giannakis , Amelia Henriksen , Joel A. Tropp , Rachel Ward

We present StreamBridge, a simple yet effective framework that seamlessly transforms offline Video-LLMs into streaming-capable models. It addresses two fundamental challenges in adapting existing models into online scenarios: (1) limited…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Haibo Wang , Bo Feng , Zhengfeng Lai , Mingze Xu , Shiyu Li , Weifeng Ge , Afshin Dehghan , Meng Cao , Ping Huang

This paper introduces kernel continual learning, a simple but effective variant of continual learning that leverages the non-parametric nature of kernel methods to tackle catastrophic forgetting. We deploy an episodic memory unit that…

Machine Learning · Computer Science 2021-07-16 Mohammad Mahdi Derakhshani , Xiantong Zhen , Ling Shao , Cees G. M. Snoek

Kernel ridge regression (KRR) is a fundamental computational tool, appearing in problems that range from computational chemistry to health analytics, with a particular interest due to its starring role in Gaussian process regression.…

Machine Learning · Computer Science 2026-01-28 Pratik Rathore , Zachary Frangella , Jiaming Yang , Michał Dereziński , Madeleine Udell

Gaussian processes offer a flexible kernel method for regression. While Gaussian processes have many useful theoretical properties and have proven practically useful, they suffer from poor scaling in the number of observations. In…

Machine Learning · Statistics 2021-08-26 Nick Terry , Youngjun Choe

We introduce a new computational model for data streams: asymptotically exact streaming algorithms. These algorithms have an approximation ratio that tends to one as the length of the stream goes to infinity while the memory used by the…

Data Structures and Algorithms · Computer Science 2014-08-11 Marc Heinrich , Alexander Munteanu , Christian Sohler