English
Related papers

Related papers: TAG-K: Tail-Averaged Greedy Kaczmarz for Computati…

200 papers

Robotic systems operating at the edge require efficient online learning algorithms that can continuously adapt to changing environments while processing streaming sensory data. Traditional backpropagation, while effective, conflicts with…

Machine Learning · Computer Science 2025-10-31 Darius Masoum Zadeh-Jousdani , Elvin Hajizada , Eyke Hüllermeier

We analyze task orderings in continual learning for linear regression, assuming joint realizability of training data. We focus on orderings that greedily maximize dissimilarity between consecutive tasks, a concept briefly explored in prior…

Machine Learning · Computer Science 2025-10-24 Matan Tsipory , Ran Levinstein , Itay Evron , Mark Kong , Deanna Needell , Daniel Soudry

A class of fast greedy block Kaczmarz methods combined with general greedy strategy and average technique are proposed for solving large consistent linear systems. Theoretical analysis of the convergence of the proposed method is given in…

Numerical Analysis · Mathematics 2022-10-18 Aqin Xiao , Junfeng Yin , Ning Zheng

Randomized Kaczmarz-type methods are widely used for their simplicity and efficiency in solving large-scale linear systems and optimization problems. However, their applicability is limited when dealing with inconsistent systems or…

Numerical Analysis · Mathematics 2025-12-11 Zeyu Dong , Aqin Xiao , Guojian Yin , Junfeng Yin

Accurate prediction of real-world pedestrian trajectories is crucial for a wide range of robot-related applications. Recent approaches typically adopt graph-based or transformer-based frameworks to model interactions. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Ruochen Li , Ziyi Chang , Junyan Hu , Jiannan Li , Amir Atapour-Abarghouei , Hubert P. H. Shum

Large-scale linear systems, $Ax=b$, frequently arise in practice and demand effective iterative solvers. Often, these systems are noisy due to operational errors or faulty data-collection processes. In the past decade, the randomized…

Numerical Analysis · Mathematics 2024-08-26 El Houcine Bergou , Soumia Boucherouite , Aritra Dutta , Xin Li , Anna Ma

In human-robot collaboration (HRC), robots must adapt online to dynamic task constraints and evolving human intent. While physical corrections provide a natural, low-latency channel for operators to convey motion-level adjustments,…

Robotics · Computer Science 2026-03-13 Jiurun Song , Xiao Liang , Minghui Zheng

Kaczmarz method is one popular iterative method for solving inverse problems, especially in computed tomography. Recently, it was established that a randomized version of the method enjoys an exponential convergence for well-posed problems,…

Numerical Analysis · Mathematics 2017-12-06 Yuling Jiao , Bangti Jin , Xiliang Lu

Kaczmarz is one of the most prominent iterative solvers for linear systems of equations. Despite substantial research progress in recent years, the state-of-the-art Kaczmarz algorithms have not fully resolved the seesaw effect, a major…

Numerical Analysis · Mathematics 2025-09-24 Aneesh Panchal , Ratikanta Behera

The famous greedy randomized Kaczmarz (GRK) method uses the greedy selection rule on maximum distance to determine a subset of the indices of working rows. In this paper, with the greedy selection rule on maximum residual, we propose the…

Numerical Analysis · Mathematics 2020-11-16 Yanjun Zhang , Hanyu Li

The Kaczmarz algorithm is a well known iterative method for solving overdetermined linear systems. Its randomized version yields provably exponential convergence in expectation. In this paper, we propose two new methods to speed up the…

Numerical Analysis · Computer Science 2016-08-02 Tengfei Ma

The Kaczmarz algorithm is a popular solver for overdetermined linear systems due to its simplicity and speed. In this paper, we propose a modification that speeds up the convergence of the randomized Kaczmarz algorithm for systems of linear…

Numerical Analysis · Computer Science 2013-05-17 Hassan Mansour , Ozgur Yilmaz

Fine-grained human action recognition (FHAR) is challenging because visually similar actions differ by subtle spatio-temporal cues. Many recent systems enhance discriminability with extra modalities (e.g., pose, text, optical flow), but…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Imtiaz Ul Hassan , Nik Bessis , Ardhendu Behera

We study the problem of modelling high-dimensional, heavy-tailed time series data via a factor-adjusted vector autoregressive (VAR) model, which simultaneously accounts for pervasive co-movements of the variables by a handful of factors, as…

Methodology · Statistics 2026-04-27 Dylan Dijk , Haeran Cho

Scalable web search systems typically employ multi-stage retrieval architectures, where an initial stage generates a set of candidate documents that are then pruned and re-ranked. Since subsequent stages typically exploit a multitude of…

Information Retrieval · Computer Science 2017-12-12 Joel Mackenzie , J. Shane Culpepper , Roi Blanco , Matt Crane , Charles L. A. Clarke , Jimmy Lin

Meta learning is a promising paradigm in the era of large models and task distributional robustness has become an indispensable consideration in real-world scenarios. Recent advances have examined the effectiveness of tail task risk…

Machine Learning · Computer Science 2024-10-31 Yiqin Lv , Qi Wang , Dong Liang , Zheng Xie

Our paper proposes a model predictive controller as a single-task formulation that simultaneously optimizes wheel and torso motions. This online joint velocity and ground reaction force optimization integrates a kinodynamic model of a…

Robotics · Computer Science 2021-07-07 Marko Bjelonic , Ruben Grandia , Oliver Harley , Cla Galliard , Samuel Zimmermann , Marco Hutter

With the growth of large data as well as large-scale learning tasks, the need for efficient and robust linear system solvers is greater than ever. The randomized Kaczmarz method (RK) and similar stochastic iterative methods have received…

Numerical Analysis · Mathematics 2023-01-04 Lu Cheng , Benjamin Jarman , Deanna Needell , Elizaveta Rebrova

A greedy randomized nonlinear Bregman-Kaczmarz method by sampling the working index with residual information is developed for the solution of the constrained nonlinear system of equations. Theoretical analyses prove the convergence of the…

Numerical Analysis · Mathematics 2024-06-25 Aqin Xiao , Junfeng Yin

Purpose: This paper aims to enhance bearing fault diagnosis in industrial machinery by introducing a novel method that combines Graph Attention Network (GAT) and Long Short-Term Memory (LSTM) networks. This approach captures both spatial…