English
Related papers

Related papers: SSR: A Training-Free Approach for Streaming 3D Rec…

200 papers

Despite rapid advancements in lifelong learning (LLL) research, a large body of research mainly focuses on improving the performance in the existing \textit{static} continual learning (CL) setups. These methods lack the ability to succeed…

Machine Learning · Computer Science 2023-01-30 Soumya Banerjee , Vinay Kumar Verma , Vinay P. Namboodiri

3D Gaussian Splatting (3DGS) enables high-quality rendering of 3D scenes and is getting increasing adoption in domains like autonomous driving and embodied intelligence. However, 3DGS still faces major efficiency challenges when faced with…

Hardware Architecture · Computer Science 2025-07-31 Linye Wei , Jiajun Tang , Fan Fei , Boxin Shi , Runsheng Wang , Meng Li

Real-time reconstruction of dynamic 3D scenes from uncalibrated video streams demands robust online methods that recover scene dynamics from sparse observations under strict latency and memory constraints. Yet most dynamic reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Zike Wu , Qi Yan , Xuanyu Yi , Lele Wang , Renjie Liao

Streaming 3D reconstruction under a strict constant-memory budget hinges on how the recurrent state is updated as the stream evolves. We profile TTT3R-style per-token gates across five benchmarks and discover a structural bottleneck: the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Kejun Ren , Lei Jin , Tianxin Huang , Lianming Xu , Li Wang

We present a novel approach for recovering 3D shape and view dependent appearance from a few colored images, enabling efficient 3D reconstruction and novel view synthesis. Our method learns an implicit neural representation in the form of a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Mae Younes , Amine Ouasfi , Adnane Boukhayma

Self-supervised learning (SSL) has emerged as a powerful paradigm for learning representations without labeled data. Most SSL approaches rely on strong, well-established, handcrafted data augmentations to generate diverse views for…

Machine Learning · Computer Science 2026-01-16 Berken Utku Demirel , Christian Holz

Large scale, streaming datasets are ubiquitous in modern machine learning. Streaming algorithms must be scalable, amenable to incremental training and robust to the presence of non-stationarity. In this work consider the problem of learning…

Machine Learning · Statistics 2017-12-15 Ricardo Pio Monti , Christoforos Anagnostopoulos , Giovanni Montana

Streaming adaptations of manifold learning based dimensionality reduction methods, such as Isomap, are based on the assumption that a small initial batch of observations is enough for exact learning of the manifold, while remaining…

Machine Learning · Statistics 2020-07-20 Suchismit Mahapatra , Varun Chandola

Online 3D reconstruction requires estimating camera pose and scene geometry under strict causal and bounded-memory constraints. Existing methods often suffer from drift, jitter, or collapse on long sequences. We trace these failures to a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Chong Cheng , Peilin Tao , Nanjie Yao , Guanzhi Ding , Xianda Chen , Yuansen Du , Xiaoyang Guo , Wei Yin , Weiqiang Ren , Qian Zhang , Zhengqing Chen , Hao Wang

Natural intelligence processes experience as a continuous stream, sensing, acting, and learning moment-by-moment in real time. Streaming learning, the modus operandi of classic reinforcement learning (RL) algorithms like Q-learning and TD,…

Machine Learning · Computer Science 2024-12-09 Mohamed Elsayed , Gautham Vasan , A. Rupam Mahmood

Despite the promising performance of state space models (SSMs) in long sequence modeling, limitations still exist. Advanced SSMs like S5 and S6 (Mamba) in addressing non-uniform sampling, their recursive structures impede efficient SSM…

Machine Learning · Computer Science 2024-06-11 Biqing Qi , Junqi Gao , Kaiyan Zhang , Dong Li , Jianxing Liu , Ligang Wu , Bowen Zhou

Recently, studies on machine learning have focused on methods that use symmetry implicit in a specific manifold as an inductive bias. Grassmann manifolds provide the ability to handle fundamental shapes represented as shape spaces, enabling…

Machine Learning · Computer Science 2023-12-06 Ryoma Yataka , Kazuki Hirashima , Masashi Shiraishi

Recent advances in generalizable 3D Gaussian Splatting (3DGS) have enabled rapid 3D scene reconstruction within seconds, eliminating the need for per-scene optimization. However, existing methods primarily follow an offline reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Chong Xia , Fangfu Liu , Yule Wang , Yize Pang , Yueqi Duan

Many areas in science and engineering now have access to technologies that enable the rapid collection of overwhelming data volumes. While these datasets are vital for understanding phenomena from physical to biological and social systems,…

Signal Processing · Electrical Eng. & Systems 2026-01-14 Nicholas P. Bertrand , Eva Yezerets , Han Lun Yap , Adam S. Charles , Christopher J. Rozell

This paper proposes a self-regularised minimum latency training (SR-MLT) method for streaming Transformer-based automatic speech recognition (ASR) systems. In previous works, latency was optimised by truncating the online attention weights…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-25 Mohan Li , Rama Doddipatla , Catalin Zorila

Unification of automatic speech recognition (ASR) systems reduces development and maintenance costs, but training a single model to perform well in both offline and low-latency streaming settings remains challenging. We present a Unified…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-22 Andrei Andrusenko , Vladimir Bataev , Lilit Grigoryan , Nune Tadevosyan , Vitaly Lavrukhin , Boris Ginsburg

The field of self-supervised 3D representation learning has emerged as a promising solution to alleviate the challenge presented by the scarcity of extensive, well-annotated datasets. However, it continues to be hindered by the lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yunsong Wang , Na Zhao , Gim Hee Lee

Recent advancements in multi-view scene reconstruction have been significant, yet existing methods face limitations when processing streams of input images. These methods either rely on time-consuming offline optimization or are restricted…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Zhuoguang Chen , Minghui Qin , Tianyuan Yuan , Zhe Liu , Hang Zhao

Despite overparameterization, deep networks trained via supervised learning are easy to optimize and exhibit excellent generalization. One hypothesis to explain this is that overparameterized deep networks enjoy the benefits of implicit…

Machine Learning · Computer Science 2021-12-10 Aviral Kumar , Rishabh Agarwal , Tengyu Ma , Aaron Courville , George Tucker , Sergey Levine

Recent advances in autoregressive neural surrogate models have enabled orders-of-magnitude speedups in simulating dynamical systems. However, autoregressive models are generally prone to distribution drift: compounding errors in…

Machine Learning · Computer Science 2026-03-19 Qi Liu , Laure Zanna , Joan Bruna