English
Related papers

Related papers: TTSA3R: Training-Free Temporal-Spatial Adaptive Pe…

200 papers

Realtime 4D reconstruction for dynamic scenes remains a crucial challenge for autonomous driving perception. Most existing methods rely on depth estimation through self-supervision or multi-modality sensor fusion. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xin Fei , Wenzhao Zheng , Yueqi Duan , Wei Zhan , Masayoshi Tomizuka , Kurt Keutzer , Jiwen Lu

Video Question Answering (VideoQA) is a complex video-language task that demands a sophisticated understanding of both visual content and temporal dynamics. Traditional Transformer-style architectures, while effective in integrating…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Zijie Song , Zhenzhen Hu , Yixiao Ma , Jia Li , Richang Hong

Real-time monocular 3D reconstruction is a challenging problem that remains unsolved. Although recent end-to-end methods have demonstrated promising results, tiny structures and geometric boundaries are hardly captured due to their…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Chenyangguang Zhang , Zhiqiang Lou , Yan Di , Federico Tombari , Xiangyang Ji

Multivariate time series forecasting (MTSF) seeks to model temporal dynamics among variables to predict future trends. Transformer-based models and large language models (LLMs) have shown promise due to their ability to capture long-range…

Machine Learning · Computer Science 2025-08-07 Abdul Monaf Chowdhury , Rabeya Akter , Safaeid Hossain Arib

Real-world sequential signals, such as audio or video, contain critical information that is often embedded within long periods of silence or noise. While recurrent neural networks (RNNs) are designed to process such data efficiently, they…

Machine Learning · Computer Science 2026-05-01 Bojian Yin , Shurong Wang , Haoyu Tan , Sander Bohte , Federico Corradi , Guoqi Li

Humans perceive and understand real-world spaces through a stream of visual observations. Therefore, the ability to streamingly maintain and update spatial evidence from potentially unbounded video streams is essential for spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Fangfu Liu , Diankun Wu , Jiawei Chi , Yimo Cai , Yi-Hsin Hung , Xumin Yu , Hao Li , Han Hu , Yongming Rao , Yueqi Duan

We introduce a novel, training-free system for reconstructing, understanding, and rendering 3D indoor scenes from a sparse set of unposed RGB images. Unlike traditional radiance field approaches that require dense views and per-scene…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jiatong Xia , Lingqiao Liu

Simultaneous understanding and 3D reconstruction plays an important role in developing end-to-end embodied intelligent systems. To achieve this, recent approaches resort to 2D-to-3D feature alignment paradigm, which leads to limited 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Qi Xu , Dongxu Wei , Lingzhe Zhao , Wenpu Li , Zhangchi Huang , Shunping Ji , Peidong Liu

Processing long videos with multimodal large language models (MLLMs) poses a significant computational challenge, as the model's self-attention mechanism scales quadratically with the number of video tokens, resulting in high computational…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Kaibin Wang , Mingbao Lin

Recent synthetic speech detectors leveraging the Transformer model have superior performance compared to the convolutional neural network counterparts. This improvement could be due to the powerful modeling ability of the multi-head…

Sound · Computer Science 2024-09-10 Duc-Tuan Truong , Ruijie Tao , Tuan Nguyen , Hieu-Thi Luong , Kong Aik Lee , Eng Siong Chng

We tackle the challenging problem of source-free unsupervised domain adaptation (SFUDA) for 3D semantic segmentation. It amounts to performing domain adaptation on an unlabeled target domain without any access to source data; the available…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Björn Michele , Alexandre Boulch , Tuan-Hung Vu , Gilles Puy , Renaud Marlet , Nicolas Courty

In recent years, 2D Convolutional Networks-based video action recognition has encouragingly gained wide popularity; However, constrained by the lack of long-range non-linear temporal relation modeling and reverse motion information…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Yongkang Zhang , Jun Li , Guoming Wu , Han Zhang , Zhiping Shi , Zhaoxun Liu , Zizhang Wu

Dense 3D scene reconstruction from an ordered sequence or unordered image collections is a critical step when bringing research in computer vision into practical scenarios. Following the paradigm introduced by DUSt3R, which unifies an image…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yuqi Wu , Wenzhao Zheng , Jie Zhou , Jiwen Lu

Test-Time Adaptation (TTA) enables pre-trained models to adjust to distribution shift by learning from unlabeled test-time streams. However, existing methods typically treat these streams as independent samples, overlooking the supervisory…

Machine Learning · Computer Science 2026-01-30 Young Kyung Kim , Oded Schlesinger , Qiangqiang Wu , J. Matías Di Martino , Guillermo Sapiro

Recent studies on long-term time series forecasting have shown that simple linear models and MLP-based predictors can achieve strong performance without increasingly complex architectures. However, many competitive baselines still rely on…

Machine Learning · Computer Science 2026-05-14 Zhenan Yu , Guangxin Jiang , Jin Yang

We present Edit3r, a feed-forward framework that reconstructs and edits 3D scenes in a single pass from unposed, view-inconsistent, instruction-edited images. Unlike prior methods requiring per-scene optimization, Edit3r directly predicts…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Jiageng Liu , Weijie Lyu , Xueting Li , Yejie Guo , Ming-Hsuan Yang

Video semantic segmentation (VSS) plays a vital role in understanding the temporal evolution of scenes. Traditional methods often segment videos frame-by-frame or in a short temporal window, leading to limited temporal context, redundant…

Image and Video Processing · Electrical Eng. & Systems 2025-03-28 Syed Ariff Syed Hesham , Yun Liu , Guolei Sun , Henghui Ding , Jing Yang , Ender Konukoglu , Xue Geng , Xudong Jiang

Transformers process images and videos by flattening space and time into long token sequences. While attention and KV caching preserve past features, their memory grows with sequence length and they lack an explicit, persistent spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Kabir Swain , Sijie Han , Daniel Karl I. Weidele , Mauro Martino , Antonio Torralba

DUSt3R-based end-to-end scene reconstruction has recently shown promising results in dense visual SLAM. However, most existing methods only use image pairs to estimate pointmaps, overlooking spatial memory and global consistency.To this…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Guole Shen , Tianchen Deng , Yanbo Wang , Yongtao Chen , Yilin Shen , Jiuming Liu , Jingchuan Wang

Real-world time series often exhibit a non-stationary nature, degrading the performance of pre-trained forecasting models. Test-Time Adaptation (TTA) addresses this by adjusting models during inference, but existing methods typically update…

Machine Learning · Computer Science 2025-07-01 Heitor R. Medeiros , Hossein Sharifi-Noghabi , Gabriel L. Oliveira , Saghar Irandoust