English
Related papers

Related papers: OccamVTS: Distilling Vision Models to 1% Parameter…

200 papers

Time series forecasting is a critical task across domains such as energy, finance, and meteorology, where accurate predictions enable informed decision-making. While transformer-based and large-parameter models have recently achieved…

Machine Learning · Computer Science 2026-02-11 Julien Guité-Vinet , Alexandre Blondin Massé , Éric Beaudry

Recent advances in lightweight time series forecasting models suggest the inherent simplicity of time series forecasting tasks. In this paper, we present CMoS, a super-lightweight time series forecasting model. Instead of learning the…

Machine Learning · Computer Science 2025-05-27 Haotian Si , Changhua Pei , Jianhui Li , Dan Pei , Gaogang Xie

Time Series Forecasting (TSF) is critical in many real-world domains like financial planning and health monitoring. Recent studies have revealed that Large Language Models (LLMs), with their powerful in-contextual modeling capabilities,…

Machine Learning · Computer Science 2025-03-14 Jialiang Tang , Shuo Chen , Chen Gong , Jing Zhang , Dacheng Tao

Amidst the advancements in image-based Large Vision-Language Models (image-LVLM), the transition to video-based models (video-LVLM) is hindered by the limited availability of quality video data. This paper addresses the challenge by…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Shimin Chen , Yitian Yuan , Shaoxiang Chen , Zequn Jie , Lin Ma

This paper considers the problem of variable selection allowing for parameter instability. It distinguishes between signal and pseudo-signal variables that are correlated with the target variable, and noise variables that are not, and…

Econometrics · Economics 2024-07-17 Alexander Chudik , M. Hashem Pesaran , Mahrad Sharifvaghefi

Model visualization (ModelVis) has emerged as a major research direction, yet existing taxonomies are largely organized by data or tasks, making it difficult to treat models as first-class analysis objects. We present a model-centric…

Machine Learning · Computer Science 2026-03-31 Siyu Wu , Lei Shi , Lei Xia , Cenyang Wu , Zipeng Liu , Yingchaojie Feng , Liang Zhou , Wei Chen

Despite significant advances in Vision Language Models (VLMs), they remain constrained by the complexity and redundancy of visual input. When images contain large amounts of irrelevant information, VLMs are susceptible to interference, thus…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Xinyu Zhang , Yuxuan Dong , Lingling Zhang , Chengyou Jia , Zhuohang Dang , Basura Fernando , Jun Liu , Mike Zheng Shou

Multivariate time series forecasting is widely used in various fields. Reasonable prediction results can assist people in planning and decision-making, generate benefits and avoid risks. Normally, there are two characteristics of time…

Machine Learning · Computer Science 2021-03-23 Yifu Zhou , Ziheng Duan , Haoyan Xu , Jie Feng , Anni Ren , Yueyang Wang , Xiaoqian Wang

This paper proposes LLaFS, the first attempt to leverage large language models (LLMs) in few-shot segmentation. In contrast to the conventional few-shot segmentation methods that only rely on the limited and biased information from the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Lanyun Zhu , Tianrun Chen , Deyi Ji , Jieping Ye , Jun Liu

With the rapid development of computer vision, Vision Transformers (ViTs) offer the tantalising prospect of unified information processing across visual and textual domains due to the lack of inherent inductive biases in ViTs. ViTs require…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Gousia Habib , Tausifa Jan Saleem , Ishfaq Ahmad Malik , Brejesh Lall

In this paper, approximate Linear Minimum Variance (LMV) filters for continuous-discrete state space models are introduced. The filters are obtained by means of a recursive approximation to the predictions for the first two moments of the…

Optimization and Control · Mathematics 2013-12-18 Juan Carlos Jimenez

In high-stakes domains, small task-specific vision models are crucial due to their low computational requirements and the availability of numerous methods to explain their results. However, these explanations often reveal that the models do…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Alexander Koebler , Lukas Kuhn , Ingo Thon , Florian Buettner

Vision-Language Models (VLMs) excel at reasoning in linguistic space but struggle with perceptual understanding that requires dense visual perception, e.g., spatial reasoning and geometric awareness. This limitation stems from the fact that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yiming Qin , Bomin Wei , Jiaxin Ge , Konstantinos Kallidromitis , Stephanie Fu , Trevor Darrell , XuDong Wang

Infrastructure-mounted sensors can capture rich environmental information to enhance communications and facilitate beamforming in millimeter-wave systems. This work presents an efficient sensing-assisted long-term beam tracking framework…

Signal Processing · Electrical Eng. & Systems 2026-05-21 Mengyuan Ma , Nhan Thanh Nguyen , Nir Shlezinger , Yonina C. Eldar , A. Lee Swindlehurst , Markku Juntti

Knowledge distillation offers a promising path to transfer reasoning capabilities from large teacher models to efficient student models; however, existing token-level on-policy distillation methods require token-level alignment between the…

Computation and Language · Computer Science 2026-01-30 Jing Xiong , Hui Shen , Shansan Gong , Yuxin Cheng , Jianghan Shen , Chaofan Tao , Haochen Tan , Haoli Bai , Lifeng Shang , Ngai Wong

Self-supervised VO methods have shown great success in jointly estimating camera pose and depth from videos. However, like most data-driven methods, existing VO networks suffer from a notable decrease in performance when confronted with…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Shunkai Li , Xin Wang , Yingdian Cao , Fei Xue , Zike Yan , Hongbin Zha

Predicting future states of dynamic agents is a fundamental task in autonomous driving. An expressive representation for this purpose is Occupancy Flow Fields, which provide a scalable and unified format for modeling motion, spatial extent,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Peter Lengyel

This research examines the use of Large Language Models (LLMs) in predicting time series, with a specific focus on the LLMTIME model. Despite the established effectiveness of LLMs in tasks such as text generation, language translation, and…

Machine Learning · Computer Science 2024-08-12 Rui Cao , Qiao Wang

Time-series anomaly detection (TSAD) has played a vital role in a variety of fields, including healthcare, finance, and sensor-based condition monitoring. Prior methods, which mainly focus on training domain-specific models on numerical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Zelin He , Sarah Alnegheimish , Matthew Reimherr

Large language models (LLMs) often struggle with maintaining accuracy throughout multiple multiple reasoning steps, especially in mathematical reasoning where an error in earlier steps can propagate to subsequent ones and it ultimately…

Artificial Intelligence · Computer Science 2024-04-02 Fei Yu , Anningzhe Gao , Benyou Wang