English
Related papers

Related papers: Context Matters: Leveraging Contextual Features fo…

200 papers

Contextual information at inference time, such as demonstrations, retrieved knowledge, or interaction history, can substantially improve large language models (LLMs) without parameter updates, yet its theoretical role remains poorly…

Computation and Language · Computer Science 2026-02-10 Dingzirui Wang , Xuanliang Zhang , Keyan Xu , Qingfu Zhu , Wanxiang Che , Yang Deng

Time-series data are critical in diverse applications, such as industrial monitoring, medical diagnostics, and climate research. However, effectively integrating these high-dimensional temporal signals with natural language for dynamic,…

Computation and Language · Computer Science 2025-06-26 Yilin Wang , Peixuan Lei , Jie Song , Yuzhe Hao , Tao Chen , Yuxuan Zhang , Lei Jia , Yuanxiang Li , Zhongyu Wei

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

Machine Learning · Computer Science 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

An important task for the design of Question Answering systems is the selection of the sentence containing (or constituting) the answer from documents relevant to the asked question. Most previous work has only used the target sentence to…

Computation and Language · Computer Science 2020-06-03 Ivano Lauriola , Alessandro Moschitti

Time series forecasting plays a crucial role in various applications, particularly in healthcare, where accurate predictions of future health trajectories can significantly impact clinical decision-making. Ensuring transparency and…

Machine Learning · Computer Science 2025-05-22 Jeremy Qin

Home entertainment systems feature in a variety of usage scenarios with one or more simultaneous users, for whom the complexity of choosing media to consume has increased rapidly over the last decade. Users' decision processes are complex…

Information Retrieval · Computer Science 2019-10-01 Miklas S. Kristoffersen , Sven E. Shepstone , Zheng-Hua Tan

Forecast combinations have been widely applied in the last few decades to improve forecasting. Estimating optimal weights that can outperform simple averages is not always an easy task. In recent years, the idea of using time series…

Methodology · Statistics 2021-10-22 Yanfei Kang , Wei Cao , Fotios Petropoulos , Feng Li

Recent time-series foundation models exhibit strong abilities to predict physical systems. These abilities include zero-shot forecasting, in which a model forecasts future states of a system given only a short trajectory as context, without…

Machine Learning · Computer Science 2026-03-31 Yuanzhao Zhang , William Gilpin

Time series forecasting is a fundamental problem with applications in climate, energy, healthcare, and finance. Many existing approaches require domain-specific feature engineering and substantial labeled data for each task. We introduce…

Machine Learning · Computer Science 2026-01-29 Olaf Yunus Laitinen Imanov , Derya Umut Kulali , Taner Yilmaz

Motivated by the recent success of time-series foundation models for zero-shot forecasting, we present a methodology for $\textit{in-context fine-tuning}$ of a time-series foundation model. In particular, we design a pretrained foundation…

Machine Learning · Computer Science 2024-11-01 Abhimanyu Das , Matthew Faw , Rajat Sen , Yichen Zhou

Trajectory prediction in autonomous driving relies on accurate representation of all relevant contexts of the driving scene, including traffic participants, road topology, traffic signs, as well as their semantic relations to each other.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Zhigang Sun , Zixu Wang , Lavdim Halilaj , Juergen Luettin

Semantic segmentation assigns labels to pixels in images, a critical yet challenging task in computer vision. Convolutional methods, although capturing local dependencies well, struggle with long-range relationships. Vision Transformers…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Mian Muhammad Naeem Abid , Nancy Mehta , Zongwei Wu , Radu Timofte

Reducing traffic accidents is a crucial global public safety concern. Accident prediction is key to improving traffic safety, enabling proactive measures to be taken before a crash occurs, and informing safety policies, regulations, and…

Time series forecasting plays an increasingly important role in modern business decisions. In today's data-rich environment, people often aim to choose the optimal forecasting model for their data. However, identifying the optimal model…

Applications · Statistics 2021-12-17 Xixi Li , Fotios Petropoulos , Yanfei Kang

Time series foundation models have shown impressive performance on a variety of tasks, across a wide range of domains, even in zero-shot settings. However, most of these models are designed to handle short univariate time series as an…

Machine Learning · Computer Science 2024-09-23 Nina Żukowska , Mononito Goswami , Michał Wiliński , Willa Potosnak , Artur Dubrawski

Spatio-temporal traffic forecasting is challenging due to complex temporal patterns, dynamic spatial structures, and diverse input formats. Although Transformer-based models offer strong global modeling, they often struggle with rigid…

Artificial Intelligence · Computer Science 2025-08-20 Jiayu Fang , Zhiqi Shao , S T Boris Choy , Junbin Gao

Spatio-temporal forecasting is crucial in transportation, logistics, and supply chain management. However, current methods struggle with large, complex datasets. We propose a dynamic, multi-modal approach that integrates the strengths of…

Machine Learning · Computer Science 2024-08-27 Sagar Srinivas Sakhinana , Geethan Sannidhi , Chidaksh Ravuru , Venkataramana Runkana

This study evaluates the forecasting performance of recent language models (LLMs) on binary forecasting questions. We first introduce a novel dataset of over 600 binary forecasting questions, augmented with related news articles and their…

Computation and Language · Computer Science 2025-01-14 Gerrit Mutschlechner , Adam Jatowt

Meta-forecasting is a newly emerging field which combines meta-learning and time series forecasting. The goal of meta-forecasting is to train over a collection of source time series and generalize to new time series one-at-a-time. Previous…

Machine Learning · Computer Science 2023-02-07 Mike Van Ness , Huibin Shen , Hao Wang , Xiaoyong Jin , Danielle C. Maddix , Karthick Gopalswamy

The performance of time series forecasting has recently been greatly improved by the introduction of transformers. In this paper, we propose a general multi-scale framework that can be applied to the state-of-the-art transformer-based time…

Machine Learning · Computer Science 2023-02-08 Amin Shabani , Amir Abdi , Lili Meng , Tristan Sylvain