中文
相关论文

相关论文: Context-Aware Probabilistic Modeling with LLM for …

200 篇论文

Generally, the decoder-only large language models (LLMs) are adapted to context-aware neural machine translation (NMT) in a concatenating way, where LLMs take the concatenation of the source sentence (i.e., intra-sentence context) and the…

计算与语言 · 计算机科学 2024-09-24 Xinglin Lyu , Junhui Li , Yanqing Zhao , Min Zhang , Daimeng Wei , Shimin Tao , Hao Yang , Min Zhang

Though large language models (LLMs) have enabled great success across a wide variety of tasks, they still appear to fall short of one of the loftier goals of artificial intelligence research: creating an artificial system that can adapt its…

计算与语言 · 计算机科学 2026-05-04 Michael A. Lepori , Tal Linzen , Ann Yuan , Katja Filippova

Forecasting the short-term spread of an ongoing disease outbreak is a formidable challenge due to the complexity of contributing factors, some of which can be characterized through interlinked, multi-modality variables such as…

机器学习 · 计算机科学 2024-04-11 Hongru Du , Jianan Zhao , Yang Zhao , Shaochong Xu , Xihong Lin , Yiran Chen , Lauren M. Gardner , Hao Frank Yang

Large Language Models (LLMs) often experience performance degradation during long-running interactions due to increasing context length, memory saturation, and computational overhead. This paper presents an adaptive context compression…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Payal Fofadiya , Sunil Tiwari

In the time-series domain, an increasing number of works combine text with temporal data to leverage the reasoning capabilities of large language models (LLMs) for various downstream time-series understanding tasks. This enables a single…

计算与语言 · 计算机科学 2025-11-11 Zhirui Zhang , Changhua Pei , Tianyi Gao , Zhe Xie , Yibo Hao , Zhaoyang Yu , Longlong Xu , Tong Xiao , Jing Han , Dan Pei

In this work, we propose FlowTime, a generative model for probabilistic forecasting of multivariate timeseries data. Given historical measurements and optional future covariates, we formulate forecasting as sampling from a learned…

机器学习 · 计算机科学 2026-02-10 Ahmed ElGazzar , Marcel van Gerven

Producing probabilistic forecasts for large collections of similar and/or dependent time series is a practically relevant and challenging task. Classical time series models fail to capture complex patterns in the data, and multivariate…

机器学习 · 统计学 2019-05-30 Yuyang Wang , Alex Smola , Danielle C. Maddix , Jan Gasthaus , Dean Foster , Tim Januschowski

Vector representations of contextual embeddings learned by pre-trained large language models (LLMs) are effective in various downstream tasks in numerical domains such as time series forecasting. Despite their significant benefits, the…

计算与语言 · 计算机科学 2025-06-24 Rashed Shelim , Shengzhe Xu , Walid Saad , Naren Ramakrishnan

The real-time prediction of business processes using historical event data is an important capability of modern business process monitoring systems. Existing process prediction methods are able to also exploit the data perspective of…

人工智能 · 计算机科学 2022-05-11 Marco Pegoraro , Merih Seran Uysal , David Benedikt Georgi , Wil M. P. van der Aalst

In-context learning has emerged as a groundbreaking ability of Large Language Models (LLMs) and revolutionized various fields by providing a few task-relevant demonstrations in the prompt. However, trustworthy issues with LLM's response,…

Large language models (LLMs) excel at natural language understanding and generation but remain vulnerable to factual errors, limiting their reliability in knowledge-intensive tasks. While decoding-time strategies provide a promising…

Intelligent mobile robots are critical in several scenarios. However, as their computational resources are limited, mobile robots struggle to handle several tasks concurrently and yet guaranteeing real-timeliness. To address this challenge…

机器人学 · 计算机科学 2021-04-13 Ramyad Hadidi , Nima Shoghi Ghalehshahi , Bahar Asgari , Hyesoon Kim

Modern large language model (LLM) inference engines optimize throughput and latency under fixed decoding rules, treating generation as a linear progression in token time. We propose a fundamentally different paradigm: entropic\-time…

计算与语言 · 计算机科学 2026-03-05 Andrew Kiruluta

Temporal prediction is critical for making intelligent and robust decisions in complex dynamic environments. Motion prediction needs to model the inherently uncertain future which often contains multiple potential outcomes, due to…

机器学习 · 计算机科学 2019-12-10 Yichuan Charlie Tang , Ruslan Salakhutdinov

Context-aware processing mechanisms have increasingly become a critical area of exploration for improving the semantic and contextual capabilities of language generation models. The Context-Aware Semantic Recomposition Mechanism (CASRM) was…

计算与语言 · 计算机科学 2025-03-27 Richard Katrix , Quentin Carroway , Rowan Hawkesbury , Matthias Heathfield

Chatbots via large language models (LLMs) generate fluent responses but often struggle with when to speak, especially for brief, timely listener reactions during ongoing dialogue. We present a multimodal strategy for LLMs, which leverages…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Zikai Liao , Yi Ouyang , Yi-Lun Lee , Chen-Ping Yu , Yi-Hsuan Tsai , Zhaozheng Yin

Recent advances in Large Language Models (LLMs) have demonstrated new possibilities for accurate and efficient time series analysis, but prior work often required heavy fine-tuning and/or ignored inter-series correlations. In this work, we…

Traffic forecasting is pivotal for intelligent transportation systems, where accurate and interpretable predictions can significantly enhance operational efficiency and safety. A key challenge stems from the heterogeneity of traffic…

机器学习 · 计算机科学 2025-11-17 Seyed Mohamad Moghadas , Bruno Cornelis , Alexandre Alahi , Adrian Munteanu

Large Language Models (LLMs) have seen significant use in domains such as natural language processing and computer vision. Going beyond text, image and graphics, LLMs present a significant potential for analysis of time series data,…

机器学习 · 计算机科学 2024-05-08 Xiyuan Zhang , Ranak Roy Chowdhury , Rajesh K. Gupta , Jingbo Shang

Large language models (LLMs) have achieved notable progress. Despite their success, next-token prediction (NTP), the dominant method for LLM training and inference, is constrained in both contextual coverage and inference efficiency due to…

计算与语言 · 计算机科学 2025-09-23 Xiaohao Liu , Xiaobo Xia , Weixiang Zhao , Manyi Zhang , Xianzhi Yu , Xiu Su , Shuo Yang , See-Kiong Ng , Tat-Seng Chua