English
Related papers

Related papers: Long-range Modeling and Processing of Multimodal E…

200 papers

Recent advances in Large Language Models (LLMs) have highlighted the challenge of handling long-context tasks, where models need to reason over extensive input contexts to aggregate target information. While Chain-of-Thought (CoT) prompting…

Computation and Language · Computer Science 2025-03-03 Dawei Zhu , Xiyu Wei , Guangxiang Zhao , Wenhao Wu , Haosheng Zou , Junfeng Ran , Xun Wang , Lin Sun , Xiangzheng Zhang , Sujian Li

Time series forecasting is important for applications spanning energy markets, climate analysis, and traffic management. However, existing methods struggle to effectively integrate exogenous texts and align them with the probabilistic…

Machine Learning · Computer Science 2025-07-30 Yueyang Yao , Jiajun Li , Xingyuan Dai , MengMeng Zhang , Xiaoyan Gong , Fei-Yue Wang , Yisheng Lv

Recent advances in Large Language Models (LLMs) have been changing the paradigm of Recommender Systems (RS). However, when items in the recommendation scenarios contain rich textual information, such as product descriptions in online…

Information Retrieval · Computer Science 2024-03-21 Zhi Zheng , Wenshuo Chao , Zhaopeng Qiu , Hengshu Zhu , Hui Xiong

Contextual Markov Decision Processes (CMDPs) offer a framework for sequential decision-making under external signals, but existing methods often fail to generalize in high-dimensional or unstructured contexts, resulting in excessive…

Artificial Intelligence · Computer Science 2025-10-06 Peidong Liu , Junjiang Lin , Shaowen Wang , Yao Xu , Haiqing Li , Xuhao Xie , Siyi Wu , Hao Li

Understanding abnormal events in videos is a vital and challenging task that has garnered significant attention in a wide range of applications. Although current video understanding Multi-modal Large Language Models (MLLMs) are capable of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yingxian Chen , Jiahui Liu , Ruidi Fan , Yanwei Li , Chirui Chang , Shizhen Zhao , Wilton W. T. Fok , Xiaojuan Qi , Yik-Chung Wu

Long video understanding is essential for human-like intelligence, enabling coherent perception and reasoning over extended temporal contexts. While the emerging thinking-with-frames paradigm, which alternates between global temporal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Pengfei Hu , Meng Cao , Yingyao Wang , Yi Wang , Jiahua Dong , Jun Song , Yu Cheng , Bo Zheng , Xiaodan Liang

Large language models (LLMs) have shown remarkable performance in vision-language tasks, but their application in the medical field remains underexplored, particularly for integrating structured time series data with unstructured clinical…

Computation and Language · Computer Science 2025-06-17 Shuai Niu , Jing Ma , Hongzhan Lin , Liang Bai , Zhihua Wang , Wei Bi , Yida Xu , Guo Li , Xian Yang

Understanding temporal dynamics is critical for conversational agents, enabling effective content analysis and informed decision-making. However, time-aware datasets, particularly for persona-grounded conversations, are still limited, which…

Computation and Language · Computer Science 2025-02-11 Wanqi Yang , Yanda Li , Meng Fang , Ling Chen

Multimodal Large Language Models (MLLMs) have shown strong performance in video understanding tasks. However, they continue to struggle with long-form videos because of an inefficient perception of temporal intervals. Unlike humans, who can…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Chenglin Li , Qianglong Chen , fengtao , Yin Zhang

Sequential recommendations (SR) predict users' future interactions based on their historical behavior. The rise of Large Language Models (LLMs) has brought powerful generative and reasoning capabilities, significantly enhancing SR…

Information Retrieval · Computer Science 2026-02-09 Qiyong Zhong , Jiajie Su , Ming Yang , Yunshan Ma , Xiaolin Zheng , Chaochao Chen

Temporal Point Processes (TPPs) have recently become increasingly interesting for learning dynamics in graph data. A reason for this is that learning on dynamic graph data is becoming more relevant, since data from many scientific fields,…

Machine Learning · Computer Science 2024-08-29 Alice Moallemy-Oureh , Silvia Beddar-Wiesing , Yannick Nagel , Rüdiger Nather , Josephine M. Thomas

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

Machine Learning · Computer Science 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

Forecasting in the real world requires integrating structured time-series data with unstructured textual information, but existing methods are architecturally limited by fixed input/output horizons and are unable to model or quantify…

Machine Learning · Computer Science 2025-10-27 Sungjun Cho , Changho Shin , Suenggwan Jo , Xinya Yan , Shourjo Aditya Chaudhuri , Frederic Sala

Marked Temporal Point Processes (MTPPs) arise naturally in medical, social, commercial, and financial domains. However, existing Transformer-based methods mostly inject temporal information only via positional encodings, relying on shared…

Machine Learning · Computer Science 2026-03-25 Xinzi Tan , Kejian Zhang , Junhan Yu , Doudou Zhou

Human activities generate various event sequences such as taxi trip records, bike-sharing pick-ups, crime occurrence, and infectious disease transmission. The point process is widely used in many applications to predict such events related…

Machine Learning · Computer Science 2024-01-30 Yoshiaki Takimoto , Yusuke Tanaka , Tomoharu Iwata , Maya Okawa , Hideaki Kim , Hiroyuki Toda , Takeshi Kurashima

In the burgeoning domain of Large Language Models (LLMs), there is a growing interest in applying LLM to time series forecasting, with multiple studies focused on leveraging textual prompts to further enhance the predictive prowess. This…

Machine Learning · Computer Science 2024-11-19 Peisong Niu , Tian Zhou , Xue Wang , Liang Sun , Rong Jin

Recent advancements in Large Language Models (LLMs) have the potential to transform financial analytics by integrating numerical and textual data. However, challenges such as insufficient context when fusing multimodal information and the…

Computational Finance · Quantitative Finance 2024-11-14 Hoyoung Lee , Youngsoo Choi , Yuhee Kwon

Modeling long horizon marked event sequences is a fundamental challenge in many real-world applications, including healthcare, finance, and user behavior modeling. Existing neural temporal point process models are typically autoregressive,…

Machine Learning · Computer Science 2025-08-08 Xiao Shou

Large language models (LLMs) show promise for health applications when combined with behavioral sensing data. Traditional approaches convert sensor data into text prompts, but this process is prone to errors, computationally expensive, and…

The creation of news timeline is essential for a comprehensive and contextual understanding of events as they unfold over time. This approach aids in discerning patterns and trends that might be obscured when news is viewed in isolation. By…

Artificial Intelligence · Computer Science 2023-11-21 Sha Wang , Yuchen Li , Hanhua Xiao , Lambert Deng , Yanfei Dong