English
Related papers

Related papers: TS-MLLM: A Multi-Modal Large Language Model-based …

200 papers

This paper explores the potential of large language models (LLMs) to generate financial reports from time series data. We propose a framework encompassing prompt engineering, model selection, and evaluation. We introduce an automated…

Computation and Language · Computer Science 2025-07-02 Elizabeth Fons , Elena Kochkina , Rachneet Kaur , Zhen Zeng , Berowne Hlavaty , Charese Smiley , Svitlana Vyetrenko , Manuela Veloso

Forecasting in the real world requires integrating structured time-series data with unstructured textual information, but existing methods are architecturally limited by fixed input/output horizons and are unable to model or quantify…

Machine Learning · Computer Science 2025-10-27 Sungjun Cho , Changho Shin , Suenggwan Jo , Xinya Yan , Shourjo Aditya Chaudhuri , Frederic Sala

Large language models (LLMs) are often trained on extensive, temporally indiscriminate text corpora, reflecting the lack of datasets with temporal metadata. This approach is not aligned with the evolving nature of language. Conventional…

Computation and Language · Computer Science 2024-04-30 Felix Drinkall , Eghbal Rahimikia , Janet B. Pierrehumbert , Stefan Zohren

The efficient operation of modern cellular networks hinges on the accurate analysis of spatio-temporal traffic data. Mastering these patterns is essential for core network functions, chiefly forecasting future load to pre-empt congestion…

Machine Learning · Computer Science 2026-05-13 Yichen Zhang , Jun Li

The interpretation of multi-temporal remote sensing imagery is critical for monitoring Earth's dynamic processes-yet previous change detection methods, which produce binary or semantic masks, fall short of providing human-readable insights…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Chenyang Liu , Jiafan Zhang , Keyan Chen , Man Wang , Zhengxia Zou , Zhenwei Shi

Traffic forecasting represents a crucial problem within intelligent transportation systems. In recent research, Large Language Models (LLMs) have emerged as a promising method, but their intrinsic design, tailored primarily for sequential…

Machine Learning · Computer Science 2025-09-18 Hyotaek Jeon , Hyunwook Lee , Juwon Kim , Sungahn Ko

Large Language Models (LLMs) have demonstrated impressive performance in time series analysis and seems to understand the time temporal relationship well than traditional transformer-based approaches. However, since LLMs are not designed…

Machine Learning · Computer Science 2025-05-27 Liangwei Nathan Zheng , Chang George Dong , Wei Emma Zhang , Lin Yue , Miao Xu , Olaf Maennel , Weitong Chen

Diffusion Multi-modal Large Language Models (dMLLMs) have recently emerged as a novel architecture unifying image generation and understanding. However, developing effective and efficient Test-Time Scaling (TTS) methods to unlock their full…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Yi Xin , Siqi Luo , Tianxiang Xu , Qi Qin , Haoxing Chen , Kaiwen Zhu , Zhiwei Zhang , Yangfan He , Rongchao Zhang , Jinbin Bai , Shuo Cao , Bin Fu , Junjun He , Yihao Liu , Yuewen Cao , Xiaohong Liu

Recently, Vision Large Language Models (VLLMs) integrated with vision encoders have shown promising performance in vision understanding. The key of VLLMs is to encode visual content into sequences of visual tokens, enabling VLLMs to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Zhuqiang Lu , Zhenfei Yin , Mengwei He , Zhihui Wang , Zicheng Liu , Zhiyong Wang , Kun Hu

Time series forecasting is central to data analysis and web technologies. The recent success of Large Language Models (LLMs) offers significant potential for this field, especially from the cross-modality aspect. Most methods adopt an…

Machine Learning · Computer Science 2025-12-02 Yafei Lyu , Hao Zhou , Lu Zhang , Xu Yang , Zhiyong Liu

Over the past years, the industrial sector has seen many innovations brought about by automation. Inherent in this automation is the installation of sensor networks for status monitoring and data collection. One of the major challenges in…

Machine Learning · Computer Science 2020-05-28 Paulito Palmes , Joern Ploennigs , Niall Brady

Industrial machine fault diagnosis is a critical component of operational efficiency and safety in manufacturing environments. Traditional methods rely heavily on expert knowledge and specific machine learning models, which can be limited…

Computation and Language · Computer Science 2024-10-07 Apiradee Boonmee , Kritsada Wongsuwan , Pimchanok Sukjai

Time series classification plays a fundamental role in a wide range of real-world applications. Recently, large language models (LLMs) have demonstrated strong generalization and reasoning capacities, but directly applying them to time…

Machine Learning · Computer Science 2025-12-22 Xiaoyu Tao , Tingyue Pan , Mingyue Cheng , Yucong Luo , Qi Liu , Enhong Chen

Rapid development of large language models (LLMs) has significantly advanced multimodal large language models (LMMs), particularly in vision-language tasks. However, existing video-language models often overlook precise temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Shimin Chen , Xiaohan Lan , Yitian Yuan , Zequn Jie , Lin Ma

Multimodal Large Language Models (MLLMs) have demonstrated significant progress in vision-language tasks, yet they still face challenges when processing long-duration video inputs. The limitation arises from MLLMs' context limit and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Canhui Tang , Zifan Han , Hongbo Sun , Sanping Zhou , Xuchong Zhang , Xin Wei , Ye Yuan , Huayu Zhang , Jinglin Xu , Hao Sun

The rapid advancement of Large Language Models (LLMs) has sparked growing interest in their application to time series analysis tasks. However, their ability to perform complex reasoning over temporal data in real-world application domains…

Machine Learning · Computer Science 2025-09-03 Wen Ye , Jinbo Liu , Defu Cao , Wei Yang , Yan Liu

Spoken Language Models (SLMs) are increasingly central to modern speech-driven applications, but performance degrades under acoustic shift - real-world noise, reverberation, and microphone variation. Prior solutions rely on offline domain…

Text-Speech Language Models (TSLMs) -- language models trained to jointly process and generate text and speech -- are commonly trained through an early modality fusion/fission approach, in which both modalities are fed and predicted from a…

Computation and Language · Computer Science 2025-10-21 Santiago Cuervo , Adel Moumen , Yanis Labrak , Sameer Khurana , Antoine Laurent , Mickael Rouvier , Phil Woodland , Ricard Marxer

This paper explores how large language models can leverage multi-level contextual information to predict group coordination patterns in collaborative mixed reality environments. We demonstrate that encoding individual behavioral profiles,…

Human-Computer Interaction · Computer Science 2025-11-19 Diana Romero , Xin Gao , Daniel Khalkhali , Salma Elmalaki

Adapting general multimodal large language models (MLLMs) to specific domains, such as scientific and industrial fields, is highly significant in promoting their practical applications. This paper systematically investigates domain…

Computation and Language · Computer Science 2025-08-28 Daixuan Cheng , Shaohan Huang , Ziyu Zhu , Xintong Zhang , Wayne Xin Zhao , Zhongzhi Luan , Bo Dai , Zhenliang Zhang