English
Related papers

Related papers: Multi-Modal View Enhanced Large Vision Models for …

200 papers

In recent times, Large Language Models (LLMs) have captured a global spotlight and revolutionized the field of Natural Language Processing. One of the factors attributed to the effectiveness of LLMs is the model architecture used for…

Machine Learning · Computer Science 2023-08-31 Oluwaseyi Ogunfowora , Homayoun Najjaran

Recent advancements indicate that scaling up Multimodal Large Language Models (MLLMs) effectively enhances performance on downstream multimodal tasks. The prevailing MLLM paradigm, \emph{e.g.}, LLaVA, transforms visual features into…

Artificial Intelligence · Computer Science 2024-03-21 Wenqiao Zhang , Tianwei Lin , Jiang Liu , Fangxun Shu , Haoyuan Li , Lei Zhang , He Wanggui , Hao Zhou , Zheqi Lv , Hao Jiang , Juncheng Li , Siliang Tang , Yueting Zhuang

Multivariate Time Series Forecasting (MTSF) has long been a key research focus. Traditionally, these studies assume a fixed number of variables, but in real-world applications, Cyber-Physical Systems often expand as new sensors are…

Machine Learning · Computer Science 2025-06-03 Minbo Ma , Kai Tang , Huan Li , Fei Teng , Dalin Zhang , Tianrui Li

Multimodal Large Language Models (MLLMs) have achieved SOTA performance in various visual language tasks by fusing the visual representations with LLMs leveraging some visual adapters. In this paper, we first establish that adapters using…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Wenliang Zhong , Wenyi Wu , Qi Li , Rob Barton , Boxin Du , Shioulin Sam , Karim Bouyarmane , Ismail Tutar , Junzhou Huang

Despite the remarkable success of the LLaVA architecture for vision-language tasks, its design inherently struggles to effectively integrate visual features due to the inherent mismatch between text and vision modalities. We tackle this…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Dongwan Kim , Viresh Ranjan , Takashi Nagata , Arnab Dhua , Amit Kumar K C

Time Series Forecasting (TSF) is critical in many real-world domains like financial planning and health monitoring. Recent studies have revealed that Large Language Models (LLMs), with their powerful in-contextual modeling capabilities,…

Machine Learning · Computer Science 2025-03-14 Jialiang Tang , Shuo Chen , Chen Gong , Jing Zhang , Dacheng Tao

Recent advancements in Large Multimodal Models (LMMs) have shown promising results in mathematical reasoning within visual contexts, with models approaching human-level performance on existing benchmarks such as MathVista. However, we…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Ke Wang , Junting Pan , Weikang Shi , Zimu Lu , Mingjie Zhan , Hongsheng Li

Multivariate Time Series Forecasting (MTSF) involves predicting future values of multiple interrelated time series. Recently, deep learning-based MTSF models have gained significant attention for their promising ability to mine semantics…

Machine Learning · Computer Science 2025-06-17 Chengqing Yu , Fei Wang , Chuanguang Yang , Zezhi Shao , Tao Sun , Tangwen Qian , Wei Wei , Zhulin An , Yongjun Xu

We introduce MoTIF, a mode-structured tensor framework for multi-parametric approximation, super-resolution, and temporal forecasting of high-dimensional unsteady systems. The methodology leverages High-Order Singular Value Decomposition…

Long-term forecasting of multivariate urban data poses a significant challenge due to the complex spatiotemporal dependencies inherent in such datasets. This paper presents DST, a novel multivariate time-series forecasting model that…

Machine Learning · Computer Science 2025-08-28 Amirhossein Sohrabbeig , Omid Ardakanian , Petr Musilek

Time series forecasting in specialized domains is often constrained by limited data availability, where conventional models typically require large-scale datasets to effectively capture underlying temporal dynamics. To tackle this few-shot…

Machine Learning · Computer Science 2026-02-03 Haonan Shi , Dehua Shuai , Liming Wang , Xiyang Liu , Long Tian

Time series forecasting presents significant challenges in real-world applications across various domains. Building upon the decomposition of the time series, we enhance the architecture of machine learning models for better multivariate…

Machine Learning · Computer Science 2026-02-24 Sanjeev Panta , Xu Yuan , Li Chen , Nian-Feng Tzeng

Time Series Forecasting (TSF) faces persistent challenges in modeling intricate temporal dependencies across different scales. Despite recent advances leveraging different decomposition operations and novel architectures based on CNN, MLP…

Machine Learning · Computer Science 2025-10-24 Haonan Yang , Jianchao Tang , Zhuo Li , Long Lan

Recently, Large Vision-Language Models (LVLMs) have demonstrated impressive capabilities in multi-modal context comprehension. However, they still suffer from hallucination problems referring to generating inconsistent outputs with the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Xiaoye Qu , Jiashuo Sun , Wei Wei , Yu Cheng

Multimodal large language models (MLLMs) deployed on devices must adapt to continuously changing visual scenarios such as variations in background and perspective, to effectively perform complex visual tasks. To investigate catastrophic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Kai Jiang , Siqi Huang , Xiangyu Chen , Jiawei Shao , Hongyuan Zhang , Ping Luo , Xuelong Li

Multivariate time series long-term prediction, which aims to predict the change of data in a long time, can provide references for decision-making. Although transformer-based models have made progress in this field, they usually do not make…

Machine Learning · Computer Science 2023-08-08 Chengqing Yu , Fei Wang , Zezhi Shao , Tao Sun , Lin Wu , Yongjun Xu

Multimodal large language models (MLLMs) typically extract visual features from the final layers of a pretrained Vision Transformer (ViT). This widespread deep-layer bias, however, is largely driven by empirical convention rather than…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Haoran Chen , Junyan Lin , Xinghao Chen , Yue Fan , Jianfeng Dong , Xin Jin , Hui Su , Jinlan Fu , Xiaoyu Shen

Complex distribution shifts are the main obstacle to achieving accurate long-term time series forecasting. Several efforts have been conducted to capture the distribution characteristics and propose adaptive normalization techniques to…

Machine Learning · Computer Science 2024-10-01 Dalin Qin , Yehui Li , Weiqi Chen , Zhaoyang Zhu , Qingsong Wen , Liang Sun , Pierre Pinson , Yi Wang

Long-term satellite image time series (SITS) analysis in heterogeneous landscapes faces significant challenges, particularly in Mediterranean regions where complex spatial patterns, seasonal variations, and multi-decade environmental…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Ido Faran , Nathan S. Netanyahu , Maxim Shoshany

The success of Large Language Models (LLMs) has inspired the development of Multimodal Large Language Models (MLLMs) for unified understanding of vision and language. However, the increasing model size and computational complexity of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Yuxuan Cai , Jiangning Zhang , Haoyang He , Xinwei He , Ao Tong , Zhenye Gan , Chengjie Wang , Zhucun Xue , Yong Liu , Xiang Bai