English
Related papers

Related papers: Multi-Modal View Enhanced Large Vision Models for …

200 papers

The rapid proliferation of solar energy has significantly expedited the integration of photovoltaic (PV) systems into contemporary power grids. Considering that the cloud dynamics frequently induce rapid fluctuations in solar irradiance,…

Signal Processing · Electrical Eng. & Systems 2025-04-21 Huapeng Lin , Miao Yu

Generating forecasts for time series with multiple seasonal cycles is an important use-case for many industries nowadays. Accounting for the multi-seasonal patterns becomes necessary to generate more accurate and meaningful forecasts in…

Applications · Statistics 2020-04-28 Kasun Bandara , Christoph Bergmeir , Hansika Hewamalage

Time series data is a key element of big data analytics, commonly found in domains such as finance, healthcare, climate forecasting, and transportation. In large scale real world settings, such data is often high dimensional and…

Machine Learning · Computer Science 2025-08-14 Younghwi Kim , Dohee Kim , Joongrock Kim , Sunghyun Sim

Long-term activity forecasting is an especially challenging research problem because it requires understanding the temporal relationships between observed actions, as well as the variability and complexity of human activities. Despite…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Reuben Tan , Matthias De Lange , Michael Iuzzolino , Bryan A. Plummer , Kate Saenko , Karl Ridgeway , Lorenzo Torresani

Time series forecasting is widely used in extensive applications, such as traffic planning and weather forecasting. However, real-world time series usually present intricate temporal variations, making forecasting extremely challenging.…

Machine Learning · Computer Science 2024-05-24 Shiyu Wang , Haixu Wu , Xiaoming Shi , Tengge Hu , Huakun Luo , Lintao Ma , James Y. Zhang , Jun Zhou

Video prediction is a challenging task. The quality of video frames from current state-of-the-art (SOTA) generative models tends to be poor and generalization beyond the training data is difficult. Furthermore, existing prediction…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Vikram Voleti , Alexia Jolicoeur-Martineau , Christopher Pal

Multimodal Large Models (MLLMs) have achieved remarkable progress in vision-language understanding and generation tasks. However, existing MLLMs typically rely on static modality fusion strategies, which treat all modalities equally…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Hiroshi Tanaka , Anika Rao , Hana Satou , Michael Johnson , Sofia García

Dynamic Vision Sensors (DVS) offer a unique advantage in control applications due to their high temporal resolution and asynchronous event-based data. Still, their adoption in machine learning algorithms remains limited. To address this gap…

Robotics · Computer Science 2025-03-04 Felix Resch , Mónika Farsang , Radu Grosu

Reinforcement learning based post-training paradigms for Video Large Language Models (VideoLLMs) have achieved significant success by optimizing for visual-semantic tasks such as captioning or VideoQA. However, while these approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Xiaokun Sun , Zezhong Wu , Zewen Ding , Linli Xu

The increasing availability of multimodal data across text, tables, and images presents new challenges for developing models capable of complex cross-modal reasoning. Existing methods for Multimodal Multi-hop Question Answering (MMQA) often…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Qi Zhi Lim , Chin Poo Lee , Kian Ming Lim , Kalaiarasi Sonai Muthu Anbananthen

Multivariate time series forecasting (MTSF) seeks to model temporal dynamics among variables to predict future trends. Transformer-based models and large language models (LLMs) have shown promise due to their ability to capture long-range…

Machine Learning · Computer Science 2025-08-07 Abdul Monaf Chowdhury , Rabeya Akter , Safaeid Hossain Arib

Long-term time series forecasting (LTSF) aims to predict future values of a time series given the past values. The current state-of-the-art (SOTA) on this problem is attained in some cases by linear-centric models, which primarily feature a…

Machine Learning · Computer Science 2024-05-03 Ronghao Ni , Zinan Lin , Shuaiqi Wang , Giulia Fanti

Deep learning (e.g., Transformer) has been widely and successfully used in multivariate time series forecasting (MTSF). Unlike existing methods that focus on training models from a single modal of time series input, large language models…

Machine Learning · Computer Science 2025-04-09 Peiyuan Liu , Hang Guo , Tao Dai , Naiqi Li , Jigang Bao , Xudong Ren , Yong Jiang , Shu-Tao Xia

Forecasting high-resolution land subsidence is a critical yet challenging task due to its complex, non-linear dynamics. While standard architectures like ConvLSTM often fail to model long-range dependencies, we argue that a more fundamental…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Wendong Yao , Binhua Huang , Soumyabrata Dev

Long-term time series forecasting (LTSF) is a challenging task that has been investigated in various domains such as finance investment, health care, traffic, and weather forecasting. In recent years, Linear-based LTSF models showed better…

Machine Learning · Computer Science 2023-11-13 Seonkyu Lim , Jaehyeon Park , Seojin Kim , Hyowon Wi , Haksoo Lim , Jinsung Jeon , Jeongwhan Choi , Noseong Park

AI systems are notorious for their fragility; minor input changes can potentially cause major output swings. When such systems are deployed in critical areas like finance, the consequences of their uncertain behavior could be severe. In…

Machine Learning · Computer Science 2024-06-21 Kausik Lakkaraju , Rachneet Kaur , Zhen Zeng , Parisa Zehtabi , Sunandita Patra , Biplav Srivastava , Marco Valtorta

The prevailing Direct Forecasting (DF) paradigm dominates Long-term Time Series Forecasting (LTSF) by forcing models to predict the entire future horizon in a single forward pass. While efficient, this rigid coupling of output and…

Machine Learning · Computer Science 2026-02-03 Jiaming Ma , Siyuan Mu , Ruilin Tang , Haofeng Ma , Qihe Huang , Zhengyang Zhou , Pengkun Wang , Binwu Wang , Yang Wang

Time series forecasting plays a significant role in finance, energy, meteorology, and IoT applications. Recent studies have leveraged the generalization capabilities of large language models (LLMs) to adapt to time series forecasting,…

Machine Learning · Computer Science 2026-05-12 Hao Liu , Xiaoxing Zhang , Chun Yang , Xiaobin Zhu

In this work, we introduce LLaDA-V, a purely diffusion-based Multimodal Large Language Model (MLLM) that integrates visual instruction tuning with masked diffusion models, representing a departure from the autoregressive paradigms dominant…

Machine Learning · Computer Science 2025-06-05 Zebin You , Shen Nie , Xiaolu Zhang , Jun Hu , Jun Zhou , Zhiwu Lu , Ji-Rong Wen , Chongxuan Li

Time series forecasting plays a crucial role in decision-making across various domains, but it presents significant challenges. Recent studies have explored image-driven approaches using computer vision models to address these challenges,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhen Zeng , Rachneet Kaur , Suchetha Siddagangappa , Tucker Balch , Manuela Veloso