English
Related papers

Related papers: MoDEx: Mixture of Depth-specific Experts for Multi…

200 papers

Monocular depth estimation (MDE) aims to infer per-pixel depth from a single RGB image. While diffusion models have advanced MDE with impressive generalization, they often exhibit limitations in accurately reconstructing far-range regions.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Mingxia Zhan , Li Zhang , Yingjie Wang , Xiaomeng Chu , Beibei Wang , Yanyong Zhang

The immense success of the Transformer architecture in Natural Language Processing has led to its adoption in Time Se ries Forecasting (TSF), where superior performance has been shown. However, a recent important paper questioned their…

Computation and Language · Computer Science 2025-10-28 Musleh Alharthi , Kaleel Mahmood , Sarosh Patel , Ausif Mahmood

Multivariate time series forecasting (MTSF) seeks to model temporal dynamics among variables to predict future trends. Transformer-based models and large language models (LLMs) have shown promise due to their ability to capture long-range…

Machine Learning · Computer Science 2025-08-07 Abdul Monaf Chowdhury , Rabeya Akter , Safaeid Hossain Arib

Multivariate Time Series Forecasting (MTSF) plays a crucial role across diverse fields, ranging from economic, energy, to traffic. In recent years, deep learning has demonstrated outstanding performance in MTSF tasks. In MTSF, modeling the…

Machine Learning · Computer Science 2026-01-28 Xiangfei Qiu , Hanyin Cheng , Xingjian Wu , Junkai Lu , Jilin Hu , Chenjuan Guo , Christian S. Jensen , Bin Yang

Long-term time-series forecasting (LTTF) has become a pressing demand in many applications, such as wind power supply planning. Transformer models have been adopted to deliver high prediction capacity because of the high computational…

Machine Learning · Computer Science 2023-01-06 Yan Li , Xinjiang Lu , Haoyi Xiong , Jian Tang , Jiantao Su , Bo Jin , Dejing Dou

Recent work has shown that simple linear models can outperform several Transformer based approaches in long term time-series forecasting. Motivated by this, we propose a Multi-layer Perceptron (MLP) based encoder-decoder model, Time-series…

Machine Learning · Statistics 2024-04-05 Abhimanyu Das , Weihao Kong , Andrew Leach , Shaan Mathur , Rajat Sen , Rose Yu

Recently, there has been a growing interest in Long-term Time Series Forecasting (LTSF), which involves predicting long-term future values by analyzing a large amount of historical time-series data to identify patterns and trends. There…

Machine Learning · Computer Science 2026-02-17 Aitian Ma , Dongsheng Luo , Mo Sha

Modern applications increasingly involve many heterogeneous input streams, such as clinical sensors, wearable device data, imaging, and text, each with distinct measurement models, sampling rates, and noise characteristics. We define this…

Machine Learning · Computer Science 2026-03-03 Xing Han , Hsing-Huan Chung , Joydeep Ghosh , Paul Pu Liang , Suchi Saria

Real-world time series exhibit complex and evolving dynamics, making accurate forecasting extremely challenging. Recent multi-modal forecasting methods leverage textual information such as news reports to improve prediction, but most rely…

Machine Learning · Computer Science 2026-01-30 Lige Zhang , Ali Maatouk , Jialin Chen , Leandros Tassiulas , Rex Ying

Monocular depth estimation (MDE) has widely applicable but remains highly challenging due to the inherently ill-posed nature of reconstructing 3D scenes from single 2D images. Modern Vision Foundation Models (VFMs), pre-trained on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Gongshu Wang , Zhirui Wang , Kan Yang

Time series forecasting (TSF) plays a crucial role in various domains, including web data analysis, energy consumption prediction, and weather forecasting. While Multi-Layer Perceptrons (MLPs) are lightweight and effective for capturing…

Machine Learning · Computer Science 2026-03-05 Zhengnan Li , Haoxuan Li , Hao Wang , Jun Fang , Yuting Tan , Xilong Cheng Yunxiao Qin

Recent research in time series forecasting has explored integrating multimodal features into models to improve accuracy. However, the accuracy of such methods is constrained by three key challenges: inadequate extraction of fine-grained…

Machine Learning · Computer Science 2025-10-21 Shule Hao , Junpeng Bao , Wenli Li

Large Language Models (LLMs) have achieved remarkable success across a wide range of tasks, but serving them efficiently at scale remains a critical challenge due to their substantial computational and latency demands. While most existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-04 Yifan Sun , Gholamreza Haffari , Minxian Xu , Rajkumar Buyya , Adel N. Toosi

Monocular depth estimation (MDE) plays a pivotal role in various computer vision applications, such as robotics, augmented reality, and autonomous driving. Despite recent advancements, existing methods often fail to meet key requirements…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Andrii Litvynchuk , Ivan Livinsky , Anand Ravi , Nima Kalantari , Andrii Tsarov

Transformer-based models have recently made significant advances in accurate time-series forecasting, but even these architectures struggle to scale efficiently while capturing long-term temporal dynamics. Mixture-of-Experts (MoE) layers…

Machine Learning · Computer Science 2026-03-17 Evandro S. Ortigossa , Eran Segal

Accurate univariate forecasting remains a pressing need in real-world systems, such as energy markets, hydrology, retail demand, and IoT monitoring, where signals are often intermittent and horizons span both short- and long-term. While…

Machine Learning · Computer Science 2025-08-26 Kyrylo Yemets , Mykola Lukashchuk , Ivan Izonin

Time series forecasting is crucial for various applications, such as weather forecasting, power load forecasting, and financial analysis. In recent studies, MLP-mixer models for time series forecasting have been shown as a promising…

Machine Learning · Computer Science 2024-12-24 Md Mahmuddun Nabi Murad , Mehmet Aktukmak , Yasin Yilmaz

The field of time series forecasting is rapidly advancing, with recent large-scale Transformers and lightweight Multilayer Perceptron (MLP) models showing strong predictive performance. However, conventional Transformer models are often…

Machine Learning · Computer Science 2025-08-13 Zheng Zhou , Yu-Jie Xiong , Jia-Chen Zhang , Chun-Ming Xia , Xi-Jiong Xie

The emergence of deep learning has yielded noteworthy advancements in time series forecasting (TSF). Transformer architectures, in particular, have witnessed broad utilization and adoption in TSF tasks. Transformers have proven to be the…

Machine Learning · Computer Science 2023-11-01 Liyilei Su , Xumin Zuo , Rui Li , Xin Wang , Heng Zhao , Bingding Huang

Multivariate time-series (MTS) forecasting is fundamental to applications ranging from urban mobility and resource management to climate modeling. While recent generative models based on denoising diffusion have advanced state-of-the-art…

Machine Learning · Computer Science 2025-11-21 Seyed Mohamad Moghadas , Bruno Cornelis , Adrian Munteanu