English
Related papers

Related papers: Moirai 2.0: When Less Is More for Time Series Fore…

200 papers

Learning transferable representations from unlabeled time series is crucial for improving performance in data-scarce classification. Existing self-supervised methods often operate at the point level and rely on unidirectional encoding,…

Machine Learning · Computer Science 2026-03-02 Mingyue Cheng , Xiaoyu Tao , Zhiding Liu , Qi Liu , Hao Zhang , Rujiao Zhang , Enhong Chen

Training large foundation models costs hundreds of millions of dollars, making deployment optimization critical. Current approaches require machine learning engineers to manually craft training recipes through error-prone trial-and-error on…

Time Series Foundation Models (TSFMs) have shown significant impact through their model capacity, scalability, and zero-shot generalization. However, due to the heterogeneity of inter-variate dependencies and the backbone scalability on…

Machine Learning · Computer Science 2025-10-15 Guo Qin , Zhi Chen , Yong Liu , Zhiyuan Shi , Haixuan Liu , Xiangdong Huang , Jianmin Wang , Mingsheng Long

Efficiently modeling spatio-temporal (ST) physical processes and observations presents a challenging problem for the deep learning community. Many recent studies have concentrated on meticulously reconciling various advantages, leading to…

Artificial Intelligence · Computer Science 2024-06-04 Hao Wu , Yuxuan Liang , Wei Xiong , Zhengyang Zhou , Wei Huang , Shilong Wang , Kun Wang

Moire artifacts are common in digital photography, resulting from the interference between high-frequency scene content and the color filter array of the camera. Existing deep learning-based demoireing methods trained on large scale…

Image and Video Processing · Electrical Eng. & Systems 2020-11-06 Lin Liu , Shanxin Yuan , Jianzhuang Liu , Liping Bao , Gregory Slabaugh , Qi Tian

This paper is a submission for the Weather4Cast~2025 complementary Pollution Task and presents an efficient framework for 6-hour lead-time nowcasting of PM$_1$, PM$_{2.5}$, and PM$_{10}$ across the Indian subcontinent and surrounding…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Ansh Kushwaha , Kaushik Gopalan

We introduce DenoMAE2.0, an enhanced denoising masked autoencoder that integrates a local patch classification objective alongside traditional reconstruction loss to improve representation learning and robustness. Unlike conventional Masked…

Machine Learning · Computer Science 2025-02-26 Atik Faysal , Mohammad Rostami , Taha Boushine , Reihaneh Gh. Roshan , Huaxia Wang , Nikhil Muralidhar

Residual transformations enhance the representational depth and expressive power of large language models (LLMs). However, applying static residual transformations across all tokens in auto-regressive generation leads to a suboptimal…

Computation and Language · Computer Science 2025-02-05 Nikhil Bhendawade , Mahyar Najibi , Devang Naik , Irina Belousova

Accurate beam prediction is essential for mitigating signalling overhead and latency in integrated sensing and communication-enabled massive multi-input multi-output systems. With the aid of multimodal learning, the prediction accuracy can…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Zijian Zheng , Wenqiang Yi , Hyundong Shin , Arumugam Nallanathan

Monocular 3D object detection remains challenging because metric size and depth are underdetermined by single-view evidence, particularly under occlusion, truncation, and projection-induced scale-depth ambiguity. Although recent methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Leon Davies , Qinggang Meng , Mohamad Saada , Baihua Li , Simon Sølvsten

Real-world multichannel time series prediction faces growing demands for efficiency across edge and cloud environments, making channel compression a timely and essential problem. Motivated by the success of Multiple-Input Multiple-Output…

Machine Learning · Computer Science 2026-01-30 Ziqi Liu , Pei Zeng , Yi Ding

A large number of time series forecasting models including traditional statistical models, machine learning models and more recently deep learning have been proposed in the literature. However, choosing the right model along with good…

Time series forecasting plays an increasingly important role in modern business decisions. In today's data-rich environment, people often aim to choose the optimal forecasting model for their data. However, identifying the optimal model…

Applications · Statistics 2021-12-17 Xixi Li , Fotios Petropoulos , Yanfei Kang

Although Transformers excel in natural language processing, their extension to time series forecasting remains challenging due to insufficient consideration of the differences between textual and temporal modalities. In this paper, we…

Machine Learning · Computer Science 2025-10-09 Zhipeng Liu , Peibo Duan , Xuan Tang , Baixin Li , Yongsheng Huang , Mingyang Geng , Changsheng Zhang , Bin Zhang , Binwu Wang

We introduce a model-agnostic forward diffusion process for time-series forecasting that decomposes signals into spectral components, preserving structured temporal patterns such as seasonality more effectively than standard diffusion.…

Machine Learning · Statistics 2026-02-17 Francisco Caldas , Sahil Kumar , Cláudia Soares

While multimodal foundation models can now natively work with data beyond text, they remain underutilized in analyzing the considerable amounts of multi-dimensional time-series data in fields like healthcare, finance, and social sciences,…

Time series underwent the transition from statistics to deep learning, as did many other machine learning fields. Although it appears that the accuracy has been increasing as the model is updated in a number of publicly available datasets,…

Machine Learning · Computer Science 2022-08-16 Gedi Liu , Yifeng Jiang , Yi Ouyang , Keyang Zhong , Yang Wang

This study is the first to analyze the performance of a time-series foundation AI model for Value-at-Risk (VaR), which essentially forecasts the left-tail quantiles of returns. Foundation models, pre-trained on diverse datasets, can be…

Risk Management · Quantitative Finance 2025-05-13 Anubha Goel , Puneet Pasricha , Juho Kanniainen

Large pre-trained models have demonstrated remarkable capabilities across domains, but their effectiveness in time series forecasting remains understudied. This work empirically examines whether pre-trained large-scale time series models…

Machine Learning · Computer Science 2025-07-08 Sanjay Chakraborty , Ibrahim Delibasoglu , Fredrik Heintz

We introduce MIO, a transformer-based model for inferring symbolic ordinary differential equations (ODEs) from multiple observed trajectories of a dynamical system. By combining multiple instance learning with transformer-based symbolic…

Machine Learning · Computer Science 2025-10-28 Yakup Emre Şahin , Niki Kilbertus , Sören Becker
‹ Prev 1 3 4 5 6 7 10 Next ›