English
Related papers

Related papers: SSD-TS: Exploring the Potential of Linear State Sp…

200 papers

Diffusion models (DMs) have shown promise for Time-Series Data Imputation (TSDI); however, their performance remains inconsistent in complex scenarios. We attribute this to two primary obstacles: (1) non-stationary temporal dynamics, which…

Machine Learning · Computer Science 2026-02-03 Zhichao Chen , Hao Wang , Fangyikang Wang , Licheng Pan , Zhengnan Li , Yunfei Teng , Haoxuan Li , Zhouchen Lin

Spatially resolved transcriptomics represents a significant advancement in single-cell analysis by offering both gene expression data and their corresponding physical locations. However, this high degree of spatial resolution entails a…

Genomics · Quantitative Biology 2024-03-19 Xiaoyu Li , Wenwen Min , Shunfang Wang , Changmiao Wang , Taosheng Xu

While Transformers have been the main architecture behind deep learning's success in language modeling, state-space models (SSMs) such as Mamba have recently been shown to match or outperform Transformers at small to medium scale. We show…

Machine Learning · Computer Science 2024-06-03 Tri Dao , Albert Gu

Deep learning models in the Earth Observation domain heavily rely on the availability of large-scale accurately labeled satellite imagery. However, obtaining and labeling satellite imagery is a resource-intensive endeavor. While generative…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Orkhan Baghirli , Hamid Askarov , Imran Ibrahimli , Ismat Bakhishov , Nabi Nabiyev

Distribution System State Estimation (DSSE) plays an increasingly-important role in modern power grids due to the integration of distributed energy resources (DERs). The inherent characteristics of distribution systems make classical…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Bader Alabdulrazzaq , Bri-Mathias Hodge

With intelligent room-side sensing and service robots widely deployed, human motion prediction (HMP) is essential for safe, proactive assistance. However, many existing HMP methods either produce a single, deterministic forecast that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Junqiao Fan , Pengfei Liu , Haocong Rao

Spatiotemporal data mining plays an important role in air quality monitoring, crowd flow modeling, and climate forecasting. However, the originally collected spatiotemporal data in real-world scenarios is usually incomplete due to sensor…

Machine Learning · Computer Science 2023-02-21 Mingzhe Liu , Han Huang , Hao Feng , Leilei Sun , Bowen Du , Yanjie Fu

In this work, we propose an approach to generalize denoising diffusion probabilistic models for stock market predictions and portfolio management. Present works have demonstrated the efficacy of modeling interstock relations for market…

Machine Learning · Computer Science 2024-03-22 Divyanshu Daiya , Monika Yadav , Harshit Singh Rao

Physics-informed machine learning (PIML) has emerged as a promising alternative to classical methods for predicting dynamical systems, offering faster and more generalizable solutions. However, existing models, including recurrent neural…

Machine Learning · Computer Science 2025-01-28 Zheyuan Hu , Nazanin Ahmadi Daryakenari , Qianli Shen , Kenji Kawaguchi , George Em Karniadakis

Efficiently modeling large 2D contexts is essential for various fields including Giga-Pixel Whole Slide Imaging (WSI) and remote sensing. Transformer-based models offer high parallelism but face challenges due to their quadratic complexity…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Jingwei Zhang , Anh Tien Nguyen , Xi Han , Vincent Quoc-Huy Trinh , Hong Qin , Dimitris Samaras , Mahdi S. Hosseini

Forecasting complex time series is an important yet challenging problem that involves various industrial applications. Recently, masked time-series modeling has been proposed to effectively model temporal dependencies for forecasting by…

Machine Learning · Computer Science 2025-07-02 Hyunwoo Seo , Chiehyeon Lim

Multispectral fusion object detection is a critical task for edge-based maritime surveillance and remote sensing, demanding both high inference efficiency and robust feature representation for high-resolution inputs. However, current State…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Qianqian Zhang , Leon Tabaro , Ahmed M. Abdelmoniem , Junshe An

Leveraging neural networks as surrogate models for turbulence simulation is a topic of growing interest. At the same time, embodying the inherent uncertainty of simulations in the predictions of surrogate models remains very challenging.…

Fluid Dynamics · Physics 2024-10-10 Qiang Liu , Nils Thuerey

State Space Models (SSMs) have emerged as a promising alternative to the popular transformer-based models and have been increasingly gaining attention. Compared to transformers, SSMs excel at tasks with sequential data or longer contexts,…

Machine Learning · Computer Science 2025-03-17 Xingtai Lv , Youbang Sun , Kaiyan Zhang , Shang Qu , Xuekai Zhu , Yuchen Fan , Yi Wu , Ermo Hua , Xinwei Long , Ning Ding , Bowen Zhou

Diffusion Probabilistic Models (DPMs) have been recently utilized to deal with various blind image restoration (IR) tasks, where they have demonstrated outstanding performance in terms of perceptual quality. However, the task-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Magauiya Zhussip , Iaroslav Koshelev , Stamatis Lefkimmiatis

The imputation of missing values in time series has many applications in healthcare and finance. While autoregressive models are natural candidates for time series imputation, score-based diffusion models have recently outperformed existing…

Machine Learning · Computer Science 2021-10-28 Yusuke Tashiro , Jiaming Song , Yang Song , Stefano Ermon

Time series forecasting has made significant advances, including with Transformer-based models. The attention mechanism in Transformer effectively captures temporal dependencies by attending to all past inputs simultaneously. However, its…

Machine Learning · Computer Science 2025-11-04 Xiongxiao Xu , Canyu Chen , Yueqing Liang , Baixiang Huang , Guangji Bai , Liang Zhao , Kai Shu

With the rapid development of diffusion models and flow-based generative models, there has been a surge of interests in solving noisy linear inverse problems, e.g., super-resolution, deblurring, denoising, colorization, etc, with generative…

Machine Learning · Computer Science 2024-10-22 Xiangming Meng , Yoshiyuki Kabashima

Recently, the Mamba architecture based on State Space Models (SSMs) has gained attention in 3D human pose estimation due to its linear complexity and strong global modeling capability. However, existing SSM-based methods typically apply…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Hu Cui , Wenqiang Hua , Renjing Huang , Shurui Jia , Tessai Hayama

Recent years have witnessed a growing interest for time series foundation models, with a strong emphasis on the forecasting task. Yet, the crucial task of out-of-domain imputation of missing values remains largely underexplored. We propose…

Machine Learning · Computer Science 2025-11-11 Etienne Le Naour , Tahar Nabil , Ghislain Agoua