English
Related papers

Related papers: START: A Generalized State Space Model with Salien…

200 papers

Selective State-Space Models (SSMs) such as Mamba have emerged as an alternative architecture to self-attention based transformers in sequence modeling tasks. Recent works have demonstrated the use of transformers in some filtering and…

Systems and Control · Electrical Eng. & Systems 2026-04-28 Alex Tang , M. Emrullah Ildiz , Batin Kurt , Samet Oymak , Necmiye Ozay

Physics-informed machine learning (PIML) has emerged as a promising alternative to classical methods for predicting dynamical systems, offering faster and more generalizable solutions. However, existing models, including recurrent neural…

Machine Learning · Computer Science 2025-01-28 Zheyuan Hu , Nazanin Ahmadi Daryakenari , Qianli Shen , Kenji Kawaguchi , George Em Karniadakis

Graph Neural Networks based on the message-passing (MP) mechanism are a dominant approach for handling graph-structured data. However, they are inherently limited to modeling only pairwise interactions, making it difficult to explicitly…

Machine Learning · Computer Science 2024-09-19 Marco Montagna , Simone Scardapane , Lev Telyatnikov

Machine learning models typically suffer from the domain shift problem when trained on a source dataset and evaluated on a target dataset of different distribution. To overcome this problem, domain generalisation (DG) methods aim to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Kaiyang Zhou , Yongxin Yang , Timothy Hospedales , Tao Xiang

Deep learning has revolutionized medical imaging by providing innovative solutions to complex healthcare challenges. Traditional models often struggle to dynamically adjust feature importance, resulting in suboptimal representation,…

Image and Video Processing · Electrical Eng. & Systems 2024-04-29 Kazi Shahriar Sanjid , Md. Tanzim Hossain , Md. Shakib Shahariar Junayed , M. Monir Uddin

State Space Models (SSMs) are powerful tools for modeling sequential data in computer vision and time series analysis domains. However, traditional SSMs are limited by fixed, one-dimensional sequential processing, which restricts their…

Machine Learning · Computer Science 2025-04-08 Nikola Zubić , Davide Scaramuzza

Deep learning techniques have revolutionized the infrared and visible image fusion (IVIF), showing remarkable efficacy on complex scenarios. However, current methods do not fully combine frequency domain features with global semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Tianpei Zhang , Yiming Zhu , Jufeng Zhao , Guangmang Cui , Yuchen Zheng

Machine learning algorithms have the potential to improve patient outcomes in digital pathology. However, generalization of these tools is currently limited by sensitivity to variations in tissue preparation, staining procedures and…

Multispectral fusion object detection is a critical task for edge-based maritime surveillance and remote sensing, demanding both high inference efficiency and robust feature representation for high-resolution inputs. However, current State…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Qianqian Zhang , Leon Tabaro , Ahmed M. Abdelmoniem , Junshe An

Domain generalization (DG) aims to learn predictive models that can generalize to unseen domains. Most existing DG approaches focus on learning domain-invariant representations under the assumption of conditional distribution shift (i.e.,…

Machine Learning · Computer Science 2026-02-03 Jewon Yeom , Kyubyung Chae , Hyunggyu Lim , Yoonna Oh , Dongyoon Yang , Taesup Kim

The generalization of deep neural networks to unknown domains is a major challenge despite their tremendous progress in recent years. For this reason, the dynamic area of domain generalization (DG) has emerged. In contrast to unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Manuel Schwonberg , Hanno Gottschalk

Domain generalization is a critical challenge for machine learning systems. Prior domain generalization methods focus on extracting domain-invariant features across several stationary domains to enable generalization to new domains.…

Machine Learning · Computer Science 2024-01-17 Binghui Xie , Yongqiang Chen , Jiaqi Wang , Kaiwen Zhou , Bo Han , Wei Meng , James Cheng

Convolutional neural networks have primarily led 3D medical image segmentation but may be limited by small receptive fields. Transformer models excel in capturing global relationships through self-attention but are challenged by high…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Ao Chang , Jiajun Zeng , Ruobing Huang , Dong Ni

Convolutional neural networks (CNN) and Transformers have made impressive progress in the field of remote sensing change detection (CD). However, both architectures have inherent shortcomings: CNN are constrained by a limited receptive…

Image and Video Processing · Electrical Eng. & Systems 2024-12-31 Hongruixuan Chen , Jian Song , Chengxi Han , Junshi Xia , Naoto Yokoya

State-space models (SSMs) have emerged as efficient alternatives to Transformers for sequence modeling, offering superior scalability through recurrent structures. However, their training remains costly and the ecosystem around them is far…

Machine Learning · Computer Science 2025-10-24 Penghao Wang , Yuhao Zhou , Mengxuan Wu , Panpan Zhang , Zhangyang Wang , Kai Wang

Recent deep models for image shadow removal often rely on attention-based architectures to capture long-range dependencies. However, their fixed attention patterns tend to mix illumination cues from irrelevant regions, leading to distorted…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Zhaotong Yang , Yi Chen , Yanying Li , Shengfeng He , Yangyang Xu , Junyu Dong , Jian Yang , Yong Du

Domain shift widely exists in the visual world, while modern deep neural networks commonly suffer from severe performance degradation under domain shift due to the poor generalization ability, which limits the real-world applications. The…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Yuyang Zhao , Zhun Zhong , Na Zhao , Nicu Sebe , Gim Hee Lee

For many practical computer vision applications, the learned models usually have high performance on the datasets used for training but suffer from significant performance degradation when deployed in new environments, where there are…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Xin Jin , Cuiling Lan , Wenjun Zeng , Zhibo Chen

The Mamba layer offers an efficient selective state space model (SSM) that is highly effective in modeling multiple domains, including NLP, long-range sequence processing, and computer vision. Selective SSMs are viewed as dual models, in…

Machine Learning · Computer Science 2024-04-02 Ameen Ali , Itamar Zimerman , Lior Wolf

State-space modeling has emerged as a powerful paradigm for sequence analysis in various tasks such as natural language processing, time-series forecasting, and signal processing. In this work, we propose an \emph{Adaptive State-Space…

Machine Learning · Computer Science 2025-07-31 Alice Zhang , Chao Li