English
Related papers

Related papers: Physics-Guided Tiny-Mamba Transformer for Reliabil…

200 papers

Accurate traffic forecasting is crucial for intelligent transportation systems, supporting effective traffic management, congestion reduction, and informed urban planning. However, traditional models often fail to adequately capture the…

Artificial Intelligence · Computer Science 2026-04-21 Dongyi He , Yuanquan Gao , Bin Jiang , He Yan

Practitioners monitoring deployed probabilistic models face a fundamental trap: any fixed-sample test applied repeatedly over an unbounded stream will eventually raise a false alarm, even when the model remains perfectly stable. Existing…

Methodology · Statistics 2026-03-16 Tristan Farran

Transformer-based large language models (LLMs) have achieved strong performance across many natural language processing tasks. Nonetheless, their quadratic computational and memory requirements, particularly in self-attention layers, pose…

Computation and Language · Computer Science 2025-09-03 Fabien Furfaro

Digital twins (DTs) enable powerful predictive analytics, but persistent discrepancies between simulations and real systems--known as the reality gap--undermine their reliability. Coined in robotics, the term now applies to DTs, where…

Machine Learning · Computer Science 2026-01-29 Sizhe Ma , Katherine A. Flanigan , Mario Bergés

Recent advances in deep learning have made it possible to predict phenotypic measures directly from functional magnetic resonance imaging (fMRI) brain volumes, sparking significant interest in the neuroimaging community. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Arunkumar Kannan , Martin A. Lindquist , Brian Caffo

Ecological Momentary Assessments (EMAs) are an important psychological data source for measuring current cognitive states, affect, behavior, and environmental factors from participants in mobile health (mHealth) studies and treatment…

State space models, such as Mamba, have recently garnered attention in time series forecasting due to their ability to capture sequence patterns. However, in electricity consumption benchmarks, Mamba forecasts exhibit a mean error of…

Machine Learning · Statistics 2025-07-08 Pedro Pessoa , Paul Campitelli , Douglas P. Shepherd , S. Banu Ozkan , Steve Pressé

Time series classification (TSC) is crucial in numerous real-world applications, such as environmental monitoring, medical diagnosis, and posture recognition. TSC tasks require models to effectively capture discriminative information for…

Machine Learning · Computer Science 2025-12-10 Da Zhang , Bingyu Li , Zhiyuan Zhao , Yanhan Zhang , Junyu Gao , Feiping Nie , Xuelong Li

Time series forecasting in real world environments faces significant challenges non stationarity, multi scale temporal patterns, and distributional shifts that degrade model stability and accuracy. This study propose AdaMamba, a unified…

Machine Learning · Computer Science 2025-12-09 MinCheol Jeon

Cross-modal alignment is crucial for multimodal representation fusion due to the inherent heterogeneity between modalities. While Transformer-based methods have shown promising results in modeling inter-modal relationships, their quadratic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yan Li , Yifei Xing , Xiangyuan Lan , Xin Li , Haifeng Chen , Dongmei Jiang

The large-scale integration of inverter-based resources (IBRs), particularly distributed photovoltaics (DPVs), into distribution networks increases the need for integrated transmission and distribution (T&D) co-simulation. A key challenge…

Systems and Control · Electrical Eng. & Systems 2026-04-23 Jong Ha Woo , Qi Xiao , Yu Ma , Zishuo Yang , Victor Daldegan Paduani , Ning Lu

Multivariate time series classification (TSC) is critical for various applications in fields such as healthcare and finance. While various approaches for TSC have been explored, important properties of time series, such as shift…

Machine Learning · Computer Science 2025-03-18 Md Atik Ahamed , Qiang Cheng

The increasing prevalence of compact UAVs has introduced significant risks to public safety, while traditional drone detection systems are often bulky and costly. To address these challenges, we present TAME, the Temporal Audio-based Mamba…

Sound · Computer Science 2025-03-04 Zhenyuan Xiao , Huanran Hu , Guili Xu , Junwei He

Venous thromboembolism (VTE) is a critical cardiovascular condition, encompassing deep vein thrombosis (DVT) and pulmonary embolism (PE). Accurate and timely identification of VTE is essential for effective medical care. This study builds…

Machine Learning · Computer Science 2024-08-20 Jamie Deng , Yusen Wu , Yelena Yesha , Phuong Nguyen

Dynamic graph embedding has emerged as an important technique for modeling complex time-evolving networks across diverse domains. While transformer-based models have shown promise in capturing long-range dependencies in temporal graph data,…

Machine Learning · Computer Science 2025-05-13 Ashish Parmanand Pandey , Alan John Varghese , Sarang Patil , Mengjia Xu

Multi-task dense scene understanding, which trains a model for multiple dense prediction tasks, has a wide range of application scenarios. Capturing long-range dependency and enhancing cross-task interactions are crucial to multi-task dense…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Baijiong Lin , Weisen Jiang , Pengguang Chen , Shu Liu , Ying-Cong Chen

Closed-loop control of nonlinear dynamical systems with partial-state observability demands expert knowledge of a diverse, less standardized set of theoretical tools. Moreover, it requires a delicate integration of controller and estimator…

Systems and Control · Electrical Eng. & Systems 2024-04-04 Xiangyuan Zhang , Weichao Mao , Haoran Qiu , Tamer Başar

Human motion understanding is a fundamental task with diverse practical applications, facilitated by the availability of large-scale motion capture datasets. Recent studies focus on text-motion tasks, such as text-based motion generation,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Xinghan Wang , Zixi Kang , Yadong Mu

Transformer-based architectures have become the backbone of both uni-modal and multi-modal foundation models, largely due to their scalability via attention mechanisms, resulting in a rich ecosystem of publicly available pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Xiuwei Chen , Wentao Hu , Xiao Dong , Sihao Lin , Zisheng Chen , Meng Cao , Yina Zhuang , Jianhua Han , Hang Xu , Xiaodan Liang

Clinical time-series data are difficult to model with methods designed for regular sequences because they exhibit irregular sampling, frequent missing values, and heterogeneous observation patterns across variables. Existing approaches…

Machine Learning · Computer Science 2026-05-19 Jinwoong Kim , Sangjin Park