English
Related papers

Related papers: Physics-Guided Tiny-Mamba Transformer for Reliabil…

200 papers

Point cloud registration (PCR) is a fundamental task in 3D computer vision and robotics. Most learning-based PCR methods rely on Transformer architectures, which suffer from quadratic computational complexity. This limitation restricts the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Bingxi Liu , An Liu , Hao Chen , Huaqi Tao , Jinqiang Cui , Yiqun Wang , Hong Zhang

Long-short range time series forecasting is essential for predicting future trends and patterns over extended periods. While deep learning models such as Transformers have made significant strides in advancing time series forecasting, they…

Machine Learning · Computer Science 2024-09-16 Wenqing Zhang , Junming Huang , Ruotong Wang , Changsong Wei , Wenqian Huang , Yuxin Qiao

Remote sensing change detection (RSCD) is vital for identifying land-cover changes, yet existing methods, including state-of-the-art State Space Models (SSMs), often lack explicit mechanisms to handle geometric misalignments and struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Min Sun , Fenghui Guo

Remote sensing change detection is vital for monitoring environmental and urban transformations but faces challenges like manual feature extraction and sensitivity to noise. Traditional methods and early deep learning models, such as…

Background: Pregnancy-associated thrombotic microangiopathy (P-TMA) is rare but life-threatening. Early risk prediction before overt clinical presentation remains challenging, as the associated laboratory abnormalities are subtle,…

Machine Learning · Computer Science 2026-05-14 Chuanchuan Sun , Zhen Yu , Qin Fan , Qingchao Chen , Feng Yu

Traditional mobility management strategies emphasize macro-level mobility oversight from traffic-sensing infrastructures, often overlooking safety risks that directly affect road users. To address this, we propose a Digital Twin-based…

Physics and Society · Physics 2024-07-23 Tao Li , Zilin Bian , Haozhe Lei , Fan Zuo , Ya-Ting Yang , Quanyan Zhu , Zhenning Li , Zhibin Chen , Kaan Ozbay

Detecting payment fraud in real-world banking streams requires models that can exploit both the order of events and the irregular time gaps between them. We introduce FraudTransformer, a sequence model that augments a vanilla GPT-style…

Accurate forecasting of residual Physical Resource Blocks (PRBs) is critical for proactive network slice provisioning, energy-efficient operation, and spectrum-aware decision making in cellular systems, where residual PRBs serve as a…

Machine Learning · Computer Science 2026-05-18 Saad Masrur , Yuxuan Jiang , Matti Hiltunen , Ajay Rajkumar , Ismail Guvenc

Long-term time series forecasting (LTSF) provides longer insights into future trends and patterns. Over the past few years, deep learning models especially Transformers have achieved advanced performance in LTSF tasks. However, LTSF faces…

Machine Learning · Computer Science 2024-06-28 Aobo Liang , Xingguo Jiang , Yan Sun , Xiaohou Shi , Ke Li

Human trajectory forecasting is crucial for safe navigation in crowded environments, requiring models that balance accuracy with computational efficiency. Efficiently modeling social interactions is key to performance in dense crowds. Yet,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Po-Chien Luan , Wuyang Li , Yang Gao , Alexandre Alahi

Radio map (RM) has recently attracted much attention since it can provide real-time and accurate spatial channel information for 6G services and applications. However, current deep learning-based methods for RM construction exhibit well…

Signal Processing · Electrical Eng. & Systems 2025-08-14 Honggang Jia , Nan Cheng , Xiucheng Wang , Conghao Zhou , Ruijin Sun , Xuemin , Shen

In pediatric cardiology, the accurate and immediate assessment of cardiac function through echocardiography is crucial since it can determine whether urgent intervention is required in many emergencies. However, echocardiography is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zi Ye , Tianxiang Chen , Fangyijie Wang , Hanwei Zhang , Lijun Zhang

Large-scale pre-trained transformers have demonstrated remarkable success in various computer vision tasks. However, it is still highly challenging to fully fine-tune these models for downstream tasks due to their high computational and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Zhao Song , Ke Yang , Naiyang Guan , Junjie Zhu , Peng Qiao , Qingyong Hu

Mamba has recently gained widespread attention as a backbone model for point cloud modeling, leveraging a state-space architecture that enables efficient global sequence modeling with linear complexity. However, its lack of local inductive…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Xuanyu Lin , Xiaona Zeng , Xianwei Zheng , Xutao Li

Motivation: Generative models for protein backbone design have to simultaneously ensure geometric validity, sampling efficiency, and scalability to long sequences. However, most existing approaches rely on iterative refinement, quadratic…

Biomolecules · Quantitative Biology 2026-03-31 Tianyu Wu , Lin Zhu

Turbulence is notoriously difficult to model due to its multi-scale nature and sensitivity to small perturbations. Classical solvers of turbulence simulation generally operate on finer grids and are computationally inefficient. In this…

Fluid Dynamics · Physics 2022-07-12 Yuchen Dang , Zheyuan Hu , Miles Cranmer , Michael Eickenberg , Shirley Ho

Detecting early warning indicators for abrupt dynamical transitions in complex systems or high-dimensional observation data is essential in many real-world applications, such as brain diseases, natural disasters, and engineering…

Machine Learning · Statistics 2024-04-08 Lingyu Feng , Ting Gao , Wang Xiao , Jinqiao Duan

Pre-trained language models (PLMs) demonstrate remarkable intelligence but struggle with emerging tasks unseen during training in real-world applications. Training separate models for each new task is usually impractical. Multi-task…

Computation and Language · Computer Science 2025-05-02 Xiao Zhang , Kangsheng Wang , Tianyu Hu , Huimin Ma

Existing RGB-T tracking algorithms have made remarkable progress by leveraging the global interaction capability and extensive pre-trained models of the Transformer architecture. Nonetheless, these methods mainly adopt imagepair appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Simiao Lai , Chang Liu , Jiawen Zhu , Ben Kang , Yang Liu , Dong Wang , Huchuan Lu

In modern distribution systems, load uncertainty can be fully captured by micro-PMUs, which can record high-resolution data; however, in practice, micro-PMUs are installed at limited locations in distribution networks due to budgetary…

Signal Processing · Electrical Eng. & Systems 2020-12-01 Fankun Bu , Kaveh Dehghanpour , Zhaoyu Wang