English
Related papers

Related papers: DCMSA: Multi-Head Self-Attention Mechanism Based o…

200 papers

Due to limitations such as geographic, physical, or economic factors, collected seismic data often have missing traces. Traditional seismic data reconstruction methods face the challenge of selecting numerous empirical parameters and…

Geophysics · Physics 2026-01-09 Shuang Wang , Fei Deng , Peifan Jiang , Zezheng Ni , Bin Wang

In recent years, convolutional neural networks (CNNs) with channel-wise feature refining mechanisms have brought noticeable benefits to modelling channel dependencies. However, current attention paradigms fail to infer an optimal channel…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Nick Nikzad , Yongsheng Gao , Jun Zhou

While diffusion Multimodal Large Language Models (dMLLMs) have recently achieved remarkable strides in multimodal generation, the development of interpretability mechanisms has lagged behind their architectural evolution. Unlike traditional…

Artificial Intelligence · Computer Science 2026-04-14 Haomin Zuo , Yidi Li , Luoxiao Yang , Xiaofeng Zhang

To achieve continuous massive data transmission with significantly reduced data payload, the users can adopt semantic communication techniques to compress the redundant information by transmitting semantic features instead. However, current…

Signal Processing · Electrical Eng. & Systems 2024-01-30 Youcheng Zeng , Xinxin He , Xu Chen , Haonan Tong , Zhaohui Yang , Yijun Guo , Jianjun Hao

Recently, many attention-based deep neural networks have emerged and achieved state-of-the-art performance in environmental sound classification. The essence of attention mechanism is assigning contribution weights on different parts of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-06 You Wang , Chuyao Feng , David V. Anderson

Remote sensing change detection (CD) has made significant advancements with the adoption of Convolutional Neural Networks (CNNs) and Transformers. While CNNs offer powerful feature extraction, they are constrained by receptive field…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 JunYao Kaung , HongWei Ge

Multimodal medical image fusion is a crucial task that combines complementary information from different imaging modalities into a unified representation, thereby enhancing diagnostic accuracy and treatment planning. While deep learning…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Meng Zhou , Yuxuan Zhang , Xiaolan Xu , Jiayi Wang , Farzad Khalvati

Denoising diffusion models represent a recent emerging topic in computer vision, demonstrating remarkable results in the area of generative modeling. A diffusion model is a deep generative model that is based on two stages, a forward…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Florinel-Alin Croitoru , Vlad Hondru , Radu Tudor Ionescu , Mubarak Shah

Geological parameterization entails the representation of a geomodel using a small set of latent variables and a mapping from these variables to grid-block properties such as porosity and permeability. Parameterization is useful for data…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Guido Di Federico , Louis J. Durlofsky

Remote sensing change detection is vital for monitoring environmental and urban transformations but faces challenges like manual feature extraction and sensitivity to noise. Traditional methods and early deep learning models, such as…

Accurately capturing the full-range response of structures is crucial in structural health monitoring (SHM) for ensuring safety and operational integrity. However, limited sensor deployment due to cost, accessibility, or scale often hinders…

Computational Engineering, Finance, and Science · Computer Science 2025-09-25 Wingho Feng , Quanwang Li , Chen Wang , Jian-sheng Fan

In recent years, building change detection methods have made great progress by introducing deep learning, but they still suffer from the problem of the extracted features not being discriminative enough, resulting in incomplete regions and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Yi Liu , Chao Pang , Zongqian Zhan , Xiaomeng Zhang , Xue Yang

Global Navigation Satellite Systems (GNSS) are vital for reliable urban positioning. However, multipath and non-line-of-sight reception often introduce large measurement errors that degrade accuracy. Learning-based methods for predicting…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Jiaqi Zhu , Shouyi Lu , Ziyao Li , Guirong Zhuo , Lu Xiong

Driver Monitoring Systems (DMSs) are crucial for safe hand-over actions in Level-2+ self-driving vehicles. State-of-the-art DMSs leverage multiple sensors mounted at different locations to monitor the driver and the vehicle's interior scene…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yiming Ma , Victor Sanchez , Soodeh Nikan , Devesh Upadhyay , Bhushan Atote , Tanaya Guha

Outdoor images often suffer from severe degradation due to rain, haze, and noise, impairing image quality and challenging high-level tasks. Current image restoration methods struggle to handle complex degradation while maintaining…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Huan Zhang , Xu Zhang , Nian Cai , Jianglei Di , Yun Zhang

We propose self-diffusion, a novel framework for solving inverse problems without relying on pretrained generative models. Traditional diffusion-based approaches require training a model on a clean dataset to learn to reverse the forward…

Machine Learning · Computer Science 2025-12-09 Guanxiong Luo , Shoujin Huang , Yanlong Yang

Masked diffusion models (MDMs), which leverage bidirectional attention and a denoising process, are narrowing the performance gap with autoregressive models (ARMs). However, their internal attention mechanisms remain under-explored. This…

Artificial Intelligence · Computer Science 2026-01-13 Pengcheng Huang , Tianming Liu , Zhenghao Liu , Yukun Yan , Shuo Wang , Tong Xiao , Zulong Chen , Maosong Sun

In recent years, decentralized sensor networks have garnered significant attention in the field of state estimation owing to enhanced robustness, scalability, and fault tolerance. Optimal fusion performance can be achieved under fully…

Signal Processing · Electrical Eng. & Systems 2025-08-27 Ruifeng Dong , Ming Wang , Ning Liu , Tong Guo , Jiayi Kang , Xiaojing Shen , Yao Mao

Semantic communication (SemCom) aims to convey the intended meaning of messages rather than merely transmitting bits, thereby offering greater efficiency and robustness, particularly in resource-constrained or noisy environments. In this…

Information Theory · Computer Science 2025-07-08 Chengyang Liang , Dong Li

Vision-based motion capture solutions often struggle with occlusions, which result in the loss of critical joint information and hinder accurate 3D motion reconstruction. Other wearable alternatives also suffer from noisy or unstable data,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Junkun Jiang , Jie Chen , Ho Yin Au , Jingyu Xiang