中文
相关论文

相关论文: Self-Supervised Multimodal Fusion Transformer for …

200 篇论文

Accurate and efficient estimation of Channel State Information (CSI) is critical for next-generation wireless systems operating under non-stationary conditions, where user mobility, Doppler spread, and multipath dynamics rapidly alter…

分布式、并行与集群计算 · 计算机科学 2025-11-04 Muhammad Ahmed Mohsin , Muhammad Umer , Ahsan Bilal , Hassan Rizwan , Sagnik Bhattacharya , Muhammad Ali Jamshed , John M. Cioffi

Neural population activity often exhibits regime-dependent non-stationarity in the form of switching dynamics. Learning accurate switching dynamical system models can reveal how behavior is encoded in neural activity. Existing switching…

机器学习 · 计算机科学 2025-12-16 DongKyu Kim , Han-Lin Hsieh , Maryam M. Shanechi

In recent years, the widespread adoption of wearable devices has highlighted the growing importance of behavior analysis using IMU. While applications span diverse fields such as healthcare and robotics, recent studies have increasingly…

计算机视觉与模式识别 · 计算机科学 2025-06-05 Koki Matsuishi , Kosuke Ukita , Tsuyoshi Okita

Unmanned aerial vehicle (UAV) detection and aerial object recognition are critical for modern surveillance and security, prompting a need for robust systems that overcome limitations of single-modality approaches. This research addresses…

计算机视觉与模式识别 · 计算机科学 2025-11-20 Mauro Larrat , Claudomiro Sales

In this study, we introduce an innovative methodology for the design of mm-Wave passive networks that leverages knowledge transfer from a pre-trained synthesis neural network (NN) model in one technology node and achieves swift and reliable…

信号处理 · 电气工程与系统科学 2025-03-12 Chenhao Chu , Yuhao Mao , Hua Wang

Pansharpening aims to fuse high-resolution panchromatic (PAN) images with low-resolution multispectral (LRMS) images to generate high-resolution multispectral (HRMS) images. Although deep learning-based methods have achieved promising…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Zeyu Xia , Chenxi Sun , Tianyu Xin , Yubo Zeng , Haoyu Chen , Liang-Jian Deng

Real-time recognition and prediction of surgical activities are fundamental to advancing safety and autonomy in robot-assisted surgery. This paper presents a multimodal transformer architecture for real-time recognition and prediction of…

机器人学 · 计算机科学 2024-10-27 Keshara Weerasinghe , Seyed Hamid Reza Roodabeh , Kay Hutchinson , Homa Alemzadeh

In this work, we propose a novel unsupervised deep learning model to address multi-focus image fusion problem. First, we train an encoder-decoder network in unsupervised manner to acquire deep feature of input images. And then we utilize…

计算机视觉与模式识别 · 计算机科学 2020-09-25 Boyuan Ma , Xiaojuan Ban , Haiyou Huang , Yu Zhu

Current learning-based wireless methods struggle with generalization due to the fragmented processing of communication and sensing data. WiFo-MiSAC addresses this as a task-agnostic foundation model that tokenizes heterogeneous signals into…

信号处理 · 电气工程与系统科学 2026-04-21 Xuanyu Liu , Shijian Gao , Boxun Liu , Xiang Cheng , Liuqing Yang

A reliable comfort model is essential to improve occupant satisfaction and reduce building energy consumption. As two types of the most common and intuitive thermal adaptive behaviors, precise recognition of dressing and undressing can…

人机交互 · 计算机科学 2024-10-30 Zhaohe Lv , Guoliang Zhao , Zhanbo Xu , Jiang Wu , Yadong Zhou , Kun Liu

A major barrier to the personalized Human Activity Recognition using wearable sensors is that the performance of the recognition model drops significantly upon adoption of the system by new users or changes in physical/ behavioral status of…

计算机视觉与模式识别 · 计算机科学 2018-01-26 Seyed Ali Rokni , Marjan Nourollahi , Hassan Ghasemzadeh

Despite the exciting performance, Transformer is criticized for its excessive parameters and computation cost. However, compressing Transformer remains as an open problem due to its internal complexity of the layer designs, i.e., Multi-Head…

计算机视觉与模式识别 · 计算机科学 2022-05-25 Gen Luo , Yiyi Zhou , Xiaoshuai Sun , Yan Wang , Liujuan Cao , Yongjian Wu , Feiyue Huang , Rongrong Ji

The problem of information fusion from multiple data-sets acquired by multimodal sensors has drawn significant research attention over the years. In this paper, we focus on a particular problem setting consisting of a physical phenomenon or…

机器学习 · 统计学 2018-11-21 Ori Katz , Ronen Talmon , Yu-Lun Lo , Hau-Tieng Wu

Wearable Human Activity Recognition (WHAR) is a prominent research area within ubiquitous computing. Multi-sensor synchronous measurement has proven to be more effective for WHAR than using a single sensor. However, existing WHAR methods…

计算机视觉与模式识别 · 计算机科学 2025-04-28 Haoyu Xie , Haoxuan Li , Chunyuan Zheng , Haonan Yuan , Guorui Liao , Jun Liao , Li Liu

Transformer-based supervised pre-training achieves great performance in person re-identification (ReID). However, due to the domain gap between ImageNet and ReID datasets, it usually needs a larger pre-training dataset (e.g. ImageNet-21K)…

计算机视觉与模式识别 · 计算机科学 2021-11-24 Hao Luo , Pichao Wang , Yi Xu , Feng Ding , Yanxin Zhou , Fan Wang , Hao Li , Rong Jin

Extensive research has been conducted on assessing grasp stability, a crucial prerequisite for achieving optimal grasping strategies, including the minimum force grasping policy. However, existing works employ basic feature-level fusion…

机器人学 · 计算机科学 2023-08-03 Zhuangzhuang Zhang , Zhenning Zhou , Haili Wang , Zhinan Zhang , Huang Huang , Qixin Cao

Combining information from multi-view images is crucial to improve the performance and robustness of automated methods for disease diagnosis. However, due to the non-alignment characteristics of multi-view images, building correlation and…

图像与视频处理 · 电气工程与系统科学 2022-09-07 Di Liu , Yunhe Gao , Qilong Zhangli , Ligong Han , Xiaoxiao He , Zhaoyang Xia , Song Wen , Qi Chang , Zhennan Yan , Mu Zhou , Dimitris Metaxas

We propose a cross-attention Transformer for joint decoding of uplink OFDM signals received by multiple coordinated access points. A shared per-receiver encoder learns the time-frequency structure of each grid, and a token-wise…

信号处理 · 电气工程与系统科学 2026-04-08 Xavier Tardy , Grégoire Lefebvre , Apostolos Kountouris , Haïfa Fares , Amor Nafkha

Weakly supervised semantic segmentation (WSSS) based on image-level labels is challenging since it is hard to obtain complete semantic regions. To address this issue, we propose a self-training method that utilizes fused multi-scale…

计算机视觉与模式识别 · 计算机科学 2023-05-11 Guoqing Yang , Chuang Zhu , Yu Zhang

Drone-camera based human activity recognition (HAR) has received significant attention from the computer vision research community in the past few years. A robust and efficient HAR system has a pivotal role in fields like video…

计算机视觉与模式识别 · 计算机科学 2022-11-11 Santosh Kumar Yadav , Esha Pahwa , Achleshwar Luthra , Kamlesh Tiwari , Hari Mohan Pandey , Peter Corcoran