English
Related papers

Related papers: Self-Supervised Transformers for fMRI representati…

200 papers

The accelerated MRI reconstruction process presents a challenging ill-posed inverse problem due to the extensive under-sampling in k-space. Recently, Vision Transformers (ViTs) have become the mainstream for this task, demonstrating…

Image and Video Processing · Electrical Eng. & Systems 2024-12-17 Yucong Meng , Zhiwei Yang , Yonghong Shi , Zhijian Song

Recent progress in image deblurring techniques focuses mainly on operating in both frequency and spatial domains using the Fourier transform (FT) properties. However, their performance is limited due to the dependency of FT on stationary…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Subhajit Paul , Sahil Kumawat , Ashutosh Gupta , Deepak Mishra

Time-frequency (TF) domain dual-path models achieve high-fidelity speech separation. While some previous state-of-the-art (SoTA) models rely on RNNs, this reliance means they lack the parallelizability, scalability, and versatility of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-08 Kohei Saijo , Gordon Wichern , François G. Germain , Zexu Pan , Jonathan Le Roux

To address limitations of the graph fractional Fourier transform (GFRFT) Wiener filtering and the traditional joint time-vertex fractional Fourier transform (JFRFT) Wiener filtering, this study proposes a filtering method based on the…

Signal Processing · Electrical Eng. & Systems 2025-07-30 Ziqi Yan , Zhichao Zhang

State-of-the-art backpropagation-free learning methods employ local error feedback to direct iterative optimisation via gradient descent. Here, we examine the more restrictive setting where retrograde communication from neuronal outputs is…

Machine Learning · Computer Science 2025-12-19 Robert O'Shea , Bipin Rajendran

Deep learning has shown significant potential in diagnosing neurodegenerative diseases from MRI data. However, most existing methods rely heavily on large volumes of labeled data and often yield representations that lack interpretability.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Fangqi Cheng , Yingying Zhao , Xiaochen Yang

Multimode fiber (MMF) imaging aided by machine learning holds promise for numerous applications, including medical endoscopy. A key challenge for this technology is the sensitivity of modal transmission characteristics to environmental…

The partially separable functions (PSF) model is commonly adopted in dynamic MRI reconstruction, as is the underlying signal model in many reconstruction methods including the ones relying on low-rank assumptions. Even though the PSF model…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 Rodrigo A. Lobos , Xiaokai Wang , Rex T. L. Fung , Yongli He , David Frey , Dinank Gupta , Zhongming Liu , Jeffrey A. Fessler , Douglas C. Noll

Many fault diagnosis methods of rotating machines are based on discriminative features extracted from signals collected from the key components such as bearings. However, under complex operating conditions, periodic impulsive…

Signal Processing · Electrical Eng. & Systems 2025-12-12 Yuhan Yuan , Xiaomo Jiang , Haibin Yang , Haixin Zhao , Shengbo Wang , Xueyu Cheng , Jigang Meng , Shuhua Yang

In this paper, we propose TransMEF, a transformer-based multi-exposure image fusion framework that uses self-supervised multi-task learning. The framework is based on an encoder-decoder network, which can be trained on large natural image…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Linhao Qu , Shaolei Liu , Manning Wang , Zhijian Song

Self-supervised pre-training, where large corpora of unlabeled data are used to learn representations for downstream fine-tuning, has become a cornerstone of modern machine learning. While a growing body of theoretical work has begun to…

Machine Learning · Computer Science 2026-03-31 Mohammad Tinati , Stephen Tu

Data-driven radio frequency (RF) tomography has demonstrated significant potential for underground target detection, due to the penetrative nature of RF signals through soil. However, it is still challenging to achieve accurate and robust…

Signal Processing · Electrical Eng. & Systems 2025-08-19 Yang Zhao , Tao Wang , Said Elhadi

The ability to form images through hair-thin optical fibres promises to open up new applications from biomedical imaging to industrial inspection. Unfortunately, deployment has been limited because small changes in mechanical deformation…

Task-based functional magnetic resonance imaging (task fMRI) is a non-invasive technique that allows identifying brain regions whose activity changes when individuals are asked to perform a given task. This contributes to the understanding…

The intelligent fault diagnosis of rotating mechanical equipment usually requires a large amount of labeled sample data. However, in practical industrial applications, acquiring enough data is both challenging and expensive in terms of time…

Machine Learning · Computer Science 2025-09-12 Hanyang Wang , Yuxuan Yang , Hongjun Wang , Lihui Wang

The Magnetic Resonance Fingerprinting (MRF) approach aims to estimate multiple MR or physiological parameters simultaneously with a single fast acquisition sequence. Most of the MRF studies proposed so far have used simple MR sequence types…

Neurons and Cognition · Quantitative Biology 2024-07-16 Antoine Barrier , Thomas Coudert , Aurélien Delphin , Benjamin Lemasson , Thomas Christen

The standard approach to modern self-supervised learning is to generate random views through data augmentations and minimise a loss computed from the representations of these views. This inherently encourages invariance to the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 David Torpey , Richard Klein

Motivated by the challenges of analyzing high-dimensional ($p \gg n$) sequencing data from longitudinal microbiome studies, where samples are collected at multiple time points from each subject, we propose supervised functional tensor…

Methodology · Statistics 2024-10-15 Mohammad Samsul Alam , Ana-Maria Staicu , Pixu Shi

The emergence of deep learning has yielded noteworthy advancements in time series forecasting (TSF). Transformer architectures, in particular, have witnessed broad utilization and adoption in TSF tasks. Transformers have proven to be the…

Machine Learning · Computer Science 2023-11-01 Liyilei Su , Xumin Zuo , Rui Li , Xin Wang , Heng Zhao , Bingding Huang

The amount of Magnetic resonance imaging data has grown tremendously recently, creating an urgent need to accelerate data processing, which requires substantial computational resources and time. In this preliminary study, we applied FMRIB…