中文
相关论文

相关论文: Self-Supervised Transformers for fMRI representati…

200 篇论文

Traditional vision-based autonomous driving systems often face difficulties in navigating complex environments when relying solely on single-image inputs. To overcome this limitation, incorporating temporal data such as past image frames or…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Tuong Do , Binh X. Nguyen , Quang D. Tran , Erman Tjiputra , Te-Chuan Chiu , Anh Nguyen

Multivariate time series forecasting is a pivotal task in several domains, including financial planning, medical diagnostics, and climate science. This paper presents the Neural Fourier Transform (NFT) algorithm, which combines…

机器学习 · 计算机科学 2024-05-24 Noam Koren , Kira Radinsky

Hyperspectral images (HSIs) capture rich spectral signatures that reveal vital material properties, offering broad applicability across various domains. However, the scarcity of labeled HSI data limits the full potential of deep learning,…

计算机视觉与模式识别 · 计算机科学 2025-05-07 Shaheer Mohamed , Tharindu Fernando , Sridha Sridharan , Peyman Moghadam , Clinton Fookes

In this paper, we propose self-supervised training for video transformers using unlabeled video data. From a given video, we create local and global spatiotemporal views with varying spatial sizes and frame rates. Our self-supervised…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Kanchana Ranasinghe , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan , Michael Ryoo

Multi-horizon forecasting problems often contain a complex mix of inputs -- including static (i.e. time-invariant) covariates, known future inputs, and other exogenous time series that are only observed historically -- without any prior…

机器学习 · 统计学 2020-09-29 Bryan Lim , Sercan O. Arik , Nicolas Loeff , Tomas Pfister

In recent years, deep neural networks have emerged as a solution for inverse imaging problems. These networks are generally trained using pairs of images: one degraded and the other of high quality, the latter being called 'ground truth'.…

信息检索 · 计算机科学 2025-10-01 Victor Sechaud , Patrice Abry , Laurent Jacques , Julián Tachella

The complex world around us is inherently multimodal and sequential (continuous). Information is scattered across different modalities and requires multiple continuous sensors to be captured. As machine learning leaps towards better…

机器学习 · 计算机科学 2019-11-25 Amir Zadeh , Chengfeng Mao , Kelly Shi , Yiwei Zhang , Paul Pu Liang , Soujanya Poria , Louis-Philippe Morency

Foundational deep learning (DL) models are general models, trained on large, diverse, and unlabelled datasets, typically using self-supervised learning techniques have led to significant advancements especially in natural language…

信号处理 · 电气工程与系统科学 2024-11-18 Ahmed Aboulfotouh , Ashkan Eshaghbeigi , Dimitrios Karslidis , Hatem Abou-Zeid

Supervised fine-tuning (SFT) is a critical step in aligning large language models (LLMs) with human instructions and values, yet many aspects of SFT remain poorly understood. We trained a wide range of base models on a variety of datasets…

计算与语言 · 计算机科学 2025-10-31 Yuto Harada , Yusuke Yamauchi , Yusuke Oda , Yohei Oseki , Yusuke Miyao , Yu Takagi

Transformers have revolutionized deep learning based computer vision with improved performance as well as robustness to natural corruptions and adversarial attacks. Transformers are used predominantly for 2D vision tasks, including image…

计算机视觉与模式识别 · 计算机科学 2023-12-19 Hemang Chawla , Arnav Varma , Elahe Arani , Bahram Zonooz

Functional MRI (fMRI) is crucial for studying brain function and diagnosing neurological disorders. However, existing analysis methods suffer from reproducibility and transferability challenges due to complex preprocessing pipelines and…

Federated Learning (FL) is an emerging paradigm that enables distributed users to collaboratively and iteratively train machine learning models without sharing their private data. Motivated by the effectiveness and robustness of…

机器学习 · 计算机科学 2022-11-16 Jinyu Chen , Wenchao Xu , Song Guo , Junxiao Wang , Jie Zhang , Haozhao Wang

Recent fMRI-to-image approaches mainly focused on associating fMRI signals with specific conditions of pre-trained diffusion models. These approaches, while producing high-quality images, capture only a limited aspect of the complex…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Jingyang Huo , Yikai Wang , Xuelin Qian , Yun Wang , Chong Li , Jianfeng Feng , Yanwei Fu

We propose to simultaneously learn to sample and reconstruct magnetic resonance images (MRI) to maximize the reconstruction quality given a limited sample budget, in a self-supervised setup. Unlike existing deep methods that focus only on…

计算机视觉与模式识别 · 计算机科学 2019-01-16 Kyong Hwan Jin , Michael Unser , Kwang Moo Yi

Decoding visual stimuli from neural responses recorded by functional Magnetic Resonance Imaging (fMRI) presents an intriguing intersection between cognitive neuroscience and machine learning, promising advancements in understanding human…

计算机视觉与模式识别 · 计算机科学 2023-12-29 Jingyuan Sun , Mingxiao Li , Zijiao Chen , Yunhao Zhang , Shaonan Wang , Marie-Francine Moens

Magnetic Resonance Imaging (MRI) field-strength enhancement holds immense value for both clinical diagnostics and advanced research. However, existing methods typically focus on isolated enhancement tasks, such as specific 64mT-to-3T or…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Yiyang Lin , Chenhui Wang , Zhihao Peng , Yixuan Yuan

Self-supervised learning of convolutional neural networks can harness large amounts of cheap unlabeled data to train powerful feature representations. As surrogate task, we jointly address ordering of visual data in the spatial and temporal…

计算机视觉与模式识别 · 计算机科学 2018-07-31 Uta Büchler , Biagio Brattoli , Björn Ommer

Time-of-flight magnetic resonance angiography (TOF-MRA) is one of the most widely used non-contrast MR imaging methods to visualize blood vessels, but due to the 3-D volume acquisition highly accelerated acquisition is necessary.…

图像与视频处理 · 电气工程与系统科学 2020-08-05 Hyungjin Chung , Eunju Cha , Leonard Sunwoo , Jong Chul Ye

Functional Magnetic Resonance Imaging (fMRI) is an advanced neuroimaging method that enables in-depth analysis of brain activity by measuring dynamic changes in the blood oxygenation level-dependent (BOLD) signals. However, the…

Magnetic Resonance Fingerprinting (MRF) enables the simultaneous quantification of multiple properties of biological tissues. It relies on a pseudo-random acquisition and the matching of acquired signal evolutions to a precomputed…