English
Related papers

Related papers: Encoding the Local Connectivity Patterns of fMRI f…

200 papers

Deep learning models based on resting-state functional magnetic resonance imaging (rs-fMRI) have been widely used to diagnose brain diseases, particularly autism spectrum disorder (ASD). Existing studies have leveraged the functional…

Machine Learning · Computer Science 2023-10-06 Wonsik Jung , Eunjin Jeon , Eunsong Kang , Heung-Il Suk

Functional MRI (fMRI) is widely used to examine brain functionality by detecting alteration in oxygenated blood flow that arises with brain activity. In this study, complexity specific image categorization across different visual datasets…

Image and Video Processing · Electrical Eng. & Systems 2023-09-08 Vamshi K. Kancharala , Debanjali Bhattacharya , Neelam Sinha

We consider the problem of encoding pairwise correlations between coupled dynamical systems in a low-dimensional latent space based on few distinct observations. We used variational autoencoders (VAE) to embed temporal correlations between…

There have been several attempts to use deep learning based on brain fMRI signals to classify cognitive impairment diseases. However, deep learning is a hidden black box model that makes it difficult to interpret the process of…

Machine Learning · Computer Science 2024-11-20 Jeong-Jae Kim , Yeseul Jeon , SuMin Yu , Junggu Choi , Sanghoon Han

Discovering reliable and informative relationships among brain regions from functional magnetic resonance imaging (fMRI) signals is essential in phenotypic predictions. Most of the current methods fail to accurately characterize those…

Neurons and Cognition · Quantitative Biology 2024-06-11 Weikang Qiu , Huangrui Chu , Selena Wang , Haolan Zuo , Xiaoxiao Li , Yize Zhao , Rex Ying

In daily life, we encounter diverse external stimuli, such as images, sounds, and videos. As research in multimodal stimuli and neuroscience advances, fMRI-based brain decoding has become a key tool for understanding brain perception and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Pengyu Liu , Guohua Dong , Dan Guo , Kun Li , Fengling Li , Xun Yang , Meng Wang , Xiaomin Ying

Introducing variability while maintaining coherence is a core task in learning to generate utterances in conversation. Standard neural encoder-decoder models and their extensions using conditional variational autoencoder often result in…

Computation and Language · Computer Science 2018-10-23 Hung Le , Truyen Tran , Thin Nguyen , Svetha Venkatesh

Embeddings in AI convert symbolic structures into fixed-dimensional vectors, effectively fusing multiple signals. However, the nature of this fusion in real-world data is often unclear. To address this, we introduce two methods: (1)…

Machine Learning · Computer Science 2023-11-21 Zhijin Guo , Zhaozhen Xu , Martha Lewis , Nello Cristianini

Brain encoding models not only serve to decipher how visual stimuli are transformed into neural responses, but also represent a critical step toward visual prostheses that restore vision for patients with severe vision disorders. Brain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Ganxi Xu , Zhao-Rong Lai , Yuting Tang , Yonghao Song , Shuyan Zhou , Guoxu Zhou , Boyu Wang , Jian Zhu , Jinyi Long

Vision-language models encode images and text in a joint space, minimizing the distance between corresponding image and text pairs. How are language and images organized in this joint space, and how do the models encode meaning and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Isabel Papadimitriou , Huangyuan Su , Thomas Fel , Sham Kakade , Stephanie Gil

Neural encoding and decoding, which aim to characterize the relationship between stimuli and brain activities, have emerged as an important area in cognitive neuroscience. Traditional encoding models, which focus on feature extraction and…

Neurons and Cognition · Quantitative Biology 2019-08-26 Hao Wu , Ziyu Zhu , Jiayi Wang , Nanning Zheng , Badong Chen

Brain disorders are an umbrella term for a group of neurological and psychiatric conditions that have a major effect on thinking, feeling, and acting. These conditions encompass a wide range of conditions. The illnesses in question pose…

Neurons and Cognition · Quantitative Biology 2025-11-11 Aniruddha Saha , Soujanya Hazra , Sanjay Ghosh

For better clustering performance, appropriate representations are critical. Although many neural network-based metric learning methods have been proposed, they do not directly train neural networks to improve clustering performance. We…

Machine Learning · Statistics 2021-03-02 Tomoharu Iwata

In this article, we study association between the structural connectome and cognitive profiles using a multi-response nonparametric regression model.The cognitive profiles are measured in terms of seven age-adjusted cognitive test scores.…

Methodology · Statistics 2022-12-06 Arkaprava Roy

Voxel-based lesion-symptom mapping (VLSM) is an important method for basic and translational human neuroscience research. VLSM leverages modern neuroimaging analysis techniques to build on the classic approach of examining the relationship…

Functional magnetic resonance imaging (fMRI) is a neuroimaging modality that captures the blood oxygen level in a subject's brain while the subject either rests or performs a variety of functional tasks under different conditions. Given…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Sam Nguyen , Brenda Ng , Alan D. Kaplan , Priyadip Ray

Vision-Language Models (VLMs) have demonstrated remarkable capabilities in cross-modal understanding and generation by integrating visual and textual information. While instruction tuning and parameter-efficient fine-tuning methods have…

Machine Learning · Computer Science 2025-06-12 Weiying Zheng , Ziyue Lin , Pengxin Guo , Yuyin Zhou , Feifei Wang , Liangqiong Qu

Deep learning methods for classifying medical images have demonstrated impressive accuracy in a wide range of tasks but often these models are hard to interpret, limiting their applicability in clinical practice. In this work we introduce a…

Image and Video Processing · Electrical Eng. & Systems 2019-08-13 James R. Clough , Ilkay Oksuz , Esther Puyol-Anton , Bram Ruijsink , Andrew P. King , Julia A. Schnabel

Recently, visual encoding based on functional magnetic resonance imaging (fMRI) have realized many achievements with the rapid development of deep network computation. Visual encoding model is aimed at predicting brain activity in response…

Neurons and Cognition · Quantitative Biology 2019-07-30 Kai Qiao , Chi Zhang , Jian Chen , Linyuan Wang , Li Tong , Bin Yan

Multi-label image recognition is a fundamental task in computer vision. Recently, vision-language models have made notable advancements in this area. However, previous methods often failed to effectively leverage the rich knowledge within…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Hao Tan , Zichang Tan , Jun Li , Jun Wan , Zhen Lei