中文
相关论文

相关论文: Latent Representation Learning for Multimodal Brai…

200 篇论文

Resting-state functional magnetic resonance imaging (rs-fMRI) is a noninvasive technique pivotal for understanding human neural mechanisms of intricate cognitive processes. Most rs-fMRI studies compute a single static functional…

The classification of sleep stages is a pivotal aspect of diagnosing sleep disorders and evaluating sleep quality. However, the conventional manual scoring process, conducted by clinicians, is time-consuming and prone to human bias. Recent…

人机交互 · 计算机科学 2024-05-14 Cheol-Hui Lee , Hakseung Kim , Hyun-jee Han , Min-Kyung Jung , Byung C. Yoon , Dong-Joo Kim

Handling lengthy context is crucial for enhancing the recognition and understanding capabilities of multimodal large language models (MLLMs) in applications such as processing high-resolution images or high frame rate videos. The rise in…

计算机视觉与模式识别 · 计算机科学 2024-11-14 Jianing Zhou , Han Li , Shuai Zhang , Ning Xie , Ruijie Wang , Xiaohan Nie , Sheng Liu , Lingyun Wang

Selective state space models (SSMs), such as Mamba, highly excel at capturing long-range dependencies in 1D sequential data, while their applications to 2D vision tasks still face challenges. Current visual SSMs often convert images into 1D…

计算机视觉与模式识别 · 计算机科学 2025-02-27 Chaodong Xiao , Minghan Li , Zhengqiang Zhang , Deyu Meng , Lei Zhang

Understanding the neural implementation of complex human behaviors is one of the major goals in neuroscience. To this end, it is crucial to find a true representation of the neural data, which is challenging due to the high complexity of…

机器学习 · 计算机科学 2023-08-15 Cheol Jun Cho , Edward F. Chang , Gopala K. Anumanchipalli

In the era of large-scale pre-trained models, effectively adapting general knowledge to specific affective computing tasks remains a challenge, particularly regarding computational efficiency and multimodal heterogeneity. While…

人工智能 · 计算机科学 2026-03-20 Yan Li , Yifei Xing , Xiangyuan Lan , Xin Li , Haifeng Chen , Dongmei Jiang

Self-supervised learning techniques are celebrating immense success in natural language processing (NLP) by enabling models to learn from broad language data at unprecedented scales. Here, we aim to leverage the success of these techniques…

神经元与认知 · 定量生物学 2023-01-18 Armin W. Thomas , Christopher Ré , Russell A. Poldrack

Multivariate time series forecasting is fundamental to numerous domains such as energy, finance, and environmental monitoring, where complex temporal dependencies and cross-variable interactions pose enduring challenges. Existing…

机器学习 · 计算机科学 2026-05-15 Xingsheng Chen , Xianpei Mu , Deyu Yi , Yilin Yuan , Xingwei He , Bo Gao , Regina Zhang , Pietro Lio , Siu-Ming Yiu

Deep learning methods, especially Convolutional Neural Networks (CNN) and Vision Transformer (ViT), are frequently employed to perform semantic segmentation of high-resolution remotely sensed images. However, CNNs are constrained by their…

计算机视觉与模式识别 · 计算机科学 2024-10-29 Qinfeng Zhu , Yuan Fang , Yuanzhi Cai , Cheng Chen , Lei Fan

Cognitive neuroscience is enjoying rapid increase in extensive public brain-imaging datasets. It opens the door to large-scale statistical models. Finding a unified perspective for all available data calls for scalable and automated…

机器学习 · 统计学 2019-05-16 Arthur Mensch , Julien Mairal , Danilo Bzdok , Bertrand Thirion , Gaël Varoquaux

Learned Image Compression (LIC) has explored various architectures, such as Convolutional Neural Networks (CNNs) and transformers, in modeling image content distributions in order to achieve compression effectiveness. However, achieving…

图像与视频处理 · 电气工程与系统科学 2025-02-10 Zhuojie Wu , Heming Du , Shuyun Wang , Ming Lu , Haiyang Sun , Yandong Guo , Xin Yu

Understanding how the brain represents visual information is a fundamental challenge in neuroscience and artificial intelligence. While AI-driven decoding of neural data has provided insights into the human visual system, integrating…

神经与进化计算 · 计算机科学 2025-10-07 Dongyang Li , Haoyang Qin , Mingyang Wu , Chen Wei , Quanying Liu

Transformers and Mamba, initially invented for natural language processing, have inspired backbone architectures for visual recognition. Recent studies integrated Local Attention Transformers with Mamba to capture both local details and…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Meng Lou , Yunxiang Fu , Yizhou Yu

The connection between brain activity and corresponding visual stimuli is crucial in comprehending the human brain. While deep generative models have exhibited advancement in recovering brain recordings by generating images conditioned on…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Xuelin Qian , Yikai Wang , Yanwei Fu , Xinwei Sun , Xiangyang Xue , Jianfeng Feng

Understanding the inter-relations and interactions between tasks is crucial for multi-task dense prediction. Existing methods predominantly utilize convolutional layers and attention mechanisms to explore task-level interactions. In this…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Xinzhuo Yu , Yunzhi Zhuge , Sitong Gong , Lu Zhang , Pingping Zhang , Huchuan Lu

Recent advances in deep learning have made it possible to predict phenotypic measures directly from functional magnetic resonance imaging (fMRI) brain volumes, sparking significant interest in the neuroimaging community. However, existing…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Arunkumar Kannan , Martin A. Lindquist , Brian Caffo

Segmentation is the assigning of a semantic class to every pixel in an image and is a prerequisite for various statistical analysis tasks in materials science, like phase quantification, physics simulations or morphological…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Ronan Docherty , Isaac Squires , Antonis Vamvakeros , Samuel J. Cooper

High-dimensional imaging of neural activity, such as widefield calcium and functional ultrasound imaging, provide a rich source of information for understanding the relationship between brain activity and behavior. Accurately modeling…

神经元与认知 · 定量生物学 2025-09-24 Mohammad Hosseini , Maryam M. Shanechi

State Space Models (SSMs) have recently enjoyed a rise to prominence in the field of deep learning for sequence modeling, especially as an alternative to Transformers. Their success stems from avoiding two well-known drawbacks of…

机器学习 · 计算机科学 2025-01-22 Stefano Rando , Luca Romani , Matteo Migliarini , Luca Franco , Denis Gudovskiy , Fabio Galasso

Depression is a prevalent mental health disorder that severely impairs daily functioning and quality of life. While recent deep learning approaches for depression detection have shown promise, most rely on limited feature types, overlook…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Bowen Zhou , Marc-André Fiedler , Ayoub Al-Hamadi