中文
相关论文

相关论文: An Interpretable Transformer-Based Foundation Mode…

200 篇论文

In intensive care units (ICUs), critically ill patients are monitored with electroencephalograms (EEGs) to prevent serious brain injury. The number of patients who can be monitored is constrained by the availability of trained physicians to…

Functional near-infrared spectroscopy (fNIRS) is a non-invasive optical technique that measures brain activity by estimating blood oxygenation using near-infrared light. Traditionally, PsychoPy is used in many studies to send task-specific…

人机交互 · 计算机科学 2024-11-19 Shayla Sharmin , Md Fahim Abrar , Roghayeh Leila Barmaki

EEG foundation models (EEG-FMs) have been evaluated predominantly on clean, in-distribution accuracy, leaving their robustness, interpretability and representational quality largely unexamined. This study addresses these gaps by…

机器学习 · 计算机科学 2026-05-19 Urban Širca , Maryam Alimardani , Stefanos Zafeiriou , Konstantinos Barmpas

The portrait matting task aims to extract an alpha matte with complete semantics and finely-detailed contours. In comparison to CNN-based approaches, transformers with self-attention module have a better capacity to capture long-range…

计算机视觉与模式识别 · 计算机科学 2023-12-04 Zitao Wang , Qiguang Miao , Peipei Zhao , Yue Xi

Recent applications of deep convolutional neural networks in medical imaging raise concerns about their interpretability. While most explainable deep learning applications use post hoc methods (such as GradCAM) to generate feature…

计算机视觉与模式识别 · 计算机科学 2023-04-17 Yuanyuan Wei , Roger Tam , Xiaoying Tang

While state-of-the-art models that rely upon massively multilingual pretrained encoders achieve sample efficiency in downstream applications, they still require abundant amounts of unlabelled text. Nevertheless, most of the world's…

计算与语言 · 计算机科学 2024-02-16 Yaoyiran Li , Edoardo M. Ponti , Ivan Vulić , Anna Korhonen

Semantic segmentation of brain tumors is a fundamental medical image analysis task involving multiple MRI imaging modalities that can assist clinicians in diagnosing the patient and successively studying the progression of the malignant…

图像与视频处理 · 电气工程与系统科学 2022-01-05 Ali Hatamizadeh , Vishwesh Nath , Yucheng Tang , Dong Yang , Holger Roth , Daguang Xu

Deep-learning models have enabled performance leaps in analysis of high-dimensional functional MRI (fMRI) data. Yet, many previous methods are suboptimally sensitive for contextual representations across diverse time scales. Here, we…

信号处理 · 电气工程与系统科学 2023-02-21 Hasan Atakan Bedel , Irmak Şıvgın , Onat Dalmaz , Salman Ul Hassan Dar , Tolga Çukur

Neurons in auto-regressive language models like GPT-2 can be interpreted by analyzing their activation patterns. Recent studies have shown that techniques such as dictionary learning, a form of post-hoc sparse coding, enhance this…

计算与语言 · 计算机科学 2025-02-28 Hao Bai , Yi Ma

The shift to electronic medical records (EMRs) has engendered research into machine learning and natural language technologies to analyze patient records, and to predict from these clinical outcomes of interest. Two observations motivate…

计算与语言 · 计算机科学 2019-04-09 Sarthak Jain , Ramin Mohammadi , Byron C. Wallace

Human perception plays a vital role in forming beliefs and understanding reality. A deeper understanding of brain functionality will lead to the development of novel deep neural networks. In this work, we introduce a novel framework named…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Xuan-Bac Nguyen , Xin Li , Pawan Sinha , Samee U. Khan , Khoa Luu

Brain imaging plays a crucial role in the diagnosis and treatment of various neurological disorders, providing valuable insights into the structure and function of the brain. Techniques such as magnetic resonance imaging (MRI) and computed…

图像与视频处理 · 电气工程与系统科学 2025-01-23 Fatima Haimour , Rizik Al-Sayyed , Waleed Mahafza , Omar S. Al-Kadi

Unpaired medical image synthesis aims to provide complementary information for an accurate clinical diagnostics, and address challenges in obtaining aligned multi-modal medical scans. Transformer-based models excel in imaging translation…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Vu Minh Hieu Phan , Yutong Xie , Bowen Zhang , Yuankai Qi , Zhibin Liao , Antonios Perperidis , Son Lam Phung , Johan W. Verjans , Minh-Son To

Transformer-based pre-trained language models have demonstrated superior performance on various natural language processing tasks. However, it remains unclear how the skills required to handle these tasks distribute among model parameters.…

计算与语言 · 计算机科学 2022-11-15 Xiaozhi Wang , Kaiyue Wen , Zhengyan Zhang , Lei Hou , Zhiyuan Liu , Juanzi Li

In the current paper, we introduce a parametric data-driven model for functional near-infrared spectroscopy that decomposes a signal into a series of independent, rescaled, time-shifted, hemodynamic basis functions. Each decomposed waveform…

信号处理 · 电气工程与系统科学 2020-01-24 Marco A. Pinto-Orellana , Diego C. Nascimento , Peyman Mirtaheri , Rune Jonassen , Anis Yazidi , Hugo L. Hammer

Mild Traumatic Brain Injury (mTBI) is a significant public health challenge due to its high prevalence and potential for long-term health effects. Despite Computed Tomography (CT) being the standard diagnostic tool for mTBI, it often yields…

图像与视频处理 · 电气工程与系统科学 2024-04-09 Hanem Ellethy , Viktor Vegh , Shekhar S. Chandra

The incorporation of neuroimaging techniques such as electroenchephalography (EEG) and functional near-infrared spectroscopy (fNIRS) has provided new opportunities for the analysis of dynamic brain processes involved in cognitive and motor…

神经元与认知 · 定量生物学 2026-03-25 Zaineb Ajra , Grégoire Vergotte , Stéphane Perrey , Lilian Evra , Simon Pla , Gérard Dray , Jacky Montmain , Binbin Xu

Foundation models pre-trained on large-scale datasets demonstrate strong transfer learning capabilities; however, their adaptation to complex multi-label diagnostic tasks-such as comprehensive head CT finding detection-remains understudied.…

Brain-Computer Interfaces (BCIs) based on P300 event-related potentials offer promising applications in health, education, and assistive technologies. However, challenges related to inter- and intra-subject variability and the…

机器学习 · 计算机科学 2026-05-12 Christian Oliva , Vinicio Changoluisa , Francisco B Rodríguez , Luis F Lago-Fernández

Transformers are state-of-the-art networks for most sequence processing tasks. However, the self-attention mechanism often used in Transformers requires large time windows for each computation step and thus makes them less suitable for…

神经与进化计算 · 计算机科学 2023-03-22 Nathan Leroux , Jan Finkbeiner , Emre Neftci