中文
相关论文

相关论文: OmniNeuro: A Multimodal HCI Framework for Explaina…

200 篇论文

Deep neural networks achieve outstanding results in a large variety of tasks, often outperforming human experts. However, a known limitation of current neural architectures is the poor accessibility to understand and interpret the network…

计算机视觉与模式识别 · 计算机科学 2022-03-08 Nicola Garau , Niccolò Bisagno , Zeno Sambugaro , Nicola Conci

Addressing the challenges of fragmented task definitions and the heterogeneity of unstructured data in multimodal parsing, this paper proposes the Omni Parsing framework. This framework establishes a Unified Taxonomy covering documents,…

Deep learning models have gained increasing adoption in medical image analysis. However, these models often produce overconfident predictions, which can compromise clinical accuracy and reliability. Bridging the gap between high-performance…

图像与视频处理 · 电气工程与系统科学 2026-03-24 Jutika Borah , Hidam Kumarjit Singh

In massive multiple-input multiple-output (MIMO) system, channel state information (CSI) is essential for the base station to achieve high performance gain. Recently, deep learning is widely used in CSI compression to fight against the…

信息论 · 计算机科学 2020-11-06 Zhilin Lu , Jintao Wang , Jian Song

Brain-computer interfaces (BCIs) with speech decoding from brain recordings have broad application potential in fields such as clinical rehabilitation and cognitive neuroscience. However, current decoding methods remain limited to…

神经元与认知 · 定量生物学 2025-06-05 Yi Guo , Yihang Dong , Michael Kwok-Po Ng , Shuqiang Wang

Brain-computer interface (BCI) aims to decode motor intent from noninvasive neural signals to enable control of external devices, but practical deployment remains limited by noise and variability in motor imagery (MI)-based…

机器学习 · 计算机科学 2025-11-12 Si-Hyun Kim , Heon-Gyu Kwak , Byoung-Hee Kwon , Seong-Whan Lee

Massive multiple-input multiple-output (MIMO) technology is a key enabler of modern wireless communication systems, which demand accurate downlink channel state information (CSI) for optimal performance. Although deep learning (DL) has…

信号处理 · 电气工程与系统科学 2025-05-14 Ruonan Ren , Jianhua Mo , Meixia Tao

Decoding language from the human brain remains a grand challenge for Brain-Computer Interfaces (BCIs). Current approaches typically rely on unimodal brain representations, neglecting the brain's inherently multimodal processing. Inspired by…

计算与语言 · 计算机科学 2025-08-12 Chunyu Ye , Yunhao Zhang , Jingyuan Sun , Chong Li , Chengqing Zong , Shaonan Wang

The impressive performance of deep learning models, particularly Convolutional Neural Networks (CNNs), is often hindered by their lack of interpretability, rendering them "black boxes." This opacity raises concerns in critical areas like…

人工智能 · 计算机科学 2024-10-23 John M. Willis

Translating neural networks from theory to clinical practice has unique challenges, specifically in the field of neuroimaging. In this paper, we present DeepNeuro, a deep learning framework that is best-suited to putting deep learning…

计算机视觉与模式识别 · 计算机科学 2018-08-15 Andrew Beers , James Brown , Ken Chang , Katharina Hoebel , Elizabeth Gerstner , Bruce Rosen , Jayashree Kalpathy-Cramer

Multimodal brain decoding aims to reconstruct semantic information that is consistent with visual stimuli from brain activity signals such as fMRI, and then generate readable natural language descriptions. However, multimodal brain decoding…

机器学习 · 计算机科学 2026-04-21 Xuanyu Hu

The opaque nature of deep learning models remains a significant barrier to their clinical adoption in medical imaging. This paper presents a multimodal explainability framework that bridges the gap between convolutional neural network (CNN)…

计算机视觉与模式识别 · 计算机科学 2026-05-08 Paul Valery Nguezet , Elie Tagne Fute , Yusuf Brima , Benoit Martin Azanguezet , Marcellin Atemkeng

Image denoising is a classic restoration problem. Yet, current deep learning methods are subject to the problems of generalization and interpretability. To mitigate these problems, in this project, we present a framework that is capable of…

图像与视频处理 · 电气工程与系统科学 2021-06-18 Haley Owsianko , Florian Cassayre , Qiyuan Liang

Recent advances in omni-modal large language models have enabled remarkable progress in joint vision-audio understanding. However, prevailing architectures rely on modality-specific encoders with a \emph{video-coarse, audio-dense} design --…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Detao Bai , Shimin Yao , Weixuan Chen , Chengen Lai , Yuanming Li , Zhiheng Ma , Xihan Wei

EEG decoding systems based on deep neural networks have been widely used in decision making of brain computer interfaces (BCI). Their predictions, however, can be unreliable given the significant variance and noise in EEG signals. Previous…

信号处理 · 电气工程与系统科学 2022-10-04 Tiehang Duan , Zhenyi Wang , Sheng Liu , Sargur N. Srihari , Hui Yang

Noise in low-dose computed tomography (LDCT) can obscure important diagnostic details. While deep learning offers powerful denoising, supervised methods require impractical paired data, and self-supervised alternatives often use opaque,…

图像与视频处理 · 电气工程与系统科学 2026-02-19 Yipeng Sun , Linda-Sophie Schneider , Siyuan Mei , Jinhua Wang , Ge Hu , Mingxuan Gu , Chengze Ye , Fabian Wagner , Lan Song , Siming Bayer , Andreas Maier

This study introduces a pioneering approach in brain-computer interface (BCI) technology, featuring our novel concept of complex visual imagery for non-invasive electroencephalography (EEG)-based communication. Complex visual imagery, as…

人机交互 · 计算机科学 2025-11-20 Byoung-Hee Kwon

Neural networks have greatly boosted performance in computer vision by learning powerful representations of input data. The drawback of end-to-end training for maximal overall performance are black-box models whose hidden representations…

计算机视觉与模式识别 · 计算机科学 2020-04-29 Patrick Esser , Robin Rombach , Björn Ommer

Accurate and interpretable classification of brain tumors from magnetic resonance imaging (MRI) is critical for effective diagnosis and treatment planning. This study presents an ensemble-based deep learning framework that combines…

图像与视频处理 · 电气工程与系统科学 2025-08-12 Melika Filvantorkaman , Mohsen Piri , Maral Filvan Torkaman , Ashkan Zabihi , Hamidreza Moradi

Speech-related Brain Computer Interfaces (BCI) aim primarily at finding an alternative vocal communication pathway for people with speaking disabilities. As a step towards full decoding of imagined speech from active thoughts, we present a…

机器学习 · 计算机科学 2019-04-10 Pramit Saha , Muhammad Abdul-Mageed , Sidney Fels