中文
相关论文

相关论文: Revealing Vision-Language Integration in the Brain…

200 篇论文

Deep learning with convolutional neural networks (ConvNets) have dramatically improved learning capabilities of computer vision applications just through considering raw data without any prior feature extraction. Nowadays, there is rising…

信号处理 · 电气工程与系统科学 2019-07-15 Apdullah Yayık , Yakup Kutlu , Gökhan Altan

Deep convolutional neural networks (DCNNs) and the ventral visual pathway share vast architectural and functional similarities in visual challenges such as object recognition. Recent insights have demonstrated that both hierarchical…

计算机视觉与模式识别 · 计算机科学 2021-09-22 Leonard E. van Dyck , Roland Kwitt , Sebastian J. Denzler , Walter R. Gruber

Spiking neural networks (SNNs) have captured apparent interest over the recent years, stemming from neuroscience and reaching the field of artificial intelligence. However, due to their nature SNNs remain far behind in achieving the…

We propose a unified deep meta-learning framework for accelerated magnetic resonance imaging (MRI) that jointly addresses multi-coil reconstruction and cross-modality synthesis. Motivated by the limitations of conventional methods in…

最优化与控制 · 数学 2026-03-10 Merham Fouladvand , Peuroly Batra

Predicting brain activity in response to naturalistic, multimodal stimuli is a key challenge in computational neuroscience. While encoding models are becoming more powerful, their ability to generalize to truly novel contexts remains a…

Spiking neural networks (SNNs) are the third generation of neural networks that are biologically inspired to process data in a fashion that emulates the exchange of signals in the brain. Within the Computer Vision community SNNs have…

音频与语音处理 · 电气工程与系统科学 2024-09-04 William Bjorndahl , Jack Easton , Austin Modoff , Eric C. Larson , Joseph Camp , Prasanna Rangarajan

Neuroimaging data analysis often involves \emph{a-priori} selection of data features to study the underlying neural activity. Since this could lead to sub-optimal feature selection and thereby prevent the detection of subtle patterns in…

神经元与认知 · 定量生物学 2018-07-03 Arna Ghosh , Fabien dal Maso , Marc Roig , Georgios D Mitsis , Marie-Hélène Boudrias

Quality assessment of prenatal ultrasonography is essential for the screening of fetal central nervous system (CNS) anomalies. The interpretation of fetal brain structures is highly subjective, expertise-driven, and requires years of…

Multimodal recommendation enhances accuracy by leveraging visual and textual signals, and its success largely depends on learning high-quality cross-modal representations. Recent advances in Large Vision-Language Models (LVLMs) offer…

信息检索 · 计算机科学 2026-04-28 Zhongtao Rao , Peilin Zhou , Dading Chong , Zhiwei Chen , Shoujin Wang , Nan Tang

Accurate beam prediction is essential for mitigating signalling overhead and latency in integrated sensing and communication-enabled massive multi-input multi-output systems. With the aid of multimodal learning, the prediction accuracy can…

信号处理 · 电气工程与系统科学 2026-05-15 Zijian Zheng , Wenqiang Yi , Hyundong Shin , Arumugam Nallanathan

Vision-language models have become increasingly powerful for tasks that require an understanding of both visual and linguistic elements, bridging the gap between these modalities. In the context of multimodal clinical AI, there is a growing…

计算与语言 · 计算机科学 2024-04-30 Masoud Monajatipoor , Zi-Yi Dou , Aichi Chien , Nanyun Peng , Kai-Wei Chang

How (dis)similar are the learning trajectories of vision-language models and children? Recent modeling work has attempted to understand the gap between models' and humans' data efficiency by constructing models trained on less data,…

Rapid development of big data and high-performance computing have encouraged explosive studies of deep learning in geoscience. However, most studies only take single-type data as input, frittering away invaluable multisource, multi-scale…

机器学习 · 计算机科学 2020-05-19 Zhenyu Yuan , Yuxin Jiang , Jingjing Li , Handong Huang

The incentive for using Evolutionary Algorithms (EAs) for the automated optimization and training of deep neural networks (DNNs), a process referred to as neuroevolution, has gained momentum in recent years. The configuration and training…

神经与进化计算 · 计算机科学 2022-05-09 Fergal Stapleton , Edgar Galván , Ganesh Sistu , Senthil Yogamani

Aggregating multi-site brain MRI data can enhance deep learning model training, but also introduces non-biological heterogeneity caused by site-specific variations (e.g., differences in scanner vendors, acquisition parameters, and imaging…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Mengqi Wu , Yongheng Sun , Qianqian Wang , Pew-Thian Yap , Mingxia Liu

Electroencephalography (EEG) is a neuroimaging technique that records brain neural activity with high temporal resolution. Unlike other methods, EEG does not require prohibitively expensive equipment and can be easily set up using…

人机交互 · 计算机科学 2024-10-01 Arash Akbarinia

We capitalize on large amounts of readily-available, synchronous data to learn a deep discriminative representations shared across three major natural modalities: vision, sound and language. By leveraging over a year of sound from video and…

计算机视觉与模式识别 · 计算机科学 2017-06-06 Yusuf Aytar , Carl Vondrick , Antonio Torralba

Brain signals could be used to control devices to assist individuals with disabilities. Signals such as electroencephalograms are complicated and hard to interpret. A set of signals are collected and should be classified to identify the…

信号处理 · 电气工程与系统科学 2021-05-25 Ghazale Ghorbanzade , Zahra Nabizadeh-ShahreBabak , Shadrokh Samavi , Nader Karimi , Ali Emami , Pejman Khadivi

Extracting temporal and representation features efficiently plays a pivotal role in understanding visual sequence information. To deal with this, we propose a new recurrent neural framework that can be stacked deep effectively. There are…

计算机视觉与模式识别 · 计算机科学 2019-10-28 Bo Pang , Kaiwen Zha , Hanwen Cao , Chen Shi , Cewu Lu

Accurate assessment of bimanual motor skills is essential across various professions, yet, traditional methods often rely on subjective assessments or focus solely on motor actions, overlooking the integral role of cognitive processes. This…

人工智能 · 计算机科学 2024-04-18 Erim Yanik , Xavier Intes , Suvranu De