English
Related papers

Related papers: Revealing Vision-Language Integration in the Brain…

200 papers

Deep learning with convolutional neural networks (ConvNets) have dramatically improved learning capabilities of computer vision applications just through considering raw data without any prior feature extraction. Nowadays, there is rising…

Signal Processing · Electrical Eng. & Systems 2019-07-15 Apdullah Yayık , Yakup Kutlu , Gökhan Altan

Deep convolutional neural networks (DCNNs) and the ventral visual pathway share vast architectural and functional similarities in visual challenges such as object recognition. Recent insights have demonstrated that both hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Leonard E. van Dyck , Roland Kwitt , Sebastian J. Denzler , Walter R. Gruber

Spiking neural networks (SNNs) have captured apparent interest over the recent years, stemming from neuroscience and reaching the field of artificial intelligence. However, due to their nature SNNs remain far behind in achieving the…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Katerina Maria Oikonomou , Vasiliki Balaska , Konstantinos A. Tsintotas , Christos N. Mavridis , Ioannis Kansizoglou , Antonios Gasteratos

We propose a unified deep meta-learning framework for accelerated magnetic resonance imaging (MRI) that jointly addresses multi-coil reconstruction and cross-modality synthesis. Motivated by the limitations of conventional methods in…

Optimization and Control · Mathematics 2026-03-10 Merham Fouladvand , Peuroly Batra

Predicting brain activity in response to naturalistic, multimodal stimuli is a key challenge in computational neuroscience. While encoding models are becoming more powerful, their ability to generalize to truly novel contexts remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Hamid Abdollahi , Amir Hossein Mansouri Majoumerd , Amir Hossein Bagheri Baboukani , Amir Abolfazl Suratgar , Mohammad Bagher Menhaj

Spiking neural networks (SNNs) are the third generation of neural networks that are biologically inspired to process data in a fashion that emulates the exchange of signals in the brain. Within the Computer Vision community SNNs have…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-04 William Bjorndahl , Jack Easton , Austin Modoff , Eric C. Larson , Joseph Camp , Prasanna Rangarajan

Neuroimaging data analysis often involves \emph{a-priori} selection of data features to study the underlying neural activity. Since this could lead to sub-optimal feature selection and thereby prevent the detection of subtle patterns in…

Neurons and Cognition · Quantitative Biology 2018-07-03 Arna Ghosh , Fabien dal Maso , Marc Roig , Georgios D Mitsis , Marie-Hélène Boudrias

Quality assessment of prenatal ultrasonography is essential for the screening of fetal central nervous system (CNS) anomalies. The interpretation of fetal brain structures is highly subjective, expertise-driven, and requires years of…

Multimodal recommendation enhances accuracy by leveraging visual and textual signals, and its success largely depends on learning high-quality cross-modal representations. Recent advances in Large Vision-Language Models (LVLMs) offer…

Information Retrieval · Computer Science 2026-04-28 Zhongtao Rao , Peilin Zhou , Dading Chong , Zhiwei Chen , Shoujin Wang , Nan Tang

Accurate beam prediction is essential for mitigating signalling overhead and latency in integrated sensing and communication-enabled massive multi-input multi-output systems. With the aid of multimodal learning, the prediction accuracy can…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Zijian Zheng , Wenqiang Yi , Hyundong Shin , Arumugam Nallanathan

Vision-language models have become increasingly powerful for tasks that require an understanding of both visual and linguistic elements, bridging the gap between these modalities. In the context of multimodal clinical AI, there is a growing…

Computation and Language · Computer Science 2024-04-30 Masoud Monajatipoor , Zi-Yi Dou , Aichi Chien , Nanyun Peng , Kai-Wei Chang

How (dis)similar are the learning trajectories of vision-language models and children? Recent modeling work has attempted to understand the gap between models' and humans' data efficiency by constructing models trained on less data,…

Computation and Language · Computer Science 2024-12-10 Alvin Wei Ming Tan , Sunny Yu , Bria Long , Wanjing Anya Ma , Tonya Murray , Rebecca D. Silverman , Jason D. Yeatman , Michael C. Frank

Rapid development of big data and high-performance computing have encouraged explosive studies of deep learning in geoscience. However, most studies only take single-type data as input, frittering away invaluable multisource, multi-scale…

Machine Learning · Computer Science 2020-05-19 Zhenyu Yuan , Yuxin Jiang , Jingjing Li , Handong Huang

The incentive for using Evolutionary Algorithms (EAs) for the automated optimization and training of deep neural networks (DNNs), a process referred to as neuroevolution, has gained momentum in recent years. The configuration and training…

Neural and Evolutionary Computing · Computer Science 2022-05-09 Fergal Stapleton , Edgar Galván , Ganesh Sistu , Senthil Yogamani

Aggregating multi-site brain MRI data can enhance deep learning model training, but also introduces non-biological heterogeneity caused by site-specific variations (e.g., differences in scanner vendors, acquisition parameters, and imaging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Mengqi Wu , Yongheng Sun , Qianqian Wang , Pew-Thian Yap , Mingxia Liu

Electroencephalography (EEG) is a neuroimaging technique that records brain neural activity with high temporal resolution. Unlike other methods, EEG does not require prohibitively expensive equipment and can be easily set up using…

Human-Computer Interaction · Computer Science 2024-10-01 Arash Akbarinia

We capitalize on large amounts of readily-available, synchronous data to learn a deep discriminative representations shared across three major natural modalities: vision, sound and language. By leveraging over a year of sound from video and…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Yusuf Aytar , Carl Vondrick , Antonio Torralba

Brain signals could be used to control devices to assist individuals with disabilities. Signals such as electroencephalograms are complicated and hard to interpret. A set of signals are collected and should be classified to identify the…

Signal Processing · Electrical Eng. & Systems 2021-05-25 Ghazale Ghorbanzade , Zahra Nabizadeh-ShahreBabak , Shadrokh Samavi , Nader Karimi , Ali Emami , Pejman Khadivi

Extracting temporal and representation features efficiently plays a pivotal role in understanding visual sequence information. To deal with this, we propose a new recurrent neural framework that can be stacked deep effectively. There are…

Computer Vision and Pattern Recognition · Computer Science 2019-10-28 Bo Pang , Kaiwen Zha , Hanwen Cao , Chen Shi , Cewu Lu

Accurate assessment of bimanual motor skills is essential across various professions, yet, traditional methods often rely on subjective assessments or focus solely on motor actions, overlooking the integral role of cognitive processes. This…

Artificial Intelligence · Computer Science 2024-04-18 Erim Yanik , Xavier Intes , Suvranu De