English
Related papers

Related papers: Contextual Minimum-Norm Estimates (CMNE): A Deep L…

200 papers

Designing deep neural networks is an art that often involves an expensive search over candidate architectures. To overcome this for recurrent neural nets (RNNs), we establish a connection between the hidden state dynamics in an RNN and…

Machine Learning · Computer Science 2021-12-14 Tan M. Nguyen , Richard G. Baraniuk , Andrea L. Bertozzi , Stanley J. Osher , Bao Wang

The recently discovered Neural Collapse (NC) phenomenon occurs pervasively in today's deep net training paradigm of driving cross-entropy (CE) loss towards zero. During NC, last-layer features collapse to their class-means, both classifiers…

Machine Learning · Computer Science 2022-05-11 X. Y. Han , Vardan Papyan , David L. Donoho

Environmental audio tagging is a newly proposed task to predict the presence or absence of a specific audio event in a chunk. Deep neural network (DNN) based methods have been successfully adopted for predicting the audio tags in the…

Sound · Computer Science 2017-02-28 Yong Xu , Qiuqiang Kong , Qiang Huang , Wenwu Wang , Mark D. Plumbley

Sleep staging based on electroencephalogram (EEG) plays an important role in the clinical diagnosis and treatment of sleep disorders. In order to emancipate human experts from heavy labeling work, deep neural networks have been employed to…

Machine Learning · Computer Science 2021-01-08 Xue Jiang

Accurately assessing mental workload is crucial in cognitive neuroscience, human-computer interaction, and real-time monitoring, as cognitive load fluctuations affect performance and decision-making. While Electroencephalography (EEG) based…

Neural and Evolutionary Computing · Computer Science 2025-09-29 Jiahui An , Sara Irina Fabrikant , Giacomo Indiveri , Elisa Donati

Electromagnetic source imaging (ESI) requires solving a highly ill-posed inverse problem. To seek a unique solution, traditional ESI methods impose various forms of priors that may not accurately reflect the actual source properties, which…

Image and Video Processing · Electrical Eng. & Systems 2022-07-14 Gexin Huang , Jiawen Liang , Ke Liu , Chang Cai , ZhengHui Gu , Feifei Qi , Yuan Qing Li , Zhu Liang Yu , Wei Wu

We point out a limitation of the mutual information neural estimation (MINE) where the network fails to learn at the initial training phase, leading to slow convergence in the number of training iterations. To solve this problem, we propose…

Information Theory · Computer Science 2019-06-03 Chung Chan , Ali Al-Bashabsheh , Hing Pang Huang , Michael Lim , Da Sun Handason Tam , Chao Zhao

The classification of electrocardiogram (ECG) signals, which takes much time and suffers from a high rate of misjudgment, is recognized as an extremely challenging task for cardiologists. The major difficulty of the ECG signals…

Machine Learning · Computer Science 2020-12-11 Haozhen Zhang , Wei Zhao , Shuang Liu

In this paper, we propose a novel source model for a magnetoencephalography (MEG) inverse problem that combines a conventional extended parametric approach and an imaging approach.Our aim is to separately identify a focal current source and…

Signal Processing · Electrical Eng. & Systems 2023-02-27 Takaaki Nara , Ten-yu Yang , Kenta Kabashima

We propose a deep learning approach to predicting audio event onsets in electroencephalogram (EEG) recorded from users as they listen to music. We use a publicly available dataset containing ten contemporary songs and concurrently recorded…

Signal Processing · Electrical Eng. & Systems 2021-02-15 Ashvala Vinay , Alexander Lerch , Grace Leslie

Convolutional Neural Networks (CNN) outperform traditional classification methods in many domains. Recently these methods have gained attention in neuroscience and particularly in brain-computer interface (BCI) community. Here, we introduce…

Machine Learning · Computer Science 2019-02-12 Ivan Zubarev , Rasmus Zetter , Hanna-Leena Halme , Lauri Parkkonen

Exponential random graph models (ERGMs) are very flexible for modeling network formation but pose difficult estimation challenges due to their intractable normalizing constant. Existing methods, such as MCMC-MLE, rely on sequential…

Social and Information Networks · Computer Science 2025-02-05 Angelo Mele

In recent years, deep learning (DL) has contributed significantly to the improvement of motor-imagery brain-machine interfaces (MI-BMIs) based on electroencephalography(EEG). While achieving high classification accuracy, DL models have also…

Signal Processing · Electrical Eng. & Systems 2020-06-03 Thorir Mar Ingolfsson , Michael Hersche , Xiaying Wang , Nobuaki Kobayashi , Lukas Cavigelli , Luca Benini

Emotion recognition in conversation (ERC) has emerged as a research hotspot in domains such as conversational robots and question-answer systems. How to efficiently and adequately retrieve contextual emotional cues has been one of the key…

Computation and Language · Computer Science 2024-01-26 Jiang Li , Xiaoping Wang , Yingjian Liu , Zhigang Zeng

In this paper, various structures and methods of Deep Artificial Neural Networks (DNN) will be evaluated and compared for the purpose of continuous Persian speech recognition. One of the first models of neural networks used in speech…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-06 Arash Dehghani , Seyyed Ali Seyyedsalehi

As global climate change intensifies, accurate weather forecasting has become increasingly important, affecting agriculture, energy management, environmental protection, and daily life. This study introduces a hybrid model combining…

Machine Learning · Computer Science 2024-10-22 Yuhao Gong , Yuchen Zhang , Fei Wang , Chi-Han Lee

A vast majority of spiking neural networks (SNNs) are trained based on inductive biases that are not necessarily a good fit for several critical tasks that require low-latency and power efficiency. Inferring brain behavior based on the…

Neural and Evolutionary Computing · Computer Science 2023-04-20 Xi Chen , Siwei Mai , Konstantinos Michmizos

Parallelization framework has become a necessity to speed up the training of deep neural networks (DNN) recently. Such framework typically employs the Model Average approach, denoted as MA-DNN, in which parallel workers conduct respective…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-19 Shizhao Sun , Wei Chen , Jiang Bian , Xiaoguang Liu , Tie-Yan Liu

We propose a new deep network for audio event recognition, called AENet. In contrast to speech, sounds coming from audio events may be produced by a wide variety of sources. Furthermore, distinguishing them often requires analyzing an…

Multimedia · Computer Science 2017-01-05 Naoya Takahashi , Michael Gygli , Luc Van Gool

The task of event detection involves identifying and categorizing event triggers. Contextual information has been shown effective on the task. However, existing methods which utilize contextual information only process the context once. We…

Computation and Language · Computer Science 2018-10-09 Shaobo Liu , Rui Cheng , Xiaoming Yu , Xueqi Cheng