English
Related papers

Related papers: DGSD: Dynamical Graph Self-Distillation for EEG-Ba…

200 papers

Depression is a major cause of global mental illness and significantly influences suicide rates. Timely and accurate diagnosis is essential for effective intervention. Electroencephalography (EEG) provides a non-invasive and accessible…

Signal Processing · Electrical Eng. & Systems 2025-11-11 Soujanya Hazra , Sanjay Ghosh

In the realm of Adversarial Distillation (AD), strategic and precise knowledge transfer from an adversarially robust teacher model to a less robust student model is paramount. Our Dynamic Guidance Adversarial Distillation (DGAD) framework…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Hyejin Park , Dongbo Min

Temporal Graph Networks (TGNs) have shown remarkable performance in learning representation for continuous-time dynamic graphs. However, real-world dynamic graphs typically contain diverse and intricate noise. Noise can significantly…

Machine Learning · Computer Science 2023-09-06 Siwei Zhang , Yun Xiong , Yao Zhang , Yiheng Sun , Xi Chen , Yizhu Jiao , Yangyong Zhu

We propose a novel method for Acoustic Event Detection (AED). In contrast to speech, sounds coming from acoustic events may be produced by a wide variety of sources. Furthermore, distinguishing them often requires analyzing an extended time…

Sound · Computer Science 2016-12-09 Naoya Takahashi , Michael Gygli , Beat Pfister , Luc Van Gool

We present a new algorithm, named Autonomous Gaussian Decomposition (AGD), for automatically decomposing spectra into Gaussian components. AGD uses derivative spectroscopy and machine learning to provide optimized guesses for the number of…

Instrumentation and Methods for Astrophysics · Physics 2015-06-22 Robert R. Lindner , Carlos Vera-Ciro , Claire E. Murray , Snežana Stanimirović , Brian L. Babler , Carl Heiles , Patrick Hennebelle , W. M. Goss , John Dickey

Wearable devices for seizure monitoring detection could significantly improve the quality of life of epileptic patients. However, existing solutions that mostly rely on full electrode set of electroencephalogram (EEG) measurements could be…

Signal Processing · Electrical Eng. & Systems 2023-04-14 Qinyue Zheng , Arun Venkitaraman , Simona Petravic , Pascal Frossard

Knowledge Distillation (KD) has been used in image classification for model compression. However, rare studies apply this technology on single-stage object detectors. Focal loss shows that the accumulated errors of easily-classified samples…

Computer Vision and Pattern Recognition · Computer Science 2019-01-15 Shitao Tang , Litong Feng , Wenqi Shao , Zhanghui Kuang , Wei Zhang , Yimin Chen

This paper introduces an innovative approach to Attention-deficit/hyperactivity disorder (ADHD) diagnosis by employing deep learning (DL) techniques on electroencephalography (EEG) signals. This method addresses the limitations of current…

Computers and Society · Computer Science 2024-12-04 Medha Pappula , Syed Muhammad Anwar

RGB-D salient object detection (SOD) demonstrates its superiority on detecting in complex environments due to the additional depth information introduced in the data. Inevitably, an independent stream is introduced to extract features from…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Guangyu Ren , Yinxiao Yu , Hengyan Liu , Tania Stathaki

Voice activity detection (VAD), which classifies frames as speech or non-speech, is an important module in many speech applications including speaker verification. In this paper, we propose a novel method, called self-adaptive soft VAD, to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-25 Youngmoon Jung , Yeunju Choi , Hoirin Kim

The performance of speech enhancement algorithms in a multi-speaker scenario depends on correctly identifying the target speaker to be enhanced. Auditory attention decoding (AAD) methods allow to identify the target speaker which the…

Sound · Computer Science 2020-05-12 Ali Aroudi , Marc Delcroix , Tomohiro Nakatani , Keisuke Kinoshita , Shoko Araki , Simon Doclo

Audiovisual active speaker detection (ASD) is conventionally performed by modelling the temporal synchronisation of acoustic and visual speech cues. In egocentric recordings, however, the efficacy of synchronisation-based methods is…

Multimedia · Computer Science 2025-06-24 Jason Clarke , Yoshihiko Gotoh , Stefan Goetze

Knowledge distillation (KD) is a technique to derive optimal performance from a small student network (SN) by distilling knowledge of a large teacher network (TN) and transferring the distilled knowledge to the small SN. Since a role of…

Machine Learning · Computer Science 2019-07-10 Seunghyun Lee , Byung Cheol Song

Deep convolutional neural networks (CNNs) have been applied to extracting speaker embeddings with significant success in speaker verification. Incorporating the attention mechanism has shown to be effective in improving the model…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-01 Jingyu Li , Yusheng Tian , Tan Lee

Hashing has been widely used in approximate nearest neighbor search for its storage and computational efficiency. Deep supervised hashing methods are not widely used because of the lack of labeled data, especially when the domain is…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Xiao Luo , Zeyu Ma , Daqing Wu , Huasong Zhong , Chong Chen , Jinwen Ma , Minghua Deng

Monocular depth estimation is challenging due to its inherent ambiguity and ill-posed nature, yet it is quite important to many applications. While recent works achieve limited accuracy by designing increasingly complicated networks to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Zizhang Wu , Zhuozheng Li , Zhi-Gang Fan , Yunzhe Wu , Xiaoquan Wang , Rui Tang , Jian Pu

Derivatives of differential equation solutions are commonly for parameter estimation, fitting neural differential equations, and as model diagnostics. However, with a litany of choices and a Cartesian product of potential methods, it can be…

Numerical Analysis · Computer Science 2021-07-21 Yingbo Ma , Vaibhav Dixit , Mike Innes , Xingjian Guo , Christopher Rackauckas

In this paper, we propose a novel self-distillation method for fake speech detection (FSD), which can significantly improve the performance of FSD without increasing the model complexity. For FSD, some fine-grained information is very…

Sound · Computer Science 2023-03-03 Jun Xue , Cunhang Fan , Jiangyan Yi , Chenglong Wang , Zhengqi Wen , Dan Zhang , Zhao Lv

We introduce Adversarial Diffusion Distillation (ADD), a novel training approach that efficiently samples large-scale foundational image diffusion models in just 1-4 steps while maintaining high image quality. We use score distillation to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Axel Sauer , Dominik Lorenz , Andreas Blattmann , Robin Rombach

Deep graph neural networks (GNNs) have been shown to be expressive for modeling graph-structured data. Nevertheless, the over-stacked architecture of deep graph models makes it difficult to deploy and rapidly test on mobile or embedded…

Machine Learning · Computer Science 2022-05-25 Huarui He , Jie Wang , Zhanqiu Zhang , Feng Wu