English
Related papers

Related papers: Disentangling Dual-Encoder Masked Autoencoder for …

200 papers

This paper presents a comprehensive study focused on disentangling hippocampal shape variations from diffusion tensor imaging (DTI) datasets within the context of neurological disorders. Leveraging a Mesh Variational Autoencoder (VAE)…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Jakaria Rabbi , Johannes Kiechle , Christian Beaulieu , Nilanjan Ray , Dana Cobzas

Human social behaviors are inherently multimodal necessitating the development of powerful audiovisual models for their perception. In this paper, we present Social-MAE, our pre-trained audiovisual Masked Autoencoder based on an extended…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Hugo Bohy , Minh Tran , Kevin El Haddad , Thierry Dutoit , Mohammad Soleymani

Raman spectroscopy serves as a powerful and reliable tool for analyzing the chemical information of substances. The integration of Raman spectroscopy with deep learning methods enables rapid qualitative and quantitative analysis of…

Signal Processing · Electrical Eng. & Systems 2025-04-24 Pengju Ren , Ri-gui Zhou , Yaochong Li

Epilepsy is one of the most common neurological disorders. This disease requires reliable and efficient seizure detection methods. Electroencephalography (EEG) is the gold standard for seizure monitoring, but its manual analysis is a…

Signal Processing · Electrical Eng. & Systems 2025-12-17 Annika Stiehl , Nicolas Weeger , Christian Uhl , Dominic Bechtold , Nicole Ille , Stefan Geißelsöder

Deep learning techniques have been used recently to tackle the audio source separation problem. In this work, we propose to use deep fully convolutional denoising autoencoders (CDAEs) for monaural audio source separation. We use as many…

Sound · Computer Science 2017-10-16 Emad M. Grais , Mark D. Plumbley

Masked Autoencoders (MAE) have shown promising performance in self-supervised learning for both 2D and 3D computer vision. However, existing MAE-style methods can only learn from the data of a single modality, i.e., either images or point…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Ziyu Guo , Renrui Zhang , Longtian Qiu , Xianzhi Li , Pheng-Ann Heng

Although end-to-end (E2E) trainable automatic speech recognition (ASR) has shown great success by jointly learning acoustic and linguistic information, it still suffers from the effect of domain shifts, thus limiting potential applications.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-28 Keqi Deng , Philip C. Woodland

Despite the remarkable advances in deep learning technology, achieving satisfactory performance in lung sound classification remains a challenge due to the scarcity of available data. Moreover, the respiratory sound samples are collected…

Sound · Computer Science 2023-12-18 June-Woo Kim , Sangmin Bae , Won-Yang Cho , Byungjo Lee , Ho-Young Jung

Extending the input modality of Large Language Models~(LLMs) to the audio domain is essential for achieving comprehensive multimodal perception. However, it is well-known that acoustic information is intrinsically \textit{heterogeneous},…

Self-supervised learning (SSL) has recently emerged as a key strategy for building foundation models in remote sensing, where the scarcity of annotated data limits the applicability of fully supervised approaches. In this work, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Vittorio Bernuzzi , Leonardo Rossi , Tomaso Fontanini , Massimo Bertozzi , Andrea Prati

Multiview systems have become a key technology in modern computer vision, offering advanced capabilities in scene understanding and analysis. However, these systems face critical challenges in bandwidth limitations and computational…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Kosta Dakic , Kanchana Thilakarathna , Rodrigo N. Calheiros , Teng Joon Lim

Decoding information from bio-signals such as EEG, using machine learning has been a challenge due to the small data-sets and difficulty to obtain labels. We propose a reconstruction-based self-supervised learning model, the masked…

Signal Processing · Electrical Eng. & Systems 2022-11-07 Hsiang-Yun Sherry Chien , Hanlin Goh , Christopher M. Sandino , Joseph Y. Cheng

In this study, a machine learning model was developed for automatically detecting respiratory system sounds such as sneezing and coughing in disease diagnosis. The automatic model and approach development of breath sounds, which carry…

Sound · Computer Science 2021-11-30 Negin Melek

Multivariate Time Series forecasting has been an increasingly popular topic in various applications and scenarios. Recently, contrastive learning and Transformer-based models have achieved good performance in many long-term series…

Machine Learning · Computer Science 2023-01-24 Zhe Li , Zhongwen Rao , Lujia Pan , Pengyun Wang , Zenglin Xu

Inspired by the success of deep neural networks (DNNs) in speech processing, this paper presents Deep Vocoder, a direct end-to-end low bit rate speech compression method with deep autoencoder (DAE). In Deep Vocoder, DAE is used for…

Multimedia · Computer Science 2019-05-15 Gang Min , Changqing Zhang , Xiongwei Zhang , Wei Tan

With the exponential growth of multimedia data, leveraging multimodal sensors presents a promising approach for improving accuracy in human activity recognition. Nevertheless, accurately identifying these activities using both video data…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Rex Liu , Xin Liu

Recently, end-to-end (E2E) models, which allow to take spectral vector sequences of L2 (second-language) learners' utterances as input and produce the corresponding phone-level sequences as output, have attracted much research attention in…

Sound · Computer Science 2021-10-19 Tien-Hong Lo , Yao-Ting Sung , Berlin Chen

Environmental audio tagging aims to predict only the presence or absence of certain acoustic events in the interested acoustic scene. In this paper we make contributions to audio tagging in two parts, respectively, acoustic modeling and…

Continuous treatment effect estimation holds significant practical importance across various decision-making and assessment domains, such as healthcare and the military. However, current methods for estimating dose-response curves hinge on…

Machine Learning · Computer Science 2024-06-05 Ruijing Cui , Jianbin Sun , Bingyu He , Kewei Yang , Bingfeng Ge

Training reliable respiratory sound classification models remains challenging due to the limited size and subject diversity of datasets. Ensemble methods can improve robustness, but when base models are trained on identical data, models…

Machine Learning · Computer Science 2026-04-28 June-Woo Kim , Miika Toikkanen , Heejoon Koo , Yoon Tae Kim , Doyoung Kwon , Kyunghoon Kim