English
Related papers

Related papers: Ensemble Distribution Distillation for Self-Superv…

200 papers

Most recent work on vision-based human activity recognition (HAR) focuses on designing complex deep learning models for the task. In so doing, there is a requirement for large datasets to be collected. As acquiring and processing large…

Computer Vision and Pattern Recognition · Computer Science 2020-04-30 Bruce X. B. Yu , Yan Liu , Keith C. C. Chan

Human multimodal emotion recognition (MER) seeks to infer human emotions by integrating information from language, visual, and acoustic modalities. Although existing MER approaches have achieved promising results, they still struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Yong Li , Yuanzhi Wang , Yi Ding , Shiqing Zhang , Ke Lu , Cuntai Guan

Dataset Distillation (DD) is an emerging technique that compresses large-scale datasets into significantly smaller synthesized datasets while preserving high test performance and enabling the efficient training of large models. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Zheng Zhou , Wenquan Feng , Shuchang Lyu , Guangliang Cheng , Xiaowei Huang , Qi Zhao

In modern GANs, maintaining an Exponential Moving Average (EMA) of the generator's weights is a standard practice, as such an averaged model consistently outperforms the actively trained generator. However, the EMA generator is used for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Antoni Nowinowski , Krzysztof Krawiec

With the fast development of Deep Learning techniques, Named Entity Recognition (NER) is becoming more and more important in the information extraction task. The greatest difficulty that the NER task faces is to keep the detectability even…

Computation and Language · Computer Science 2024-01-23 Xin Chen , Qi Zhao , Xinyang Liu

Self-training is a powerful approach to deep learning. The key process is to find a pseudo-label for modeling. However, previous self-training algorithms suffer from the over-confidence issue brought by the hard labels, even some…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Zijia Wang , Wenbin Yang , Zhisong Liu , Zhen Jia

Human Activity Recognition (HAR) on resource-constrained wearable devices demands inference models that harmonize accuracy with computational efficiency. This paper introduces TinierHAR, an ultra-lightweight deep learning architecture that…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Sizhen Bian , Mengxi Liu , Vitor Fortes Rey , Daniel Geissler , Paul Lukowicz

We consider the problem of uncertainty quantification in high dimensional regression and classification for which deep ensemble have proven to be promising methods. Recent observations have shown that deep ensemble often return…

Machine Learning · Computer Science 2023-04-11 Antoine de Mathelin , Francois Deheeger , Mathilde Mougeot , Nicolas Vayatis

In this study we propose a hybrid estimation of distribution algorithm (HEDA) to solve the joint stratification and sample allocation problem. This is a complex problem in which each the quality of each stratification from the set of all…

Methodology · Statistics 2022-01-12 Mervyn O'Luing , Steven Prestwich , S. Armagan Tarim

Automatic emotion recognition is an active research topic with wide range of applications. Due to the high manual annotation cost and inevitable label ambiguity, the development of emotion recognition dataset is limited in both scale and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-08 Jingjun Liang , Ruichen Li , Qin Jin

Blind super-resolution methods based on stable diffusion showcase formidable generative capabilities in reconstructing clear high-resolution images with intricate details from low-resolution inputs. However, their practical applicability is…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Rui Xie , Chen Zhao , Kai Zhang , Zhenyu Zhang , Jun Zhou , Jian Yang , Ying Tai

Domain adaptation aims to mitigate the domain gap when transferring knowledge from an existing labeled domain to a new domain. However, existing disentanglement-based methods do not fully consider separation between domain-invariant and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Youshan Zhang , Brian D. Davison

Human activity recognition (HAR) ideally relies on data from wearable or environment-instrumented sensors sampled at regular intervals, enabling standard neural network models optimized for consistent time-series data as input. However,…

Signal Processing · Electrical Eng. & Systems 2025-01-28 Mengxi Liu , Daniel Geißler , Sizhen Bian , Bo Zhou , Paul Lukowicz

Adversarial robustness is a research area that has recently received a lot of attention in the quest for trustworthy artificial intelligence. However, recent works on adversarial robustness have focused on supervised learning where it is…

Machine Learning · Computer Science 2023-08-09 Dongyoon Yang , Insung Kong , Yongdai Kim

A key challenge in computer vision and deep learning is the definition of robust strategies for the detection of adversarial examples. Here, we propose the adoption of ensemble approaches to leverage the effectiveness of multiple detectors…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Francesco Craighero , Fabrizio Angaroni , Fabio Stella , Chiara Damiani , Marco Antoniotti , Alex Graudenzi

Adversarial training is a widely adopted strategy to bolster the robustness of neural network models against adversarial attacks. This paper revisits the fundamental assumptions underlying image classification and suggests that representing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Erh-Chung Chen , Che-Rung Lee

Wearables are fundamental to improving our understanding of human activities, especially for an increasing number of healthcare applications from rehabilitation to fine-grained gait analysis. Although our collective know-how to solve Human…

Machine Learning · Computer Science 2020-07-15 Alireza Abedin , Mahsa Ehsanpour , Qinfeng Shi , Hamid Rezatofighi , Damith C. Ranasinghe

In the past few years, augmented reality (AR) and virtual reality (VR) technologies have experienced terrific improvements in both accessibility and hardware capabilities, encouraging the application of these devices across various domains.…

Human-Computer Interaction · Computer Science 2019-10-29 Marco Cavallo , Mishal Dholakia , Matous Havlena , Kenneth Ocheltree , Mark Podlaseck

In deep reinforcement learning (RL), data augmentation is widely considered as a tool to induce a set of useful priors about semantic consistency and improve sample efficiency and generalization performance. However, even when the prior is…

Machine Learning · Computer Science 2023-03-02 Byungchan Ko , Jungseul Ok

In deep reinforcement learning (RL), data augmentation is widely considered as a tool to induce a set of useful priors about semantic consistency and improve sample efficiency and generalization performance. However, even when the prior is…

Machine Learning · Computer Science 2022-10-21 Byungchan Ko , Jungseul Ok