English
Related papers

Related papers: Data-Driven Ensembles for Deep and Hard-Decision H…

200 papers

Neural network classifiers trained with cross-entropy loss achieve strong predictive accuracy but lack the capability to provide inherent predictive uncertainty estimates, thus requiring external techniques to obtain these estimates. In…

Machine Learning · Statistics 2026-04-08 Courtney Franzen , Farhad Pourkamali-Anaraki

Deep learning based approaches have achieved significant progresses in different tasks like classification, detection, segmentation, and so on. Ensemble learning is widely known to further improve performance by combining multiple…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Danlu Chen , Xu-Yao Zhang , Wei Zhang , Yao Lu , Xiuli Li , Tao Mei

Analysis of human affect plays a vital role in human-computer interaction (HCI) systems. Due to the difficulty in capturing large amounts of real-life data, most of the current methods have mainly focused on controlled environments, which…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Jun Yu , Zhongpeng Cai , Peng He , Guocheng Xie , Qiang Ling

Deep Ensembles (DE) are a prominent approach for achieving excellent performance on key metrics such as accuracy, calibration, uncertainty estimation, and out-of-distribution detection. However, hardware limitations of real-world systems…

Ensemble learning serves as a straightforward way to improve the performance of almost any machine learning algorithm. Existing deep ensemble methods usually naively train many different models and then aggregate their predictions. This is…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Le Zhang , Qibin Hou , Yun Liu , Jia-Wang Bian , Xun Xu , Joey Tianyi Zhou , Ce Zhu

We present a new approach for learning compact and intuitive distributed representations with binary encoding. Rather than summing up expert votes as in products of experts, we employ for each variable the opinion of the most reliable…

Machine Learning · Statistics 2017-02-17 Marc Goessling , Yali Amit

Hyperdimensional Computing affords simple, yet powerful operations to create long Hyperdimensional Vectors (hypervectors) that can efficiently encode information, be used for learning, and are dynamic enough to be modified on the fly. In…

Symbolic Computation · Computer Science 2022-06-01 Peter Sutor , Dehao Yuan , Douglas Summers-Stay , Cornelia Fermuller , Yiannis Aloimonos

Few-shot object detection (FSOD) is challenging due to unstable optimization and limited generalization arising from the scarcity of training samples. To address these issues, we propose a hybrid ensemble decoder that enhances…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Xuanlong Yu , Youyang Sha , Longfei Liu , Xi Shen , Di Yang

Error-correcting codes are combinatorial objects designed to cope with the problem of reliable transmission of information on a noisy channel. A fundamental problem in coding theory and practice is to efficiently decode the received word…

Information Theory · Computer Science 2026-01-08 Haojie Gu , Jun Zhang

Deep neural networks often rely on spurious features to make predictions, which makes them brittle under distribution shift and on samples where the spurious correlation does not hold (e.g., minority-group examples). Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Aryan Yazdan Parast , Khawar Islam , Soyoun Won , Basim Azam , Naveed Akhtar

Extracting dense representations for terms and phrases is a task of great importance for knowledge discovery platforms targeting highly-technical fields. Dense representations are used as features for downstream components and have multiple…

Computation and Language · Computer Science 2023-05-26 Francesco Fusco , Diego Antognini

Deep neural networks perform well on classification tasks where data streams are i.i.d. and labeled data is abundant. Challenges emerge with non-stationary training data streams such as continual learning. One powerful approach that has…

Speech classification has attracted increasing attention due to its wide applications, particularly in classifying physical and mental states. However, these tasks are challenging due to the high variability in speech signals. Ensemble…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-25 Bagus Tris Atmaja , Felix Burkhardt

We consider the problem of erasure/list decoding using certain classes of simplified decoders. Specifically, we assume a class of erasure/list decoders, such that a codeword is in the list if its likelihood is larger than a threshold. This…

Information Theory · Computer Science 2016-11-17 Nir Weinberger , Neri Merhav

A new approach for designing bilayer and multi-layer LDPC codes is proposed and studied in the asymptotic regime. The ensembles are defined through individual uni-variate degree distributions, one for each layer. We present a construction…

Information Theory · Computer Science 2020-10-29 Eshed Ram , Yuval Cassuto

Staircase codes (SCCs) are typically decoded using iterative bounded-distance decoding (BDD) and hard decisions. In this paper, a novel decoding algorithm is proposed, which partially uses soft information from the channel. The proposed…

Signal Processing · Electrical Eng. & Systems 2020-06-05 Yi Lei , Bin Chen , Gabriele Liga , Xiong Deng , Zizheng Cao , Jianqiang Li , Kun Xu , Alex Alvarado

Domain adaptation is an attractive approach given the availability of a large amount of labeled data with similar properties but different domains. It is effective in image classification tasks where obtaining sufficient label data is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Yeganeh Madadi , Vahid Seydi , Jian Sun , Edward Chaum , Siamak Yousefi

We aim to improve segmentation through the use of machine learning tools during region agglomeration. We propose an active learning approach for performing hierarchical agglomerative segmentation from superpixels. Our method combines…

Computer Vision and Pattern Recognition · Computer Science 2015-03-13 Juan Nunez-Iglesias , Ryan Kennedy , Toufiq Parag , Jianbo Shi , Dmitri B. Chklovskii

Ever-larger language models with ever-increasing capabilities are by now well-established text processing tools. Alas, information extraction tasks such as named entity recognition are still largely unaffected by this progress as they are…

Computation and Language · Computer Science 2023-08-16 Tobias Deußer , Lars Hillebrand , Christian Bauckhage , Rafet Sifa

The attention mechanisms are playing a boosting role in advancements in sequence-to-sequence problems. Transformer architecture achieved new state of the art results in machine translation, and it's variants are since being introduced in…

Machine Learning · Computer Science 2020-05-12 Abhishek Niranjan , M Ali Basha Shaik , Kushal Verma