English
Related papers

Related papers: Efficient Self-Ensemble for Semantic Segmentation

200 papers

One of the possible objectives when designing experiments is to build or formulate a model for predicting future observations. When the primary objective is prediction, some typical approaches in the planning phase are to use…

Methodology · Statistics 2021-10-04 Trent Lemkus , Philip Ramsey , Christopher Gotwalt , Maria Weese

Student performance prediction is a critical research problem to understand the students' needs, present proper learning opportunities/resources, and develop the teaching quality. However, traditional machine learning methods fail to…

Machine Learning · Computer Science 2021-12-23 Yinkai Wang , Aowei Ding , Kaiyi Guan , Shixi Wu , Yuanqi Du

Ensemble methods are known for enhancing the accuracy and robustness of machine learning models by combining multiple base learners. However, standard approaches like greedy or random ensembling often fall short, as they assume a constant…

Machine Learning · Computer Science 2025-06-24 Sebastian Pineda Arango , Maciej Janowski , Lennart Purucker , Arber Zela , Frank Hutter , Josif Grabocka

Autoencoding, which aims to reconstruct the input images through a bottleneck latent representation, is one of the classic feature representation learning strategies. It has been shown effective as an auxiliary task for semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Yuhao Lin , Haiming Xu , Lingqiao Liu , Jinan Zou , Javen Qinfeng Shi

Aggregating multiple learners through an ensemble of models aim to make better predictions by capturing the underlying distribution of the data more accurately. Different ensembling methods, such as bagging, boosting, and stacking/blending,…

Machine Learning · Statistics 2020-11-03 Mohsen Shahhosseini , Guiping Hu , Hieu Pham

Semantic segmentation involves assigning a specific category to each pixel in an image. While Vision Transformer-based models have made significant progress, current semantic segmentation methods often struggle with precise predictions in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Guoan Xu , Wenfeng Huang , Tao Wu , Ligeng Chen , Wenjing Jia , Guangwei Gao , Xiatian Zhu , Stuart Perry

We propose an approach for adversarial attacks on dense prediction models (such as object detectors and segmentation). It is well known that the attacks generated by a single surrogate model do not transfer to arbitrary (blackbox) victim…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Zikui Cai , Yaoteng Tan , M. Salman Asif

Accurate perception of dynamic traffic scenes is crucial for high-level autonomous driving systems, requiring robust object motion estimation and instance segmentation. However, traditional methods often treat them as separate tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yinqi Chen , Meiying Zhang , Qi Hao , Guang Zhou

Ensembling neural networks is an effective way to increase accuracy, and can often match the performance of individual larger models. This observation poses a natural question: given the choice between a deep ensemble and a single neural…

Machine Learning · Computer Science 2022-10-14 Taiga Abe , E. Kelly Buchanan , Geoff Pleiss , Richard Zemel , John P. Cunningham

While nowadays deep neural networks achieve impressive performances on semantic segmentation tasks, they are usually trained by optimizing pixel-wise losses such as cross-entropy. As a result, the predictions outputted by such networks…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Yifu Chen , Arnaud Dapogny , Matthieu Cord

Statistical and structural modeling represent two distinct approaches to data analysis. In this paper, we propose a set of novel methods for combining statistical and structural models for improved prediction and causal inference. Our first…

Econometrics · Economics 2020-06-11 Jiaming Mao , Jingzhi Xu

We present a framework for efficient perceptual inference that explicitly reasons about the segmentation of its inputs and features. Rather than being trained for any specific segmentation, our framework learns the grouping process in an…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Klaus Greff , Antti Rasmus , Mathias Berglund , Tele Hotloo Hao , Jürgen Schmidhuber , Harri Valpola

Ensembling Large Language Models (LLMs) has gained attention as a promising approach to surpass the performance of individual models by leveraging their complementary strengths. In particular, aggregating models' next-token probability…

Computation and Language · Computer Science 2026-03-16 Heecheol Yun , Kwangmin Ki , Junghyun Lee , Eunho Yang

Ensemble Learning is an effective method for improving generalization in machine learning. However, as state-of-the-art neural networks grow larger, the computational cost associated with training several independent networks becomes…

Machine Learning · Computer Science 2022-03-28 Tim Whitaker , Darrell Whitley

Artificial neural networks have been successfully applied to a variety of machine learning tasks, including image recognition, semantic segmentation, and machine translation. However, few studies fully investigated ensembles of artificial…

Machine Learning · Statistics 2017-04-07 Cheng Ju , Aurélien Bibaut , Mark J. van der Laan

Recent researches have shown that deep forest ensemble achieves a considerable increase in classification accuracy compared with the general ensemble learning methods, especially when the training set is small. In this paper, we take…

Machine Learning · Computer Science 2019-05-15 Haiyang Wang , Yong Tang , Ziyang Jia , Fei Ye

Many automated processes such as auto-piloting rely on a good semantic segmentation as a critical component. To speed up performance, it is common to downsample the input frame. However, this comes at the cost of missed small objects and…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 Dmitrii Marin , Zijian He , Peter Vajda , Priyam Chatterjee , Sam Tsai , Fei Yang , Yuri Boykov

In big data applications, classical ensemble learning is typically infeasible on the raw input data and dimensionality reduction techniques are necessary. To this end, novel framework that generalises classic flat-view ensemble learning to…

Signal Processing · Electrical Eng. & Systems 2018-12-18 Ilia Kisil , Ahmad Moniri , Danilo P. Mandic

The state-of-the-art object detection and image classification methods can perform impressively on more than 9k and 10k classes, respectively. In contrast, the number of classes in semantic segmentation datasets is relatively limited. This…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Shipra Jain , Danda Paudel Pani , Martin Danelljan , Luc Van Gool

Modern neural networks do not always produce well-calibrated predictions, even when trained with a proper scoring function such as cross-entropy. In classification settings, simple methods such as isotonic regression or temperature scaling…

Machine Learning · Computer Science 2021-03-26 Steven Reich , David Mueller , Nicholas Andrews