English
Related papers

Related papers: Bounding the Worst-class Error: A Boosting Approac…

200 papers

Class-agnostic image segmentation is a crucial component in automating image editing workflows, especially in contexts where object selection traditionally involves interactive tools. Existing methods in the literature often adhere to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Sebastian Dille , Ari Blondal , Sylvain Paris , Yağız Aksoy

Reconstruction error-based neural architectures constitute a classical deep learning approach to anomaly detection which has shown great performances. It consists in training an Autoencoder to reconstruct a set of examples deemed to…

Machine Learning · Computer Science 2024-06-06 Fabrizio Angiulli , Fabio Fassetti , Luca Ferragina

Regularization is a fundamental technique to prevent over-fitting and to improve generalization performances by constraining a model's complexity. Current Deep Networks heavily rely on regularizers such as Data-Augmentation (DA) or…

Machine Learning · Computer Science 2022-04-12 Randall Balestriero , Leon Bottou , Yann LeCun

Deep neural networks (DNNs) have shown to perform very well on large scale object recognition problems and lead to widespread use for real-world applications, including situations where DNN are implemented as "black boxes". A promising…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Federica Granese , Marco Romanelli , Daniele Gorla , Catuscia Palamidessi , Pablo Piantanida

Deep learning object detection algorithm has been widely used in medical image analysis. Currently all the object detection tasks are based on the data annotated with object classes and their bounding boxes. On the other hand, medical…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Li Xiao , Cheng Zhu , Junjun Liu , Chunlong Luo , Peifang Liu , Yi Zhao

This paper proposes a straightforward and cost-effective approach to assess whether a deep neural network (DNN) relies on the primary concepts of training samples or simply learns discriminative, yet simple and irrelevant features that can…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Mohammad Mahdi Mehmanchi , Mahbod Nouri , Mohammad Sabokrou

We present a novel regularization approach to train neural networks that enjoys better generalization and test error than standard stochastic gradient descent. Our approach is based on the principles of cross-validation, where a validation…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Simon Jenni , Paolo Favaro

We consider the decision-making framework of online convex optimization with a very large number of experts. This setting is ubiquitous in contextual and reinforcement learning problems, where the size of the policy class renders…

Machine Learning · Computer Science 2021-02-19 Elad Hazan , Karan Singh

Boosting is one of the most significant advances in machine learning for classification and regression. In its original and computationally flexible version, boosting seeks to minimize empirically a loss function in a greedy fashion. The…

Statistics Theory · Mathematics 2007-06-13 Tong Zhang , Bin Yu

In this paper, we explore bounds on the expected risk when using deep neural networks for supervised classification from an information theoretic perspective. Firstly, we introduce model risk and fitting error, which are derived from…

Machine Learning · Computer Science 2024-10-08 Binchuan Qi

Confidence measures for the generalization error are crucial when small training samples are used to construct classifiers. A common approach is to estimate the generalization error by resampling and then assume the resampled estimator…

Machine Learning · Computer Science 2012-06-18 Eric B. Laber , Susan A. Murphy

It is known that the current graph neural networks (GNNs) are difficult to make themselves deep due to the problem known as over-smoothing. Multi-scale GNNs are a promising approach for mitigating the over-smoothing problem. However, there…

Machine Learning · Computer Science 2021-01-07 Kenta Oono , Taiji Suzuki

Cost-sensitive loss functions are crucial in many real-world prediction problems, where different types of errors are penalized differently; for example, in medical diagnosis, a false negative prediction can lead to worse consequences than…

Deep neural networks (DNN) are increasingly being used to perform algorithm-selection in combinatorial optimisation domains, particularly as they accommodate input representations which avoid designing and calculating features. Mounting…

Neural and Evolutionary Computing · Computer Science 2024-06-25 Emma Hart , Quentin Renau , Kevin Sim , Mohamad Alissa

Recognizing and telling similar objects apart is even hard for human beings. In this paper, we show that there is a phenomenon of class interference with all deep neural networks. Class interference represents the learning difficulty in…

Machine Learning · Computer Science 2022-11-04 Dongcui Diao , Hengshuai Yao , Bei Jiang

Class imbalance in deep neural networks (DNNs) has witnessed a rapid increase in research attention in recent years. However, the varying accounts of the reasons behind the poor performance of DNN on imbalance data in pertinent literature…

Machine Learning · Computer Science 2026-05-26 Ismail B. Mustapha , Shafaatunnur Hasan , Sunday O. Olatunji , Hatem S. Y. Nabus

Despite the recent developments that allowed neural networks to achieve impressive performance on a variety of applications, these models are intrinsically affected by the problem of overgeneralization, due to their partitioning of the full…

Artificial Intelligence · Computer Science 2020-02-11 Giacomo Spigler

In this work we study the impact of noise on the training of object detection networks for the medical domain, and how it can be mitigated by improving the training procedure. Annotating large medical datasets for training data-hungry deep…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Sina Famouri , Lia Morra , Leonardo Mangia , Fabrizio Lamberti

There is active research targeting local image manipulations that can fool deep neural networks (DNNs) into producing incorrect results. This paper examines a type of global image manipulation that can produce similar adverse effects.…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Mahmoud Afifi , Michael S Brown

As deep neural networks(DNN) become increasingly prevalent, particularly in high-stakes areas such as autonomous driving and healthcare, the ability to detect incorrect predictions of models and intervene accordingly becomes crucial for…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Ge Yan , Tsui-Wei Weng