English
Related papers

Related papers: Effects of Common Regularization Techniques on Ope…

200 papers

In recent years, research on learning with noisy labels has focused on devising novel algorithms that can achieve robustness to noisy training labels while generalizing to clean data. These algorithms often incorporate sophisticated…

Machine Learning · Computer Science 2023-07-12 Hui Kang , Sheng Liu , Huaxi Huang , Jun Yu , Bo Han , Dadong Wang , Tongliang Liu

Regularization and Bayesian methods for system identification have been repopularized in the recent years, and proved to be competitive w.r.t. classical parametric approaches. In this paper we shall make an attempt to illustrate how the use…

Systems and Control · Computer Science 2015-11-06 A. Chiuso

Open-set face recognition refers to a scenario in which biometric systems have incomplete knowledge of all existing subjects. Therefore, they are expected to prevent face samples of unregistered subjects from being identified as previously…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Rafael Henrique Vareto , Manuel Günther , William Robson Schwartz

A significant advance in accelerating neural network training has been the development of normalization methods, permitting the training of deep models both faster and with better accuracy. These advances come with practical challenges: for…

Machine Learning · Computer Science 2019-03-05 Jasmine Collins , Johannes Balle , Jonathon Shlens

In this thesis, we develop various techniques for working with sets in machine learning. Each input or output is not an image or a sequence, but a set: an unordered collection of multiple objects, each object described by a feature vector.…

Machine Learning · Computer Science 2021-03-09 Yan Zhang

Open set recognition is an emerging research area that aims to simultaneously classify samples from predefined classes and identify the rest as 'unknown'. In this process, one of the key challenges is to reduce the risk of generalizing the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Guangyao Chen , Limeng Qiao , Yemin Shi , Peixi Peng , Jia Li , Tiejun Huang , Shiliang Pu , Yonghong Tian

Many practical medical imaging scenarios include categories that are under-represented but still crucial. The relevance of image recognition models to real-world applications lies in their ability to generalize to these rare classes as well…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Daniya Najiha A. Kareem , Jean Lahoud , Mustansar Fiaz , Amandeep Kumar , Hisham Cholakkal

Supervised deep learning models require significant amount of labeled data to achieve an acceptable performance on a specific task. However, when tested on unseen data, the models may not perform well. Therefore, the models need to be…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Akshit Achara , Ram Krishna Pandey

Deep artificial neural networks have made remarkable progress in different tasks in the field of computer vision. However, the empirical analysis of these models and investigation of their failure cases has received attention recently. In…

Computer Vision and Pattern Recognition · Computer Science 2016-02-10 Babak Saleh , Ahmed Elgammal , Jacob Feldman

Image registration is fundamental in medical imaging applications, such as disease progression analysis or radiation therapy planning. The primary objective of image registration is to precisely capture the deformation between two or more…

Image and Video Processing · Electrical Eng. & Systems 2024-12-23 Anna Reithmeir , Veronika Spieker , Vasiliki Sideri-Lampretsa , Daniel Rueckert , Julia A. Schnabel , Veronika A. Zimmer

Generalization is at the core of machine learning models. However, the definition of generalization is not entirely clear. We employ set theory to introduce the concepts of algorithms, hypotheses, and dataset generalization. We analyze the…

Machine Learning · Computer Science 2023-11-14 Shiqi Liu

Object detection and recognition are fundamental functions underlying the success of species. Because the appearance of an object exhibits a large variability, the brain has to group these different stimuli under the same object identity, a…

Machine Learning · Computer Science 2022-06-14 Faris B. Rustom , Haluk Öğmen , Arash Yazdanbakhsh

Traditional supervised learning aims to train a classifier in the closed-set world, where training and test samples share the same label space. In this paper, we target a more challenging and realistic setting: open-set learning (OSL),…

Machine Learning · Computer Science 2021-07-01 Zhen Fang , Jie Lu , Anjin Liu , Feng Liu , Guangquan Zhang

The findings on open-set recognition (OSR) show that models trained on classification datasets are capable of detecting unknown classes not encountered during the training process. Specifically, after training, the learned representations…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Jaewoo Park , Hojin Park , Eunju Jeong , Andrew Beng Jin Teoh

Regularization is a fundamental technique to prevent over-fitting and to improve generalization performances by constraining a model's complexity. Current Deep Networks heavily rely on regularizers such as Data-Augmentation (DA) or…

Machine Learning · Computer Science 2022-04-12 Randall Balestriero , Leon Bottou , Yann LeCun

Camera model identification refers to the problem of linking a picture to the camera model used to shoot it. As this might be an enabling factor in different forensic applications to single out possible suspects (e.g., detecting the author…

Computer Vision and Pattern Recognition · Computer Science 2019-11-15 Pedro Ribeiro Mendes Júnior , Luca Bondi , Paolo Bestagini , Stefano Tubaro , Anderson Rocha

Overfitting is one of the most critical challenges in deep neural networks, and there are various types of regularization methods to improve generalization performance. Injecting noises to hidden units during training, e.g., dropout, is…

Machine Learning · Computer Science 2017-11-10 Hyeonwoo Noh , Tackgeun You , Jonghwan Mun , Bohyung Han

Deep learning has been widely used in radio frequency (RF) fingerprinting. Despite its excellent performance, most existing methods only consider a closed-set assumption, which cannot effectively tackle signals emitted from those unknown…

Signal Processing · Electrical Eng. & Systems 2023-06-27 Weidong Wang , Hongshu Liao , Lu Gan

Traditional machine learning follows a close-set assumption that the training and test set share the same label space. While in many practical scenarios, it is inevitable that some test samples belong to unknown classes (open-set). To fix…

Machine Learning · Computer Science 2023-02-23 Zitai Wang , Qianqian Xu , Zhiyong Yang , Yuan He , Xiaochun Cao , Qingming Huang

Various normalization layers have been proposed to help the training of neural networks. Group Normalization (GN) is one of the effective and attractive studies that achieved significant performances in the visual recognition task. Despite…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Agus Gunawan , Xu Yin , Kang Zhang