中文
相关论文

相关论文: Unravelling Small Sample Size Problems in the Deep…

200 篇论文

We study the problem of reducing the amount of labeled training data required to train supervised classification models. We approach it by leveraging Active Learning, through sequential selection of examples which benefit the model most.…

机器学习 · 计算机科学 2019-01-18 Fedor Zhdanov

Deep Learning shows very good performance when trained on large labeled data sets. The problem of training a deep net on a few or one sample per class requires a different learning approach which can generalize to unseen classes using only…

机器学习 · 计算机科学 2018-08-23 Jinchao Liu , Stuart J. Gibson , Margarita Osadchy

The customizable nature of deep learning models have allowed them to be successful predictors in various disciplines. These models are often trained with respect to thousands or millions of instances for complicated problems, but the…

机器学习 · 计算机科学 2019-12-24 Drimik Roy Chowdhury , Muhammad Firmansyah Kasim

Recent advances in deep learning models for sequence classification have greatly improved their classification accuracy, specially when large training sets are available. However, several works have suggested that under some settings the…

机器学习 · 计算机科学 2022-11-14 Francesco Cazzaro , Ariadna Quattoni , Xavier Carreras

While deep learning has achieved great success in computer vision and many other fields, currently it does not work very well on patient genomic data with the "big p, small N" problem (i.e., a relatively small number of samples with…

机器学习 · 计算机科学 2018-09-07 Tianle Ma , Aidong Zhang

Despite extensive research spanning several decades, class imbalance is still considered a profound difficulty for both machine learning and deep learning models. While data oversampling is the foremost technique to address this issue,…

机器学习 · 计算机科学 2025-02-12 Sukumar Kishanthan , Asela Hevapathige

Mixed-integer optimisation problems can be computationally challenging. Here, we introduce and analyse two efficient algorithms with a specific sequential design that are aimed at dealing with sampled problems within this class. At each…

最优化与控制 · 数学 2023-03-07 Mohammadreza Chamanbaz , Roland Bouffanais

Learning with limited data is one of the biggest problems of machine learning. Current approaches to this issue consist in learning general representations from huge amounts of data before fine-tuning the model on a small dataset of…

机器学习 · 计算机科学 2023-02-22 Grégoire Mialon

In the last decade, data-driven algorithms outperformed traditional optimization-based algorithms in many research areas, such as computer vision, natural language processing, etc. However, extensive data usages bring a new challenge or…

机器学习 · 计算机科学 2021-12-02 Shih-Chun Lin , Chia-Hung Lin

While deep learning-based general object detection has made significant strides in recent years, the effectiveness and efficiency of small object detection remain unsatisfactory. This is primarily attributed not only to the limited…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Zile Huang , Chong Zhang , Mingyu Jin , Fangyu Wu , Chengzhi Liu , Xiaobo Jin

Data driven models of dynamical systems help planners and controllers to provide more precise and accurate motions. Most model learning algorithms will try to minimize a loss function between the observed data and the model's predictions.…

人工智能 · 计算机科学 2021-02-12 Clark Zhang , Santiago Paternain , Alejandro Ribeiro

The success of deep learning hinges on enormous data and large models, which require labor-intensive annotations and heavy computation costs. Subset selection is a fundamental problem that can play a key role in identifying smaller portions…

机器学习 · 计算机科学 2023-12-19 Srikumar Ramalingam , Pranjal Awasthi , Sanjiv Kumar

This paper is concerned with the problem of low rank plus sparse matrix decomposition for big data. Conventional algorithms for matrix decomposition use the entire data to extract the low-rank and sparse components, and are based on…

数值分析 · 计算机科学 2017-03-17 Mostafa Rahmani , George Atia

Face recognition has long been an active research area in the field of artificial intelligence, particularly since the rise of deep learning in recent years. In some practical situations, each identity has only a single sample available for…

计算机视觉与模式识别 · 计算机科学 2022-08-11 Fan Liu , Delong Chen , Fei Wang , Zewen Li , Feng Xu

Real-world datasets are often highly class-imbalanced, which can adversely impact the performance of deep learning models. The majority of research on training neural networks under class imbalance has focused on specialized loss functions,…

机器学习 · 计算机科学 2023-12-06 Ravid Shwartz-Ziv , Micah Goldblum , Yucen Lily Li , C. Bayan Bruss , Andrew Gordon Wilson

Recent advances in Deep Learning have greatly improved performance on various tasks such as object detection, image segmentation, sentiment analysis. The focus of most research directions up until very recently has been on beating…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Cristian Simionescu

Deep convolutional neural networks (CNNs) have shown excellent performance in object recognition tasks and dense classification problems such as semantic segmentation. However, training deep neural networks on large and sparse datasets is…

计算机视觉与模式识别 · 计算机科学 2017-12-25 Lorenz Berger , Eoin Hyde , M. Jorge Cardoso , Sebastien Ourselin

Stochastic gradient descent samples uniformly the training set to build an unbiased gradient estimate with a limited number of samples. However, at a given step of the training process, some data are more helpful than others to continue…

机器学习 · 计算机科学 2023-03-30 Thibault Lahire

A new challenge for learning algorithms in cyber-physical network systems is the distributed solution of big-data classification problems, i.e., problems in which both the number of training samples and their dimension is high. Motivated by…

最优化与控制 · 数学 2017-02-16 Giuseppe Notarstefano

Class imbalance is a common problem in the case of real-world object detection and classification tasks. Data of some classes is abundant making them an over-represented majority, and data of other classes is scarce, making them an…

计算机视觉与模式识别 · 计算机科学 2017-03-24 Salman H. Khan , Munawar Hayat , Mohammed Bennamoun , Ferdous Sohel , Roberto Togneri