English
Related papers

Related papers: Reducing the Long Tail Losses in Scientific Emulat…

200 papers

At its core, this thesis aims to enhance the practicality of deep learning by improving the label and training efficiency of deep learning models. To this end, we investigate data subset selection techniques, specifically active learning…

Machine Learning · Computer Science 2024-03-11 Andreas Kirsch

Active learning (AL) is a prominent technique for reducing the annotation effort required for training machine learning models. Deep learning offers a solution for several essential obstacles to deploying AL in practice but introduces many…

Computation and Language · Computer Science 2022-05-10 Akim Tsvigun , Artem Shelmanov , Gleb Kuzmin , Leonid Sanochkin , Daniil Larionov , Gleb Gusev , Manvel Avetisian , Leonid Zhukov

We study different aspects of active learning with deep neural networks in a consistent and unified way. i) We investigate incremental and cumulative training modes which specify how the newly labeled data are used for training. ii) We…

Machine Learning · Computer Science 2023-01-02 John Daniel Bossér , Erik Sörstadius , Morteza Haghir Chehreghani

Long-tailed data is prevalent in real-world classification tasks and heavily relies on supervised information, which makes the annotation process exceptionally labor-intensive and time-consuming. Unfortunately, despite being a common…

Machine Learning · Computer Science 2024-12-04 Meng Wei , Zhongnian Li , Yong Zhou , Xinzheng Xu

Active learning aims to reduce the high labeling cost involved in training machine learning models on large datasets by efficiently labeling only the most informative samples. Recently, deep active learning has shown success on various…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Sudhanshu Mittal , Maxim Tatarchenko , Özgün Çiçek , Thomas Brox

Active learning aims to reduce the labeling effort that is required to train algorithms by learning an acquisition function selecting the most relevant data for which a label should be requested from a large unlabeled data pool. Active…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Javad Zolfaghari Bengar , Joost van de Weijer , Laura Lopez Fuentes , Bogdan Raducanu

The success of deep learning depends on large-scale and well-curated training data, while data in real-world applications are commonly long-tailed and noisy. Many methods have been proposed to deal with long-tailed data or noisy data, while…

Machine Learning · Computer Science 2023-05-30 Lefan Zhang , Zhang-Hao Tian , Wujun Zhou , Wei Wang

Active learning is of great interest for many practical applications, especially in industry and the physical sciences, where there is a strong need to minimize the number of costly experiments necessary to train predictive models. However,…

Machine Learning · Computer Science 2021-12-23 Maryam Pardakhti , Nila Mandal , Anson W. K. Ma , Qian Yang

There has been significant progress in creating machine learning models that identify objects in scenes along with their associated attributes and relationships; however, there is a large gap between the best models and human capabilities.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Tyler L. Hayes , Maximilian Nickel , Christopher Kanan , Ludovic Denoyer , Arthur Szlam

While deep learning is a powerful tool for natural language processing (NLP) problems, successful solutions to these problems rely heavily on large amounts of annotated samples. However, manually annotating data is expensive and…

Computation and Language · Computer Science 2021-04-06 Rishi Hazra , Parag Dutta , Shubham Gupta , Mohammed Abdul Qaathir , Ambedkar Dukkipati

While deep learning is a powerful tool for natural language processing (NLP) problems, successful solutions to these problems rely heavily on large amounts of annotated samples. However, manually annotating data is expensive and…

Machine Learning · Computer Science 2021-04-08 Rishi Hazra , Parag Dutta , Shubham Gupta , Mohammed Abdul Qaathir , Ambedkar Dukkipati

Long-tailed learning has attracted much attention recently, with the goal of improving generalisation for tail classes. Most existing works use supervised learning without considering the prevailing noise in the training dataset. To move…

Machine Learning · Computer Science 2021-08-27 Tong Wei , Jiang-Xin Shi , Wei-Wei Tu , Yu-Feng Li

Deploying deep models in real-world scenarios entails a number of challenges, including computational efficiency and real-world (e.g., long-tailed) data distributions. We address the combined challenge of learning long-tailed distributions…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jihun Kim , Dahyun Kim , Hyungrok Jung , Taeil Oh , Jonghyun Choi

Optimal design for model training is a critical topic in machine learning. Active Learning aims at obtaining improved models by querying samples with maximum uncertainty according to the estimation model for artificially labeling; this has…

Most of the existing learning models, particularly deep neural networks, are reliant on large datasets whose hand-labeling is expensive and time demanding. A current trend is to make the learning of these models frugal and less dependent on…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Sebastien Deschamps , Hichem Sahbi

Deep long-tailed learning, one of the most challenging problems in visual recognition, aims to train well-performing deep models from a large number of images that follow a long-tailed class distribution. In the last decade, deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yifan Zhang , Bingyi Kang , Bryan Hooi , Shuicheng Yan , Jiashi Feng

While deep learning (DL) is data-hungry and usually relies on extensive labeled data to deliver good performance, Active Learning (AL) reduces labeling costs by selecting a small proportion of samples from unlabeled data for labeling and…

Machine Learning · Computer Science 2022-07-20 Xueying Zhan , Qingzhong Wang , Kuan-hao Huang , Haoyi Xiong , Dejing Dou , Antoni B. Chan

Active learning aims to develop label-efficient algorithms by querying the most informative samples to be labeled by an oracle. The design of efficient training methods that require fewer labels is an important research direction that…

Computer Vision and Pattern Recognition · Computer Science 2019-12-23 Ali Mottaghi , Serena Yeung

Active learning (AL) is a machine learning algorithm that can achieve greater accuracy with fewer labeled training instances, for having the ability to ask oracles to label the most valuable unlabeled data chosen iteratively and…

Machine Learning · Computer Science 2022-09-30 Ruoyu Wang

One of the most profound challenges of modern machine learning is performing well on the long-tail of rare and underrepresented features. Large general-purpose models are trained for many tasks, but work best on high-frequency use cases.…

Computation and Language · Computer Science 2025-06-18 Daniel D'souza , Julia Kreutzer , Adrien Morisot , Ahmet Üstün , Sara Hooker
‹ Prev 1 2 3 10 Next ›