English
Related papers

Related papers: On the Importance of Adaptive Data Collection for …

200 papers

In this paper we propose an active metric learning method for clustering with pairwise constraints. The proposed method actively queries the label of informative instance pairs, while estimating underlying metrics by incorporating unlabeled…

Machine Learning · Statistics 2021-11-10 Yujia Deng , Yubai Yuan , Haoda Fu , Annie Qu

Recent empirical works have successfully used unlabeled data to learn feature representations that are broadly useful in downstream classification tasks. Several of these methods are reminiscent of the well-known word2vec embedding…

Machine Learning · Computer Science 2019-02-26 Sanjeev Arora , Hrishikesh Khandeparkar , Mikhail Khodak , Orestis Plevrakis , Nikunj Saunshi

Rooting in the scarcity of most attributes, realistic pedestrian attribute datasets exhibit unduly skewed data distribution, from which two types of model failures are delivered: (1) label imbalance: model predictions lean greatly towards…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Yibo Zhou , Hai-Miao Hu , Yirong Xiang , Xiaokang Zhang , Haotian Wu

Since state-of-the-art approaches to offensive language detection rely on supervised learning, it is crucial to quickly adapt them to the continuously evolving scenario of social media. While several approaches have been proposed to tackle…

Computation and Language · Computer Science 2022-10-17 Elisa Leonardelli , Stefano Menini , Alessio Palmero Aprosio , Marco Guerini , Sara Tonelli

Obtaining labeled data for machine learning tasks can be prohibitively expensive. Active learning mitigates this issue by exploring the unlabeled data space and prioritizing the selection of data that can best improve the model performance.…

Machine Learning · Computer Science 2021-04-21 Vineeth Rakesh , Swayambhoo Jain

Deep learning models have demonstrated outstanding performance in several problems, but their training process tends to require immense amounts of computational and human resources for training and labeling, constraining the types of…

Machine Learning · Computer Science 2019-04-29 Toan Tran , Thanh-Toan Do , Ian Reid , Gustavo Carneiro

In practical scenario, relation extraction needs to first identify entity pairs that have relation and then assign a correct relation class. However, the number of non-relation entity pairs in context (negative instances) usually far…

Computation and Language · Computer Science 2019-06-24 Wei Ye , Bo Li , Rui Xie , Zhonghao Sheng , Long Chen , Shikun Zhang

With the rapid growth of memory and computing power, datasets are becoming increasingly complex and imbalanced. This is especially severe in the context of clinical data, where there may be one rare event for many cases in the majority…

Optimizing deep learning models requires large amounts of annotated images, a process that is both time-intensive and costly. Especially for semantic segmentation models in which every pixel must be annotated. A potential strategy to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Bart M. van Marrewijk , Charbel Dandjinou , Dan Jeric Arcega Rustia , Nicolas Franco Gonzalez , Boubacar Diallo , Jérôme Dias , Paul Melki , Pieter M. Blok

Popular zero-shot models suffer due to artifacts inherited from pretraining. One particularly detrimental issue, caused by unbalanced web-scale pretraining data, is mismatched label distribution. Existing approaches that seek to repair the…

Machine Learning · Computer Science 2024-10-31 Changho Shin , Jitian Zhao , Sonia Cromp , Harit Vishwakarma , Frederic Sala

Despite strong performance in many sequence-to-sequence tasks, autoregressive models trained with maximum likelihood estimation suffer from exposure bias, i.e. the discrepancy between the ground-truth prefixes used during training and the…

Computation and Language · Computer Science 2023-01-11 Michalis Korakakis , Andreas Vlachos

We present a systematic investigation of layer-wise BERT activations for general-purpose text representations to understand what linguistic information they capture and how transferable they are across different tasks. Sentence-level…

Computation and Language · Computer Science 2019-10-25 Xiaofei Ma , Zhiguo Wang , Patrick Ng , Ramesh Nallapati , Bing Xiang

Despite the recent advances in multi-task learning of dense prediction problems, most methods rely on expensive labelled datasets. In this paper, we present a label efficient approach and look at jointly learning of multiple dense…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Wei-Hong Li , Xialei Liu , Hakan Bilen

Typical active learning strategies are designed for tasks, such as classification, with the assumption that the output space is mutually exclusive. The assumption that these tasks always have exactly one correct answer has resulted in the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Khaled Jedoui , Ranjay Krishna , Michael Bernstein , Li Fei-Fei

Supervised machine learning often requires large training sets to train accurate models, yet obtaining large amounts of labeled data is not always feasible. Hence, it becomes crucial to explore active learning methods for reducing the size…

Machine Learning · Computer Science 2024-04-16 Ashna Jose , Emilie Devijver , Massih-Reza Amini , Noel Jakse , Roberta Poloni

Fully supervised models are predominant in Bayesian active learning. We argue that their neglect of the information present in unlabelled data harms not just predictive performance but also decisions about what data to acquire. Our proposed…

Machine Learning · Computer Science 2024-04-29 Freddie Bickford Smith , Adam Foster , Tom Rainforth

With the advent of big data across multiple high-impact applications, we are often facing the challenge of complex heterogeneity. The newly collected data usually consist of multiple modalities and are characterized with multiple labels,…

Machine Learning · Computer Science 2022-07-27 Lecheng Zheng , Jinjun Xiong , Yada Zhu , Jingrui He

Imbalanced datasets present a significant challenge for machine learning models, often leading to biased predictions. To address this issue, data augmentation techniques are widely used in natural language processing (NLP) to generate new…

Computation and Language · Computer Science 2023-04-21 Gabriel O. Assunção , Rafael Izbicki , Marcos O. Prates

Active learning is able to reduce the amount of labelling effort by using a machine learning model to query the user for specific inputs. While there are many papers on new active learning techniques, these techniques rarely satisfy the…

Machine Learning · Computer Science 2020-06-18 Parmida Atighehchian , Frédéric Branchaud-Charron , Alexandre Lacoste

Supervised learning from training data with imbalanced class sizes, a commonly encountered scenario in real applications such as anomaly/fraud detection, has long been considered a significant challenge in machine learning. Motivated by…

Machine Learning · Computer Science 2019-05-27 Yunru Liu , Tingran Gao , Haizhao Yang