English
Related papers

Related papers: Small-Text: Active Learning for Text Classificatio…

200 papers

In this work, we propose the use of a fully managed machine learning service, which utilizes active learning to directly build models from unstructured data. With this tool, business users can quickly and easily build machine learning…

Machine Learning · Computer Science 2021-02-02 Teja Kanchinadam , Qian You , Keith Westpfahl , James Kim , Siva Gunda , Sebastian Seith , Glenn Fung

Word embeddings have become essential components in various information retrieval and natural language processing tasks, such as ranking, document classification, and question answering. However, despite their widespread use, traditional…

Computation and Language · Computer Science 2025-07-01 Gabriel Iturra-Bocaz , Felipe Bravo-Marquez

Active learning is designed to minimize annotation efforts by prioritizing instances that most enhance learning. However, many active learning strategies struggle with a `cold-start' problem, needing substantial initial data to be…

Computation and Language · Computer Science 2026-01-14 Markus Bayer , Justin Lutz , Christian Reuter

This paper presents a novel approach to assist students with dyslexia, ADHD, and short attention span in digesting any text-based information more efficiently. The proposed solution utilizes the Multilayer Perceptron (MLP) algorithm for…

This paper explores semi-supervised training for sequence tasks, such as Optical Character Recognition or Automatic Speech Recognition. We propose a novel loss function $\unicode{x2013}$ SoftCTC $\unicode{x2013}$ which is an extension of…

Machine Learning · Computer Science 2023-09-20 Martin Kišš , Michal Hradiš , Karel Beneš , Petr Buchal , Michal Kula

This paper presents the impact of using quantization on the efficiency of multi-class text classification in the training process of a support vector machine (SVM). This work is focused on comparing the efficiency of SVM model trained using…

Machine Learning · Computer Science 2020-07-20 Dominik Żurek , Marcin Pietroń

Supervised machine learning methods usually require a large set of labeled examples for model training. However, in many real applications, there are plentiful unlabeled data but limited labeled data; and the acquisition of labels is…

Machine Learning · Computer Science 2019-01-15 Ying-Peng Tang , Guo-Xiang Li , Sheng-Jun Huang

Recent few-shot methods, such as parameter-efficient fine-tuning (PEFT) and pattern exploiting training (PET), have achieved impressive results in label-scarce settings. However, they are difficult to employ since they are subject to high…

Computation and Language · Computer Science 2022-09-23 Lewis Tunstall , Nils Reimers , Unso Eun Seo Jo , Luke Bates , Daniel Korat , Moshe Wasserblat , Oren Pereg

Securing a sufficient amount of paired data is important to train an image-text retrieval (ITR) model, but collecting paired data is very expensive. To address this issue, in this paper, we propose an active learning algorithm for ITR that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Dae Ung Jo , Kyuewang Lee , JaeHo Chung , Jin Young Choi

Self-training provides an effective means of using an extremely small amount of labeled data to create pseudo-labels for unlabeled data. Many state-of-the-art self-training approaches hinge on different regularization methods to prevent…

Computation and Language · Computer Science 2022-02-08 Hazel Kim , Jaeman Son , Yo-Sub Han

A recently introduced text classifier, called SS3, has obtained state-of-the-art performance on the CLEF's eRisk tasks. SS3 was created to deal with risk detection over text streams and, therefore, not only supports incremental training and…

Machine Learning · Computer Science 2020-07-21 Sergio G. Burdisso , Marcelo Errecalde , Manuel Montes-y-Gómez

Large language models have shown their remarkable capabilities as a general interface for various language-related applications. Motivated by this, we target to build a unified interface for completing many vision-language tasks including…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Jun Chen , Deyao Zhu , Xiaoqian Shen , Xiang Li , Zechun Liu , Pengchuan Zhang , Raghuraman Krishnamoorthi , Vikas Chandra , Yunyang Xiong , Mohamed Elhoseiny

Traditional text classifiers are limited to predicting over a fixed set of labels. However, in many real-world applications the label set is frequently changing. For example, in intent classification, new intents may be added over time…

Machine Learning · Computer Science 2019-11-05 Jeremy Wohlwend , Ethan R. Elenberg , Samuel Altschul , Shawn Henry , Tao Lei

The paper [1] shows that simple linear classifier can compete with complex deep learning algorithms in text classification applications. Combining bag of words (BoW) and linear classification techniques, fastText [1] attains same or only…

Computation and Language · Computer Science 2017-02-21 Vladimir Zolotov , David Kung

In many real-world applications, the frequency distribution of class labels for training data can exhibit a long-tailed distribution, which challenges traditional approaches of training deep neural networks that require heavy amounts of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Richard Franklin , Jiawei Yao , Deyang Zhong , Qi Qian , Juhua Hu

With the increased availability of rich tactile sensors, there is an equally proportional need for open-source and integrated software capable of efficiently and effectively processing raw touch measurements into high-level signals that can…

Robotics · Computer Science 2021-05-28 Mike Lambeta , Huazhe Xu , Jingwei Xu , Po-Wei Chou , Shaoxiong Wang , Trevor Darrell , Roberto Calandra

py-irt is a Python library for fitting Bayesian Item Response Theory (IRT) models. py-irt estimates latent traits of subjects and items, making it appropriate for use in IRT tasks as well as ideal-point models. py-irt is built on top of the…

Computation and Language · Computer Science 2022-11-16 John P. Lalor , Pedro Rodriguez

Recent efforts in fine-tuning language models often rely on automatic data selection, commonly using Nearest Neighbors retrieval from large datasets. However, we theoretically show that this approach tends to select redundant data, limiting…

Machine Learning · Computer Science 2025-02-11 Jonas Hübotter , Sascha Bongni , Ido Hakimi , Andreas Krause

Few-shot text classification aims to classify the text under the few-shot scenario. Most of the previous methods adopt optimization-based meta learning to obtain task distribution. However, due to the neglect of matching between the few…

Computation and Language · Computer Science 2023-07-31 Tianyi Lei , Honghui Hu , Qiaoyang Luo , Dezhong Peng , Xu Wang

Textless spoken language processing research aims to extend the applicability of standard NLP toolset onto spoken language and languages with few or no textual resources. In this paper, we introduce textless-lib, a PyTorch-based library…