English
Related papers

Related papers: Low Resource Text Classification with ULMFit and B…

200 papers

In recent times training Language Models (LMs) have relied on computationally heavy training over massive datasets which makes this training process extremely laborious. In this paper we propose a novel method for numerically evaluating…

In-context learning (ICL) of large language models (LLMs) has attracted increasing attention in the community where LLMs make predictions only based on instructions augmented with a few examples. Existing example selection methods for ICL…

Computation and Language · Computer Science 2024-08-26 Haowei Du , Dongyan Zhao

The absence of large labeled datasets remains a significant challenge in many application areas of deep learning. Researchers and practitioners typically resort to transfer learning and data augmentation to alleviate this issue. We study…

Sound · Computer Science 2022-11-01 Paul Primus , Gerhard Widmer

Multilingual large language models (LLMs) are great translators, but this is largely limited to high-resource languages. For many LLMs, translating in and out of low-resource languages remains a challenging task. To maximize data efficiency…

Computation and Language · Computer Science 2025-11-11 Zheng Wei Lim , Nitish Gupta , Honglin Yu , Trevor Cohn

Data augmentation is a commonly used technique for increasing both the size and the diversity of labeled training sets by leveraging input transformations that preserve output labels. In computer vision domain, image augmentations have…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Alexander Buslaev , Alex Parinov , Eugene Khvedchenya , Vladimir I. Iglovikov , Alexandr A. Kalinin

Large video-language models (VLMs) have demonstrated promising progress in various video understanding tasks. However, their effectiveness in long-form video analysis is constrained by limited context windows. Traditional approaches, such…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Shuming Liu , Chen Zhao , Tianqi Xu , Bernard Ghanem

Multilingual NMT is a viable solution for translating low-resource languages (LRLs) when data from high-resource languages (HRLs) from the same language family is available. However, the training schedule, i.e. the order of presentation of…

Computation and Language · Computer Science 2025-06-03 Alexis Allemann , Àlex R. Atrio , Andrei Popescu-Belis

Multilingual text recognition (MLTR) systems typically focus on a fixed set of languages, which makes it difficult to handle newly added languages or adapt to ever-changing data distribution. In this paper, we propose the Incremental MLTR…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Tianlun Zheng , Zhineng Chen , BingChen Huang , Wei Zhang , Yu-Gang Jiang

The ability of generative large language models (LLMs) to perform in-context learning has given rise to a large body of research into how best to prompt models for various natural language processing tasks. In this paper, we focus on…

Computation and Language · Computer Science 2024-08-02 Armel Zebaze , Benoît Sagot , Rachel Bawden

Deep learning-based text classification models need abundant labeled data to obtain competitive performance. Unfortunately, annotating large-size corpus is time-consuming and laborious. To tackle this, multiple researches try to use data…

Computation and Language · Computer Science 2023-02-03 Xiaotian Lin , Nankai Lin , Yingwen Fu , Ziyu Yang , Shengyi Jiang

The scarcity and class imbalance of training data are known issues in current rumor detection tasks. We propose a straight-forward and general-purpose data augmentation technique which is beneficial to early rumor detection relying on event…

Computation and Language · Computer Science 2019-07-17 Sooji Han , Jie Gao , Fabio Ciravegna

This paper presents our system developed for the SemEval-2025 Task 9: The Food Hazard Detection Challenge. The shared task's objective is to evaluate explainable classification systems for classifying hazards and products in two levels of…

Computation and Language · Computer Science 2025-04-30 Foteini Papadopoulou , Osman Mutlu , Neris Özen , Bas H. M. van der Velden , Iris Hendrickx , Ali Hürriyetoğlu

Unbiased learning-to-rank (ULTR) is a well-established framework for learning from user clicks, which are often biased by the ranker collecting the data. While theoretically justified and extensively tested in simulation, ULTR techniques…

Information Retrieval · Computer Science 2024-05-16 Philipp Hager , Romain Deffayet , Jean-Michel Renders , Onno Zoeter , Maarten de Rijke

Data augmentation is a widely used technique for improving model performance in machine learning, particularly in computer vision and natural language processing. Recently, there has been increasing interest in applying augmentation…

Machine Learning · Computer Science 2023-05-05 Raad Khraishi , Ramin Okhrati

Real-world text classification tasks often require many labeled training examples that are expensive to obtain. Recent advancements in machine teaching, specifically the data programming paradigm, facilitate the creation of training data…

Machine Learning · Computer Science 2020-02-05 Neil Mallinar , Abhishek Shah , Tin Kam Ho , Rajendra Ugrani , Ayush Gupta

Embedding models are crucial for various natural language processing tasks but can be limited by factors such as limited vocabulary, lack of context, and grammatical errors. This paper proposes a novel approach to improve embedding…

Computation and Language · Computer Science 2024-04-19 Nicholas Harris , Anand Butani , Syed Hashmy

The ever-growing volume of data of user-generated content on social media provides a nearly unlimited corpus of unlabeled data even in languages where resources are scarce. In this paper, we demonstrate that state-of-the-art results on two…

Machine Learning · Computer Science 2019-12-18 Thanapapas Horsuwan , Kasidis Kanwatchara , Peerapon Vateekul , Boonserm Kijsirikul

Large Language Models (LLMs) have shown strong capabilities in document re-ranking, a key component in modern Information Retrieval (IR) systems. However, existing LLM-based approaches face notable limitations, including ranking…

Information Retrieval · Computer Science 2025-10-03 Pinhuan Wang , Zhiqiu Xia , Chunhua Liao , Feiyi Wang , Hang Liu

For most languages of the world, language model pre-training operates in a data-constrained regime where models must repeat their training data many times, degrading generalization. Two remedies exist: aggressive hyperparameter tuning such…

Machine Learning · Computer Science 2026-05-14 Paul Jeha , Anastasiia Sedova , Louis Béthune , Skyler Seto , Jes Frellsen , Pierre Ablin , Natalie Schluter

Neural machine translation (NMT) has recently gained widespread attention because of its high translation accuracy. However, it shows poor performance in the translation of long sentences, which is a major issue in low-resource languages.…

Computation and Language · Computer Science 2021-04-20 Seiichiro Kondo , Kengo Hotate , Masahiro Kaneko , Mamoru Komachi