English
Related papers

Related papers: Intent Classification on Low-Resource Languages wi…

200 papers

Intent detection is one of the core components of goal-oriented dialog systems, and detecting out-of-scope (OOS) intents is also a practically important skill. Few-shot learning is attracting much attention to mitigate data scarcity, but…

Computation and Language · Computer Science 2020-10-27 Jian-Guo Zhang , Kazuma Hashimoto , Wenhao Liu , Chien-Sheng Wu , Yao Wan , Philip S. Yu , Richard Socher , Caiming Xiong

Data availability and quality are major challenges in natural language processing for low-resourced languages. In particular, there is significantly less data available than for higher-resourced languages. This data is also often of low…

Computation and Language · Computer Science 2023-11-28 Manuel Fokam , Michael Beukman

In-context learning (ICL) using large language models for tasks with many labels is challenging due to the limited context window, which makes it difficult to fit a sufficient number of examples in the prompt. In this paper, we use a…

Computation and Language · Computer Science 2023-12-07 Aristides Milios , Siva Reddy , Dzmitry Bahdanau

As information retrieval systems continue to evolve, accurate evaluation and benchmarking of these systems become pivotal. Web search datasets, such as MS MARCO, primarily provide short keyword queries without accompanying intent or…

Information Retrieval · Computer Science 2024-09-02 Abhijit Anand , Jurek Leonhardt , V Venktesh , Avishek Anand

Machine translation in low-resource language pairs faces significant challenges due to the scarcity of parallel corpora and linguistic resources. This study focuses on the case of English-Marathi language pairs, where existing datasets are…

Computation and Language · Computer Science 2024-09-05 Nidhi Kowtal , Tejas Deshpande , Raviraj Joshi

Despite the growing importance of multilingual aspect of web search, no appropriate offline metrics to evaluate its quality are proposed so far. At the same time, personal language preferences can be regarded as intents of a query. This…

Information Retrieval · Computer Science 2016-12-15 Alexey Drutsa , Andrey Shutovich , Philipp Pushnyakov , Evgeniy Krokhalyov , Gleb Gusev , Pavel Serdyukov

Deep neural networks have demonstrated their superior performance in almost every Natural Language Processing task, however, their increasing complexity raises concerns. In particular, these networks require high expenses on computational…

Machine Learning · Computer Science 2020-10-13 Harshil Jain , Akshat Agarwal , Kumar Shridhar , Denis Kleyko

Open intent classification is a practical yet challenging task in dialogue systems. Its objective is to accurately classify samples of known intents while at the same time detecting those of open (unknown) intents. Existing methods usually…

Computation and Language · Computer Science 2022-05-10 Zifeng Cheng , Zhiwei Jiang , Yafeng Yin , Cong Wang , Qing Gu

Query reformulation is a well-known problem in Information Retrieval (IR) aimed at enhancing single search successful completion rate by automatically modifying user's input query. Recent methods leverage Large Language Models (LLMs) to…

Information Retrieval · Computer Science 2024-09-18 Wonduk Seo , Haojie Zhang , Yueyang Zhang , Changhao Zhang , Songyao Duan , Lixin Su , Daiting Shi , Jiashu Zhao , Dawei Yin

Ranking is at the core of Information Retrieval. Classic ranking optimization studies often treat ranking as a sorting problem with the assumption that the best performance of ranking would be achieved if we rank items according to their…

Information Retrieval · Computer Science 2023-04-18 Qingyao Ai , Xuanhui Wang , Michael Bendersky

This work falls in the areas of information retrieval and semantic web, and aims to improve the evaluation of web search tools. Indeed, the huge number of information on the web as well as the growth of new inexperienced users creates new…

Information Retrieval · Computer Science 2012-12-12 Abdelkrim Bouramoul , Mohamed-Khireddine Kholladi , Bich-Liên Doan

Intent classifiers are vital to the successful operation of virtual agent systems. This is especially so in voice activated systems where the data can be noisy with many ambiguous directions for user intents. Before operation begins, these…

Computation and Language · Computer Science 2022-02-22 Zvi Kons , Aharon Satt , Hong-Kwang Kuo , Samuel Thomas , Boaz Carmeli , Ron Hoory , Brian Kingsbury

Practical sequence classification tasks in natural language processing often suffer from low training data availability for target classes. Recent works towards mitigating this problem have focused on transfer learning using embeddings…

Computation and Language · Computer Science 2021-01-29 Manoj Kumar , Varun Kumar , Hadrien Glaude , Cyprien delichy , Aman Alok , Rahul Gupta

New intent discovery is of great value to natural language processing, allowing for a better understanding of user needs and providing friendly services. However, most existing methods struggle to capture the complicated semantics of…

Computation and Language · Computer Science 2023-12-14 Hanlei Zhang , Hua Xu , Xin Wang , Fei Long , Kai Gao

This paper proposes an efficient example sampling method for example-based word sense disambiguation systems. To construct a database of practical size, a considerable overhead for manual sense disambiguation (overhead for supervision) is…

Computation and Language · Computer Science 2007-05-23 Atsushi Fujii , Kentaro Inui , Takenobu Tokunaga , Hozumi Tanaka

This tutorial (https://tum-nlp.github.io/low-resource-tutorial) is designed for NLP practitioners, researchers, and developers working with multilingual and low-resource languages who seek to create more equitable and socially impactful…

Computation and Language · Computer Science 2025-12-17 Ekaterina Artemova , Laurie Burchell , Daryna Dementieva , Shu Okabe , Mariya Shmatova , Pedro Ortiz Suarez

Text matching systems have become a fundamental service in most searching platforms. For instance, they are responsible for matching user queries to relevant candidate items, or rewriting the user-input query to a pre-selected…

Computation and Language · Computer Science 2024-02-13 Mingzhe Li , Xiuying Chen , Jing Xiang , Qishen Zhang , Changsheng Ma , Chenchen Dai , Jinxiong Chang , Zhongyi Liu , Guannan Zhang

The intent recognition is an essential algorithm of any conversational AI application. It is responsible for the classification of an input message into meaningful classes. In many bot development platforms, we can configure the NLU…

Computation and Language · Computer Science 2021-10-06 Petr Lorenc , Petr Marek , Jan Pichl , Jakub Konrád , Jan Šedivý

Entity matching, a core data integration problem, is the task of deciding whether two data tuples refer to the same real-world entity. Recent advances in deep learning methods, using pre-trained language models, were proposed for resolving…

Databases · Computer Science 2023-11-28 Bar Genossar , Avigdor Gal , Roee Shraga

Intent classification (IC) and slot filling (SF) are critical building blocks in task-oriented dialogue systems. These two tasks are closely-related and can flourish each other. Since only a few utterances can be utilized for identifying…

Computation and Language · Computer Science 2021-10-27 Han Liu , Feng Zhang , Xiaotong Zhang , Siyang Zhao , Xianchao Zhang