English
Related papers

Related papers: Fast Few-shot Debugging for NLU Test Suites

200 papers

Current natural language interaction for self-tracking tools largely depends on bespoke implementation optimized for a specific tracking theme and data format, which is neither generalizable nor scalable to a tremendous design space of…

Computation and Language · Computer Science 2022-06-08 Young-Ho Kim , Sungdong Kim , Minsuk Chang , Sang-Woo Lee

Few-shot learning (FSL) commonly requires a model to identify images (queries) that belong to classes unseen during training, based on a few labelled samples of the new classes (support set) as reference. So far, plenty of algorithms…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Yunwei Bai , Ying Kiat Tan , Shiming Chen , Yao Shu , Tsuhan Chen

In a spoken dialogue system, an NLU model is preceded by a speech recognition system that can deteriorate the performance of natural language understanding. This paper proposes a method for investigating the impact of speech recognition…

Computation and Language · Computer Science 2023-10-26 Marek Kubis , Paweł Skórzewski , Marcin Sowański , Tomasz Ziętkiewicz

Few-shot learning (FSL) has emerged as an effective learning method and shows great potential. Despite the recent creative works in tackling FSL tasks, learning valid information rapidly from just a few or even zero samples still remains a…

Machine Learning · Computer Science 2022-05-25 Yisheng Song , Ting Wang , Subrota K Mondal , Jyoti Prakash Sahoo

Over the last couple of years few-shot learning (FSL) has attracted great attention towards minimizing the dependency on labeled training examples. An inherent difficulty in FSL is the handling of ambiguities resulting from having too few…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Orhun Buğra Baran , Ramazan Gökberk Cinbiş

Recently, Transformer-based language models have demonstrated remarkable performance across many NLP domains. However, the unsupervised pre-training step of these models suffers from unbearable overall computational expenses. Current…

Machine Learning · Computer Science 2020-10-27 Minjia Zhang , Yuxiong He

Objective: Few-shot learning (FSL) methods require small numbers of labeled instances for training. As many medical topics have limited annotated textual data in practical settings, FSL-based natural language processing (NLP) methods hold…

Computation and Language · Computer Science 2022-05-02 Yao Ge , Yuting Guo , Yuan-Chi Yang , Mohammed Ali Al-Garadi , Abeed Sarker

Most recent progress in natural language understanding (NLU) has been driven, in part, by benchmarks such as GLUE, SuperGLUE, SQuAD, etc. In fact, many NLU models have now matched or exceeded "human-level" performance on many tasks in these…

Few-shot classification consists of learning a predictive model that is able to effectively adapt to a new class, given only a few annotated samples. To solve this challenging problem, meta-learning has become a popular paradigm that…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Nikita Dvornik , Cordelia Schmid , Julien Mairal

Intent detection is one of the core components of goal-oriented dialog systems, and detecting out-of-scope (OOS) intents is also a practically important skill. Few-shot learning is attracting much attention to mitigate data scarcity, but…

Computation and Language · Computer Science 2020-10-27 Jian-Guo Zhang , Kazuma Hashimoto , Wenhao Liu , Chien-Sheng Wu , Yao Wan , Philip S. Yu , Richard Socher , Caiming Xiong

Natural Language Inference (NLI) evaluation is crucial for assessing language understanding models; however, popular datasets suffer from systematic spurious correlations that artificially inflate actual model performance. To address this,…

Computation and Language · Computer Science 2024-10-07 Adrian Cosma , Stefan Ruseti , Mihai Dascalu , Cornelia Caragea

Explicit decomposition modeling, which involves breaking down complex tasks into more straightforward and often more interpretable sub-tasks, has long been a central theme in developing robust and interpretable NLU systems. However, despite…

Computation and Language · Computer Science 2022-11-01 Ben Zhou , Kyle Richardson , Xiaodong Yu , Dan Roth

Deep learning-based methods in computational microscopy have been shown to be powerful but in general face some challenges due to limited generalization to new types of samples and requirements for large and diverse training data. Here, we…

Image and Video Processing · Electrical Eng. & Systems 2022-06-13 Luzhe Huang , Xilin Yang , Tairan Liu , Aydogan Ozcan

Attentional sequence-to-sequence models have become the new standard for machine translation, but one challenge of such models is a significant increase in training and decoding cost compared to phrase-based systems. Here, we focus on…

Computation and Language · Computer Science 2017-05-08 Jacob Devlin

Neural-based end-to-end approaches to natural language generation (NLG) from structured data or knowledge are data-hungry, making their adoption for real-world applications difficult with limited data. In this work, we propose the new task…

Computation and Language · Computer Science 2020-04-21 Zhiyu Chen , Harini Eavani , Wenhu Chen , Yinyin Liu , William Yang Wang

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Qianru Sun , Yaoyao Liu , Tat-Seng Chua , Bernt Schiele

Transformer-based models have achieved stateof-the-art results in many tasks in natural language processing. However, such models are usually slow at inference time, making deployment difficult. In this paper, we develop an efficient…

Machine Learning · Computer Science 2020-08-18 Henry Tsai , Jayden Ooi , Chun-Sung Ferng , Hyung Won Chung , Jason Riesa

Deep neural networks often encounter significant performance drops while facing with domain shifts between training (source) and test (target) data. To address this issue, Test Time Adaptation (TTA) methods have been proposed to adapt…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Siqi Luo , Yi Xin , Yuntao Du , Tao Tan , Guangtao Zhai , Xiaohong Liu

Most of the recent few-shot learning (FSL) algorithms are based on transfer learning, where a model is pre-trained using a large amount of source data, and the pre-trained model is fine-tuned using a small amount of target data. In transfer…

Machine Learning · Computer Science 2022-08-22 Yujin Kim , Jaehoon Oh , Sungnyun Kim , Se-Young Yun

We address the challenge of detecting synthesized speech under distribution shifts -- arising from unseen synthesis methods, speakers, languages, or audio conditions -- relative to the training data. Few-shot learning methods are a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-20 Ashi Garg , Zexin Cai , Henry Li Xinyuan , Leibny Paola García-Perera , Kevin Duh , Sanjeev Khudanpur , Matthew Wiesner , Nicholas Andrews