English
Related papers

Related papers: Augmented Natural Language for Generative Sequence…

200 papers

Spoken language understanding (SLU) treats automatic speech recognition (ASR) and natural language understanding (NLU) as a unified task and usually suffers from data scarcity. We exploit an ASR and NLU joint training method based on meta…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Yingying Gao , Junlan Feng , Chao Deng , Shilei Zhang

The rapid advancement in self-supervised representation learning has highlighted its potential to leverage unlabeled data for learning rich visual representations. However, the existing techniques, particularly those employing different…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Sana Ayromlou , Vahid Reza Khazaie , Fereshteh Forghani , Arash Afkanpour

Human learning benefits from multi-modal inputs that often appear as rich semantics (e.g., description of an object's attributes while learning about it). This enables us to learn generalizable concepts from very limited visual examples.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Mohamed Afham , Salman Khan , Muhammad Haris Khan , Muzammal Naseer , Fahad Shahbaz Khan

Natural Language Generation (NLG) is a key component in a task-oriented dialogue system, which converts the structured meaning representation (MR) to the natural language. For large-scale conversational systems, where it is common to have…

Computation and Language · Computer Science 2021-06-11 Xinnuo Xu , Guoyin Wang , Young-Bum Kim , Sungjin Lee

Generative Adversarial Networks (GANs) produce systematically better quality samples when class label information is provided., i.e. in the conditional GAN setup. This is still observed for the recently proposed Wasserstein GAN formulation…

Machine Learning · Statistics 2018-05-18 Guillermo L. Grinblat , Lucas C. Uzal , Pablo M. Granitto

We introduce a novel multi-agent collaboration framework designed to enhance the accuracy and robustness of text classification models. Leveraging BERT as the primary classifier, our framework dynamically escalates low-confidence…

Computation and Language · Computer Science 2025-02-27 Hediyeh Baban , Sai A Pidapar , Aashutosh Nema , Sichen Lu

With the continuous development of natural language processing (NLP) technology, text classification tasks have been widely used in multiple application fields. However, obtaining labeled data is often expensive and difficult, especially in…

Computation and Language · Computer Science 2025-02-14 Jia Gao , Shuangquan Lyu , Guiran Liu , Binrong Zhu , Hongye Zheng , Xiaoxuan Liao

We propose a unified neural network architecture and learning algorithm that can be applied to various natural language processing tasks including: part-of-speech tagging, chunking, named entity recognition, and semantic role labeling. This…

Machine Learning · Computer Science 2011-03-03 Ronan Collobert , Jason Weston , Leon Bottou , Michael Karlen , Koray Kavukcuoglu , Pavel Kuksa

In medical image segmentation, supervised deep networks' success comes at the cost of requiring abundant labeled data. While asking domain experts to annotate only one or a few of the cohort's images is feasible, annotating all available…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Devavrat Tomar , Behzad Bozorgtabar , Manana Lortkipanidze , Guillaume Vray , Mohammad Saeed Rad , Jean-Philippe Thiran

Despite recent advances, the remaining bottlenecks in deep generative models are necessity of extensive training and difficulties with generalization from small number of training examples. We develop a new generative model called…

Machine Learning · Statistics 2017-09-06 Sergey Bartunov , Dmitry P. Vetrov

Neural language models are a powerful tool to embed words into semantic vector spaces. However, learning such models generally relies on the availability of abundant and diverse training examples. In highly specialised domains this…

Computation and Language · Computer Science 2015-12-04 Stephanie L. Hyland , Theofanis Karaletsos , Gunnar Rätsch

In this study, we implement a novel BERT architecture for multitask fine-tuning on three downstream tasks: sentiment classification, paraphrase detection, and semantic textual similarity prediction. Our model, Multitask BERT, incorporates…

Computation and Language · Computer Science 2024-08-29 Christopher Sun , Abishek Satish

Most sentence embedding techniques heavily rely on expensive human-annotated sentence pairs as the supervised signals. Despite the use of large-scale unlabeled data, the performance of unsupervised methods typically lags far behind that of…

Computation and Language · Computer Science 2022-11-01 Yiming Chen , Yan Zhang , Bin Wang , Zuozhu Liu , Haizhou Li

The acquisition of labels for supervised learning can be expensive. To improve the sample efficiency of neural network regression, we study active learning methods that adaptively select batches of unlabeled data for labeling. We present a…

Machine Learning · Statistics 2023-08-02 David Holzmüller , Viktor Zaverkin , Johannes Kästner , Ingo Steinwart

Machine learning approaches to multi-label document classification have to date largely relied on discriminative modeling techniques such as support vector machines. A drawback of these approaches is that performance rapidly drops off as…

Machine Learning · Statistics 2011-11-11 Timothy N. Rubin , America Chambers , Padhraic Smyth , Mark Steyvers

Large Language Models (LLMs) have demonstrated impressive capabilities for generalizing in unseen tasks. In the Named Entity Recognition (NER) task, recent advancements have seen the remarkable improvement of LLMs in a broad range of entity…

Computation and Language · Computer Science 2024-06-21 Yuyang Ding , Juntao Li , Pinzheng Wang , Zecheng Tang , Bowen Yan , Min Zhang

In this paper, we propose a deep invertible hybrid model which integrates discriminative and generative learning at a latent space level for semi-supervised few-shot classification. Various tasks for classifying new species from image data…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Yusuke Ohtsubo , Tetsu Matsukawa , Einoshin Suzuki

Prompting, which casts downstream applications as language modeling tasks, has shown to be sample efficient compared to standard fine-tuning with pre-trained models. However, one pitfall of prompting is the need of manually-designed…

Computation and Language · Computer Science 2022-09-21 Zichun Yu , Tianyu Gao , Zhengyan Zhang , Yankai Lin , Zhiyuan Liu , Maosong Sun , Jie Zhou

Fine-tuning pre-trained language models has recently become a common practice in building NLP models for various tasks, especially few-shot tasks. We argue that under the few-shot setting, formulating fine-tuning closer to the pre-training…

Computation and Language · Computer Science 2022-11-01 Zihan Wang , Kewen Zhao , Zilong Wang , Jingbo Shang

Text-attributed graphs have recently garnered significant attention due to their wide range of applications in web domains. Existing methodologies employ word embedding models for acquiring text representations as node features, which are…

Machine Learning · Computer Science 2024-12-11 Jianxiang Yu , Yuxiang Ren , Chenghua Gong , Jiaqi Tan , Xiang Li , Xuecang Zhang