English
Related papers

Related papers: Self-Guided Noise-Free Data Generation for Efficie…

200 papers

Fine-tuning for large language models (LLMs) typically requires substantial amounts of high-quality supervised data, which is both costly and labor-intensive to acquire. While synthetic data generation has emerged as a promising solution,…

Computation and Language · Computer Science 2025-05-28 Zihong Chen , Wanli Jiang , Jinzhe Li , Zhonghang Yuan , Huanjun Kong , Wanli Ouyang , Nanqing Dong

Large language models (LLMs) are very proficient text generators. We leverage this capability of LLMs to generate task-specific data via zero-shot prompting and promote cross-lingual transfer for low-resource target languages. Given…

Computation and Language · Computer Science 2024-07-16 Barah Fazili , Ashish Sunil Agrawal , Preethi Jyothi

Generating realistic synthetic tabular data presents a critical challenge in machine learning. It adds another layer of complexity when this data contain class imbalance problems. This paper presents a novel token-aware data imputation…

Machine Learning · Computer Science 2025-06-05 Shreenidhi Srinivasan , Lydia Manikonda

This work improves the quality of automated machine learning (AutoML) systems by using dataset and function descriptions while significantly decreasing computation time from minutes to milliseconds by using a zero-shot approach. Given a new…

Machine Learning · Computer Science 2021-06-28 Nikhil Singh , Brandon Kates , Jeff Mentch , Anant Kharkar , Madeleine Udell , Iddo Drori

Large language models (LLMs) have enabled a range of applications in zero-shot and few-shot learning settings, including the generation of synthetic datasets for training and testing. However, to reliably use these synthetic datasets, it is…

Computation and Language · Computer Science 2024-09-19 Gaurav Maheshwari , Dmitry Ivanov , Kevin El Haddad

Deep learning models have the ability to extract rich knowledge from large-scale datasets. However, the sharing of data has become increasingly challenging due to concerns regarding data copyright and privacy. Consequently, this hampers the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Bowen Tang , Long Yan , Jing Zhang , Qian Yu , Lu Sheng , Dong Xu

Recent advances in large language model (LLM) training have highlighted the need for diverse, high-quality instruction data. Recently, many works are exploring synthetic data generation using LLMs. However, they primarily focus on prompt…

Computation and Language · Computer Science 2024-12-10 Yifang Chen , David Zhu , Simon Du , Kevin Jamieson , Yang Liu

We propose a new paradigm for zero-shot learners that is format agnostic, i.e., it is compatible with any format and applicable to a list of language tasks, such as text classification, commonsense reasoning, coreference resolution, and…

Computation and Language · Computer Science 2022-10-19 Ping Yang , Junjie Wang , Ruyi Gan , Xinyu Zhu , Lin Zhang , Ziwei Wu , Xinyu Gao , Jiaxing Zhang , Tetsuya Sakai

This paper introduces a novel algorithm for constructing decision trees using large language models (LLMs) in a zero-shot manner based on Classification and Regression Trees (CART) principles. Traditional decision tree induction methods…

Machine Learning · Computer Science 2025-01-28 Lucas Carrasco , Felipe Urrutia , Andrés Abeliuk

This paper presents AutoHint, a novel framework for automatic prompt engineering and optimization for Large Language Models (LLM). While LLMs have demonstrated remarkable ability in achieving high-quality annotation in various tasks, the…

Computation and Language · Computer Science 2023-08-10 Hong Sun , Xue Li , Yinchuan Xu , Youkow Homma , Qi Cao , Min Wu , Jian Jiao , Denis Charles

We present a meta-learning based generative model for zero-shot learning (ZSL) towards a challenging setting when the number of training examples from each \emph{seen} class is very few. This setup contrasts with the conventional ZSL…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Vinay Kumar Verma , Ashish Mishra , Anubha Pandey , Hema A. Murthy , Piyush Rai

Recently, zero-shot multi-label classification has garnered considerable attention for its capacity to operate predictions on unseen labels without human annotations. Nevertheless, prevailing approaches often use seen classes as imperfect…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Kaixin Zhang , Zhixiang Yuan , Tao Huang

Large language models (LLMs) have demonstrated remarkable success in NLP tasks. However, there is a paucity of studies that attempt to evaluate their performances on social media-based health-related natural language processing tasks, which…

Computation and Language · Computer Science 2024-03-29 Yuting Guo , Anthony Ovadje , Mohammed Ali Al-Garadi , Abeed Sarker

Adapting Large Language Models (LLMs) to specialized domains requires high-quality instruction tuning datasets, which are expensive to create through human annotation. Existing data synthesis methods focus on general-purpose tasks and fail…

Computation and Language · Computer Science 2026-03-17 Ruiyao Xu , Noelle I. Samia , Han Liu

Modern generative pre-trained language models excel at open-ended text generation, yet continue to underperform on structure-related tasks such as NER, relation extraction, and semantic role labeling, especially when compared to…

Computation and Language · Computer Science 2025-12-23 Minho Lee , Junghyun Min , Yerang Kim , Woochul Lee , Yeonsoo Lee

We present a synthetic data approach for instruction-tuning large language models (LLMs) for low-resource languages in a data-efficient manner, specifically focusing on Thai. We identify three key properties that contribute to the…

Computation and Language · Computer Science 2024-11-26 Parinthapat Pengpun , Can Udomcharoenchaikit , Weerayut Buaphet , Peerat Limkonchotiwat

Contrastively trained text-image models have the remarkable ability to perform zero-shot classification, that is, classifying previously unseen images into categories that the model has never been explicitly trained to identify. However,…

Robust object recognition systems usually rely on powerful feature extraction mechanisms from a large number of real images. However, in many realistic applications, collecting sufficient images for ever-growing new classes is unattainable.…

Computer Vision and Pattern Recognition · Computer Science 2017-05-05 Yang Long , Li Liu , Ling Shao , Fumin Shen , Guiguang Ding , Jungong Han

Large Language Models (LLMs) have shown impressive zero-shot performance across a variety of Natural Language Processing tasks, including document re-ranking. However, their effectiveness degrades on unseen tasks and domains, largely due to…

Information Retrieval · Computer Science 2025-05-02 Marco Braga , Pranav Kasela , Alessandro Raganato , Gabriella Pasi

Zero-Shot Learning (ZSL) is a classification task where we do not have even a single training labeled example from a set of unseen classes. Instead, we only have prior information (or description) about seen and unseen classes, often in the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Shabnam Daghaghi , Tharun Medini , Anshumali Shrivastava