English
Related papers

Related papers: GuideX: Guided Synthetic Data Generation for Zero-…

200 papers

Vision-language foundation models have shown promising zero-shot generalization for Cross-Domain Few-Shot Object Detection (CD-FSOD). However, they face two critical challenges in fine-tuning: insufficient support set utilization due to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Jiacong Liu , Shu Luo , Yikai Qin , Yaze Zhao , Yongwei Jiang , Yixiong Zou

Large, high-quality annotated corpora remain scarce in document-level entity and relation extraction in zero-shot or few-shot settings. In this paper, we present a fully automatic, LLM-based pipeline for synthetic data generation and…

Computation and Language · Computer Science 2025-07-09 Nicholas Popovič , Ashish Kangen , Tim Schopf , Michael Färber

Learning from imprecise labels such as "animal" or "bird", but making precise predictions like "snow bunting" at inference time is an important capability for any classifier when expertly labeled training data is scarce. Contributions by…

Computer Vision and Pattern Recognition · Computer Science 2022-01-28 Clemens-Alexander Brust , Björn Barz , Joachim Denzler

The International Classification of Diseases (ICD) is a list of classification codes for the diagnoses. Automatic ICD coding is in high demand as the manual coding can be labor-intensive and error-prone. It is a multi-label text…

Computation and Language · Computer Science 2019-10-01 Congzheng Song , Shanghang Zhang , Najmeh Sadoughi , Pengtao Xie , Eric Xing

Synthetic datasets are widely used for training urban scene recognition models, but even highly realistic renderings show a noticeable gap to real imagery. This gap is particularly pronounced when adapting to a specific target domain, such…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Denis Zavadski , Damjan Kalšan , Tim Küchler , Haebom Lee , Stefan Roth , Carsten Rother

We consider the task of optimally fine-tuning pre-trained multilingual models, given small amounts of unlabelled target data and an annotation budget. In this paper, we introduce DEMUX, a framework that prescribes the exact data-points to…

Computation and Language · Computer Science 2023-11-14 Simran Khanuja , Srinivas Gowriraj , Lucio Dery , Graham Neubig

Data generation-based zero-shot learning, although effective in training Small Task-specific Models (STMs) via synthetic datasets generated by Pre-trained Language Models (PLMs), is often limited by the low quality of such synthetic…

Computation and Language · Computer Science 2024-06-19 Tianyuan Zou , Yang Liu , Peng Li , Jianqing Zhang , Jingjing Liu , Ya-Qin Zhang

Instruction tuning has emerged as the key in aligning large language models (LLMs) with specific task instructions, thereby mitigating the discrepancy between the next-token prediction objective and users' actual goals. To reduce the labor…

Computation and Language · Computer Science 2024-04-10 Zifeng Wang , Chun-Liang Li , Vincent Perot , Long T. Le , Jin Miao , Zizhao Zhang , Chen-Yu Lee , Tomas Pfister

Large-scale vision-language pre-trained (VLP) models (e.g., CLIP) are renowned for their versatility, as they can be applied to diverse applications in a zero-shot setup. However, when these models are used in specific domains, their…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Anh-Quan Cao , Maximilian Jaritz , Matthieu Guillaumin , Raoul de Charette , Loris Bazzani

Document-level Relation Triplet Extraction (DocRTE) is a fundamental task in information systems that aims to simultaneously extract entities with semantic relations from a document. Existing methods heavily rely on a substantial amount of…

Computation and Language · Computer Science 2024-01-25 Qi Sun , Kun Huang , Xiaocui Yang , Rong Tong , Kun Zhang , Soujanya Poria

In the rapidly evolving field of healthcare and beyond, the integration of generative AI in Electronic Health Records (EHRs) represents a pivotal advancement, addressing a critical gap in current information extraction techniques. This…

Computation and Language · Computer Science 2024-06-03 Mohammed-Khalil Ghali , Abdelrahman Farrag , Hajar Sakai , Hicham El Baz , Yu Jin , Sarah Lam

Large language models (LLMs) hold the promise of solving diverse tasks when provided with appropriate natural language prompts. However, prompting often leads models to make predictions with lower accuracy compared to finetuning a model…

Computation and Language · Computer Science 2024-08-13 Chenyang Zhao , Xueying Jia , Vijay Viswanathan , Tongshuang Wu , Graham Neubig

Zero-shot recognition models require extensive training data for generalization. However, in zero-shot 3D classification, collecting 3D data and captions is costly and laborintensive, posing a significant barrier compared to 2D vision.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Kohei Torimi , Ryosuke Yamada , Daichi Otsuka , Kensho Hara , Yuki M. Asano , Hirokatsu Kataoka , Yoshimitsu Aoki

One of the biggest bottlenecks in building accurate, high coverage neural open IE systems is the need for large labelled corpora. The diversity of open domain corpora and the variety of natural language expressions further exacerbate this…

Computation and Language · Computer Science 2021-03-08 Jialong Tang , Yaojie Lu , Hongyu Lin , Xianpei Han , Le Sun , Xinyan Xiao , Hua Wu

Existing AI-generated text detection methods heavily depend on large annotated datasets and external threshold tuning, restricting interpretability, adaptability, and zero-shot effectiveness. To address these limitations, we propose…

Computation and Language · Computer Science 2025-05-22 Jiatao Li , Mao Ye , Cheng Peng , Xunjian Yin , Xiaojun Wan

This paper studies the use of language models as a source of synthetic unlabeled text for NLP. We formulate a general framework called ``generate, annotate, and learn (GAL)'' to take advantage of synthetic text within knowledge…

Machine Learning · Computer Science 2022-06-01 Xuanli He , Islam Nassar , Jamie Kiros , Gholamreza Haffari , Mohammad Norouzi

Training language models to learn from human instructions for zero-shot cross-task generalization has attracted much attention in NLP communities. Recently, instruction tuning (IT), which fine-tunes a pre-trained language model on a massive…

Computation and Language · Computer Science 2022-10-18 Yuxian Gu , Pei Ke , Xiaoyan Zhu , Minlie Huang

Large language models (LLMs) can perform a new task by merely conditioning on task instructions and a few input-output examples, without optimizing any parameters. This is called In-Context Learning (ICL). In-context Information Extraction…

Computation and Language · Computer Science 2025-07-14 Chaoxu Pang , Yixuan Cao , Qiang Ding , Ping Luo

Large language models (LLMs) have shown a remarkable ability to generalize beyond their pre-training data, and fine-tuning LLMs can elevate performance to human-level and beyond. However, in real-world scenarios, lacking labeled data often…

Machine Learning · Computer Science 2025-11-19 Tzu-Hsuan Chou , Chun-Nan Chou

Deep learning has significantly advanced building segmentation in remote sensing, yet models struggle to generalize on data of diverse geographic regions due to variations in city layouts and the distribution of building types, sizes and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Shuang Song , Yang Tang , Rongjun Qin