English
Related papers

Related papers: ReGen: Zero-Shot Text Classification via Training …

200 papers

Generative Adversarial Networks (GANs) have shown great promise recently in image generation. Training GANs for language generation has proven to be more difficult, because of the non-differentiable nature of generating text with recurrent…

Computation and Language · Computer Science 2017-12-22 Ofir Press , Amir Bar , Ben Bogin , Jonathan Berant , Lior Wolf

Zero-shot text learning enables text classifiers to handle unseen classes efficiently, alleviating the need for task-specific training data. A simple approach often relies on comparing embeddings of query (text) to those of potential…

Information Retrieval · Computer Science 2024-06-28 Tassallah Abdullahi , Ritambhara Singh , Carsten Eickhoff

Generating coherent and cohesive long-form texts is a challenging task. Previous works relied on large amounts of human-generated texts to train neural language models. However, few attempted to explicitly improve neural language models…

Computation and Language · Computer Science 2019-05-30 Woon Sang Cho , Pengchuan Zhang , Yizhe Zhang , Xiujun Li , Michel Galley , Chris Brockett , Mengdi Wang , Jianfeng Gao

Unit testing validates the correctness of the units of the software system under test and serves as the cornerstone in improving software quality and reliability. To reduce manual efforts in writing unit tests, some techniques have been…

Software Engineering · Computer Science 2025-02-25 Quanjun Zhang , Chunrong Fang , Yi Zheng , Yaxin Zhang , Yuan Zhao , Rubing Huang , Jianyi Zhou , Yun Yang , Tao Zheng , Zhenyu Chen

Text-to-image generation has traditionally focused on finding better modeling assumptions for training on a fixed dataset. These assumptions might involve complex architectures, auxiliary losses, or side information such as object part…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Aditya Ramesh , Mikhail Pavlov , Gabriel Goh , Scott Gray , Chelsea Voss , Alec Radford , Mark Chen , Ilya Sutskever

Zero-shot Composed Image Retrieval (ZS-CIR) aims to retrieve the target image based on a reference image and a text description without requiring in-distribution triplets for training. One prevalent approach follows the vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Zining Chen , Zhicheng Zhao , Fei Su , Xiaoqin Zhang , Shijian Lu

Generative retrieval shed light on a new paradigm of document retrieval, aiming to directly generate the identifier of a relevant document for a query. While it takes advantage of bypassing the construction of auxiliary index structures,…

Information Retrieval · Computer Science 2025-06-03 Sunkyung Lee , Minjin Choi , Jongwuk Lee

The text retrieval is the task of retrieving similar documents to a search query, and it is important to improve retrieval accuracy while maintaining a certain level of retrieval speed. Existing studies have reported accuracy improvements…

Information Retrieval · Computer Science 2023-11-15 Yuichi Sasazawa , Kenichi Yokote , Osamu Imaichi , Yasuhiro Sogawa

This paper introduces a novel dataset REGEN (Reviews Enhanced with GEnerative Narratives), designed to benchmark the conversational capabilities of recommender Large Language Models (LLMs), addressing the limitations of existing datasets…

Clinical natural language processing requires methods that can address domain-specific challenges, such as complex medical terminology and clinical contexts. Recently, large language models (LLMs) have shown promise in this domain. Yet,…

Computation and Language · Computer Science 2025-01-28 Ran Xu , Hejie Cui , Yue Yu , Xuan Kan , Wenqi Shi , Yuchen Zhuang , Wei Jin , Joyce Ho , Carl Yang

The effectiveness of multi-stage text retrieval has been solidly demonstrated since before the era of pre-trained language models. However, most existing studies utilize models that predate recent advances in large language models (LLMs).…

Information Retrieval · Computer Science 2023-10-13 Xueguang Ma , Liang Wang , Nan Yang , Furu Wei , Jimmy Lin

Generative modeling has been the dominant approach for large-scale pretraining and zero-shot generalization. In this work, we challenge this convention by showing that discriminative approaches perform substantially better than generative…

Computation and Language · Computer Science 2023-06-07 Haike Xu , Zongyu Lin , Jing Zhou , Yanan Zheng , Zhilin Yang

Information retrieval (IR) systems have played a vital role in modern digital life and have cemented their continued usefulness in this new era of generative AI via retrieval-augmented generation. With strong language processing…

Computation and Language · Computer Science 2025-03-04 Shijie Chen , Bernal Jiménez Gutiérrez , Yu Su

Large Language Models (LLMs) have achieved impressive progress in natural language processing, but their limited ability to retain long-term context constrains performance on document-level or multi-turn tasks. Retrieval-Augmented…

Computation and Language · Computer Science 2025-05-20 Zhangyu Wang , Siyuan Gao , Rong Zhou , Hao Wang , Li Ning

Large language models (LLMs) have demonstrated remarkable capabilities across various tasks. However, their ability to generate human-like text has raised concerns about potential misuse. This underscores the need for reliable and effective…

Computation and Language · Computer Science 2026-04-24 Runheng Liu , Heyan Huang , Xingchen Xiao , Zhijing Wu

Training effective dense retrieval models typically relies on hard negative (HN) examples mined from large document corpora using methods such as BM25 or cross-encoders, which require full corpus access and expensive index construction. We…

Information Retrieval · Computer Science 2026-05-12 Aarush Sinha

Natural language generation from structured data mainly focuses on surface-level descriptions, suffering from uncontrollable content selection and low fidelity. Previous works leverage logical forms to facilitate logical…

Computation and Language · Computer Science 2023-05-08 Shumin Deng , Jiacheng Yang , Hongbin Ye , Chuanqi Tan , Mosha Chen , Songfang Huang , Fei Huang , Huajun Chen , Ningyu Zhang

Zero-shot learning (ZSL) is commonly used to address the very pervasive problem of predicting unseen classes in fine-grained image classification and other tasks. One family of solutions is to learn synthesised unseen visual samples…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Zhi Chen , Sen Wang , Jingjing Li , Zi Huang

Recent studies have demonstrated the great potential of Large Language Models (LLMs) serving as zero-shot relevance rankers. The typical approach involves making comparisons between pairs or lists of documents. Although effective, these…

Information Retrieval · Computer Science 2023-11-06 Weiwei Sun , Zheng Chen , Xinyu Ma , Lingyong Yan , Shuaiqiang Wang , Pengjie Ren , Zhumin Chen , Dawei Yin , Zhaochun Ren

Large Language Models (LLMs) have shown their ability to improve the performance of speech recognizers by effectively rescoring the n-best hypotheses generated during the beam search process. However, the best way to exploit recent…

Computation and Language · Computer Science 2024-09-10 Ada Defne Tur , Adel Moumen , Mirco Ravanelli