English
Related papers

Related papers: LITE: LLM-Impelled efficient Taxonomy Evaluation

200 papers

Rapid advancements of large language models (LLMs) have enabled the processing, understanding, and generation of human-like text, with increasing integration into systems that touch our social sphere. Despite this success, these models can…

Computation and Language · Computer Science 2024-07-16 Isabel O. Gallegos , Ryan A. Rossi , Joe Barrow , Md Mehrab Tanjim , Sungchul Kim , Franck Dernoncourt , Tong Yu , Ruiyi Zhang , Nesreen K. Ahmed

We propose a novel zero-shot document ranking approach based on Large Language Models (LLMs): the Setwise prompting approach. Our approach complements existing prompting approaches for LLM-based zero-shot ranking: Pointwise, Pairwise, and…

Information Retrieval · Computer Science 2024-05-31 Shengyao Zhuang , Honglei Zhuang , Bevan Koopman , Guido Zuccon

The advancement of Large Language Models (LLMs) enables flexible and interpretable automatic evaluations. In the field of machine translation evaluation, utilizing LLMs with translation error annotations based on Multidimensional Quality…

Computation and Language · Computer Science 2025-09-17 Shijie Zhang , Renhao Li , Songsheng Wang , Philipp Koehn , Min Yang , Derek F. Wong

Large language model (LLM)-based judges are widely adopted for automated evaluation and reward modeling, yet their judgments are often affected by judgment biases. Accurately evaluating these biases is essential for ensuring the reliability…

Computation and Language · Computer Science 2026-03-10 Hongli Zhou , Hui Huang , Rui Zhang , Kehai Chen , Bing Xu , Conghui Zhu , Tiejun Zhao , Muyun Yang

Literature review requires researchers to synthesize a large amount of information and is increasingly challenging as the scientific literature expands. In this work, we investigate the potential of LLMs for producing hierarchical…

Computation and Language · Computer Science 2024-07-24 Chao-Chun Hsu , Erin Bransom , Jenna Sparks , Bailey Kuehl , Chenhao Tan , David Wadden , Lucy Lu Wang , Aakanksha Naik

Few-shot tabular learning, in which machine learning models are trained with a limited amount of labeled data, provides a cost-effective approach to addressing real-world challenges. The advent of Large Language Models (LLMs) has sparked…

Machine Learning · Computer Science 2025-05-09 Ruxue Shi , Hengrui Gu , Hangting Ye , Yiwei Dai , Xu Shen , Xin Wang

This paper presents a novel methodological framework for detecting and classifying latent constructs, including frames, narratives, and topics, from textual data using Open-Source Large Language Models (LLMs). The proposed hybrid approach…

Computation and Language · Computer Science 2025-04-01 Maël Kubli

Large language models (LLMs) are increasingly deployed in teams, yet existing coordination approaches often occupy two extremes. Highly structured methods rely on fixed roles, pipelines, or task decompositions assigned a priori. In…

Predictive modeling often faces challenges due to limited data availability and quality, especially in domains where collected features are weakly correlated with outcomes and where additional feature collection is constrained by ethical or…

Machine Learning · Computer Science 2024-10-08 Bingxuan Li , Pengyi Shi , Amy Ward

Users increasingly rely on Large Language Models (LLMs) for Deep Research, using them to synthesize diverse sources into structured reports that support understanding and action. In this context, the practical reliability of such reports…

Computation and Language · Computer Science 2026-02-24 Jujia Zhao , Zhaoxin Huan , Zihan Wang , Xiaolu Zhang , Jun Zhou , Suzan Verberne , Zhaochun Ren

The rapid advancement of Large Language Models (LLMs) has led to a multitude of application opportunities. One traditional task for Information Retrieval systems is the summarization and classification of texts, both of which are important…

Computation and Language · Computer Science 2025-02-25 Gautam Kishore Shahi , Oliver Hummel

We present a comprehensive system for addressing Tasks A, B, and C of the LLMs4OL 2025 challenge, which together span the full ontology construction pipeline: term extraction, typing, and taxonomy discovery. Our approach combines…

Computation and Language · Computer Science 2025-08-28 Aleksandra Beliaeva , Temurbek Rahmatullaev

Step-by-step reasoning is widely used to enhance the reasoning ability of large language models (LLMs) in complex problems. Evaluating the quality of reasoning traces is crucial for understanding and improving LLM reasoning. However,…

Computation and Language · Computer Science 2025-09-23 Jinu Lee , Julia Hockenmaier

The relentless expansion of scientific literature presents significant challenges for navigation and knowledge discovery. Within Research Information Retrieval, established tasks such as text summarization and classification remain crucial…

Information Retrieval · Computer Science 2026-04-28 Gautam Kishore Shahi , Oliver Hummel

It is desirable to coarsely classify short scientific texts, such as grant or publication abstracts, for strategic insight or research portfolio management. These texts efficiently transmit dense information to experts possessing a rich…

Artificial Intelligence · Computer Science 2024-07-09 Harsh Sakhrani , Naseela Pervez , Anirudh Ravi Kumar , Fred Morstatter , Alexandra Graddy Reed , Andrea Belz

Citation networks are critical in modern science, and predicting which previous papers (candidates) will a new paper (query) cite is a critical problem. However, the roles of a paper's citations vary significantly, ranging from foundational…

Digital Libraries · Computer Science 2024-10-15 Qianyue Hao , Jingyang Fan , Fengli Xu , Jian Yuan , Yong Li

Large Language Models (LLMs) have demonstrated remarkable progress in reasoning across diverse domains. However, effective reasoning in real-world tasks requires adapting the reasoning strategy to the demands of the problem, ranging from…

Computation and Language · Computer Science 2025-08-19 Xinda Jia , Jinpeng Li , Zezhong Wang , Jingjing Li , Xingshan Zeng , Yasheng Wang , Weinan Zhang , Yong Yu , Weiwen Liu

Despite efforts to align large language models (LLMs) with societal and moral values, these models remain susceptible to jailbreak attacks -- methods designed to elicit harmful responses. Jailbreaking black-box LLMs is considered…

Computation and Language · Computer Science 2025-09-23 Muyang Zheng , Yuanzhi Yao , Changting Lin , Caihong Kai , Yanxiang Chen , Zhiquan Liu

This paper aims to address the challenge of sparse and missing data in recommendation systems, a significant hurdle in the age of big data. Traditional imputation methods struggle to capture complex relationships within the data. We propose…

Information Retrieval · Computer Science 2024-08-09 Zhicheng Ding , Jiahao Tian , Zhenkai Wang , Jinman Zhao , Siyang Li

Conducting literature reviews for scientific papers is essential for understanding research, its limitations, and building on existing work. It is a tedious task which makes an automatic literature review generator appealing. Unfortunately,…

‹ Prev 1 4 5 6 7 8 10 Next ›