English
Related papers

Related papers: New Evaluation Paradigm for Lexical Simplification

200 papers

Incorporating natural language rationales in the prompt and In-Context Learning (ICL) have led to a significant improvement of Large Language Models (LLMs) performance. However, generating high-quality rationales require human-annotation or…

Machine Learning · Computer Science 2024-06-18 Milan Bhan , Jean-Noel Vittaut , Nicolas Chesneau , Marie-Jeanne Lesot

Large language models (LLMs) have demonstrated remarkable proficiency in machine translation (MT), even without specific training on the languages in question. However, translating rare words in low-resource or domain-specific contexts…

Computation and Language · Computer Science 2024-11-14 Shangfeng Chen , Xiayang Shi , Pu Li , Yinlin Li , Jingjing Liu

While Chain of Thought (CoT) prompting approaches have significantly consolidated the reasoning capabilities of large language models (LLMs), they still face limitations that require extensive human effort or have performance needs to be…

Computation and Language · Computer Science 2025-06-02 Kangyang Luo , Zichen Ding , Zhenmin Weng , Lingfeng Qiao , Meng Zhao , Xiang Li , Di Yin , Jinlong Shu

As Large Language Models (LLMs) become increasingly prevalent in text simplification, systematically evaluating their outputs across diverse prompting strategies and architectures remains a critical methodological challenge in both NLP…

Computation and Language · Computer Science 2026-04-13 Rares-Alexandru Roscan , Gabriel Petre1 , Adrian-Marius Dumitran , Angela-Liliana Dumitran

Large language models (LLMs) are incredibly powerful at comprehending and generating data in the form of text, but are brittle and error-prone. There has been an advent of toolkits and recipes centered around so-called prompt…

Databases · Computer Science 2023-08-09 Aditya G. Parameswaran , Shreya Shankar , Parth Asawa , Naman Jain , Yujie Wang

Supervised learning relies on high-quality labeled data, but obtaining such data through human annotation is both expensive and time-consuming. Recent work explores using large language models (LLMs) for annotation, but LLM-generated labels…

Machine Learning · Computer Science 2026-03-23 Lequan Lin , Dai Shi , Andi Han , Feng Chen , Qiuzheng Chen , Jiawen Li , Zhaoyang Li , Jiyuan Li , Zhenbang Sun , Junbin Gao

Inductive reasoning is a core problem-solving capacity: humans can identify underlying principles from a few examples, which robustly generalize to novel scenarios. Recent work evaluates large language models (LLMs) on inductive reasoning…

Machine Learning · Computer Science 2024-06-03 Ruocheng Wang , Eric Zelikman , Gabriel Poesia , Yewen Pu , Nick Haber , Noah D. Goodman

Due to their architecture and vast pre-training data, large language models (LLMs) demonstrate strong text classification performance. However, LLM output - here, the category assigned to a text - depends heavily on the wording of the…

Computation and Language · Computer Science 2025-12-04 Kylie L. Anglin , Stephanie Milan , Brittney Hernandez , Claudia Ventura

Recent Large Language Models (LLMs) have demonstrated remarkable capabilities in generating text that closely resembles human writing across wide range of styles and genres. However, such capabilities are prone to potential abuse, such as…

Computation and Language · Computer Science 2023-11-09 Harika Abburi , Kalyani Roy , Michael Suesserman , Nirmala Pudota , Balaji Veeramani , Edward Bowen , Sanmitra Bhattacharya

We propose cognitive prompting as a novel approach to guide problem-solving in large language models (LLMs) through structured, human-like cognitive operations, such as goal clarification, decomposition, filtering, abstraction, and pattern…

Computation and Language · Computer Science 2024-12-03 Oliver Kramer , Jill Baumann

Large Language Models (LLMs) have revolutionized the field of Natural Language Processing (NLP) by automating traditional labor-intensive tasks and consequently accelerated the development of computer-aided applications. As researchers…

Computation and Language · Computer Science 2025-06-24 Summra Saleem , Muhammad Nabeel Asim , Shaista Zulfiqar , Andreas Dengel

Effective document reranking is essential for improving search relevance across diverse applications. While Large Language Models (LLMs) excel at reranking due to their deep semantic understanding and reasoning, their high computational…

Computation and Language · Computer Science 2025-10-03 Dimitar Peshevski , Kiril Blazhevski , Martin Popovski , Gjorgji Madjarov

In this paper, we propose a pipeline leveraging Large Language Models (LLMs) for data augmentation in Information Extraction tasks within the legal domain. The proposed method is both simple and effective, significantly reducing the manual…

Computation and Language · Computer Science 2026-01-12 Nguyen Minh Phuong , Ha-Thanh Nguyen , May Myo Zin , Ken Satoh

Large Language Models (LLMs) have fundamentally reshaped Argument Mining (AM), shifting it from a pipeline of supervised, task-specific classifiers to a spectrum of prompt-driven, retrieval-augmented, and reasoning-oriented paradigms. Yet…

Computation and Language · Computer Science 2025-11-26 Hao Li , Viktor Schlegel , Yizheng Sun , Riza Batista-Navarro , Goran Nenadic

Most existing prompting methods suffer from the issues of generalizability and consistency, as they often rely on instance-specific solutions that may not be applicable to other instances and lack task-level consistency across the selected…

Computation and Language · Computer Science 2024-11-12 Chang Gao , Haiyun Jiang , Deng Cai , Shuming Shi , Wai Lam

Political scientists are rapidly adopting large language models (LLMs) for text annotation, yet the sensitivity of annotation results to implementation choices remains poorly understood. Most evaluations test a single model or…

Computation and Language · Computer Science 2026-04-01 Lorcan McLaren , James Cross , Zuzanna Krakowska , Robin Rauner , Martijn Schoonvelde

Sentence embedding is essential for many NLP tasks, with contrastive learning methods achieving strong performance using annotated datasets like NLI. Yet, the reliance on manual labels limits scalability. Recent studies leverage large…

Computation and Language · Computer Science 2025-06-05 Liyang He , Chenglong Liu , Rui Li , Zhenya Huang , Shulan Ruan , Jun Zhou , Enhong Chen

When developing text classification models for real world applications, one major challenge is the difficulty to collect sufficient data for all text classes. In this work, we address this challenge by utilizing large language models (LLMs)…

Computation and Language · Computer Science 2025-08-15 Chenhao Xue , Yuanzhe Jin , Adrian Carrasco-Revilla , Joyraj Chakraborty , Min Chen

Generating accurate step-by-step reasoning is essential for Large Language Models (LLMs) to address complex problems and enhance robustness and interpretability. Despite the flux of research on developing advanced reasoning approaches,…

Computation and Language · Computer Science 2024-08-13 Shibo Hao , Yi Gu , Haotian Luo , Tianyang Liu , Xiyan Shao , Xinyuan Wang , Shuhua Xie , Haodi Ma , Adithya Samavedhi , Qiyue Gao , Zhen Wang , Zhiting Hu

Requirements classification assigns natural language requirements to predefined classes, such as functional and non functional. Accurate classification reduces risk and improves software quality. Most existing models rely on supervised…

Software Engineering · Computer Science 2025-09-18 Manal Binkhonain , Reem Alfayaz