English
Related papers

Related papers: Effective Context Selection in LLM-based Leaderboa…

200 papers

This paper introduces a novel approach for identifying the possible large language models (LLMs) involved in text generation. Instead of adding an additional classification layer to a base LM, we reframe the classification task as a…

Computation and Language · Computer Science 2024-02-08 Yutian Chen , Hao Kang , Vivian Zhai , Liangze Li , Rita Singh , Bhiksha Raj

Recent Large Language Models (LLMs) have demonstrated remarkable capabilities in generating text that closely resembles human writing across wide range of styles and genres. However, such capabilities are prone to potential abuse, such as…

Computation and Language · Computer Science 2023-11-09 Harika Abburi , Kalyani Roy , Michael Suesserman , Nirmala Pudota , Balaji Veeramani , Edward Bowen , Sanmitra Bhattacharya

Context graphs are essential for modern AI applications including question answering, pattern discovery, and data analysis. Building accurate context graphs from structured databases requires inferring join relationships between entities.…

Databases · Computer Science 2026-03-05 Shivani Tripathi , Ravi Shetye , Shi Qiao , Alekh Jindal

The rapid emergence of generative AI tools is transforming the way software is developed. Consequently, software engineering education must adapt to ensure that students not only learn traditional development methods but also understand how…

Software Engineering · Computer Science 2025-12-08 Uwe M. Borghoff , Mark Minas , Jannis Schopp

Large language models (LLMs) bring unprecedented flexibility in defining and executing complex, creative natural language generation (NLG) tasks. Yet, this flexibility brings new challenges, as it introduces new degrees of freedom in…

Computation and Language · Computer Science 2024-07-08 Furkan Şahinuç , Ilia Kuznetsov , Yufang Hou , Iryna Gurevych

Large Language Models (LLMs) are being increasingly employed in data science for tasks like data preprocessing and analytics. However, data scientists encounter substantial obstacles when conversing with LLM-powered chatbots and acting on…

Human-Computer Interaction · Computer Science 2023-10-26 Bhavya Chopra , Ananya Singha , Anna Fariha , Sumit Gulwani , Chris Parnin , Ashish Tiwari , Austin Z. Henley

Long-context language models (LCLMs) have the potential to revolutionize our approach to tasks traditionally reliant on external tools like retrieval systems or databases. Leveraging LCLMs' ability to natively ingest and process entire…

This paper introduces Leaderboard Auto Generation (LAG), a novel and well-organized framework for automatic generation of leaderboards on a given research topic in rapidly evolving fields like Artificial Intelligence (AI). Faced with a…

Computation and Language · Computer Science 2025-10-07 Jian Wu , Jiayu Zhang , Dongyuan Li , Linyi Yang , Aoxiao Zhong , Renhe Jiang , Qingsong Wen , Yue Zhang

This paper focuses on extending the success of large language models (LLMs) to sequential decision making. Existing efforts either (i) re-train or finetune LLMs for decision making, or (ii) design prompts for pretrained LLMs. The former…

Machine Learning · Computer Science 2025-06-17 Dingyang Chen , Qi Zhang , Yinglun Zhu

The remarkable ability of Large Language Models (LLMs) to understand and follow instructions has sometimes been limited by their in-context learning (ICL) performance in low-resource languages. To address this, we introduce a novel approach…

Computation and Language · Computer Science 2023-12-06 Xiaoqian Li , Ercong Nie , Sheng Liang

Open Information Extraction (OIE) aims to extract objective structured knowledge from natural texts, which has attracted growing attention to build dedicated models with human experience. As the large language models (LLMs) have exhibited…

Computation and Language · Computer Science 2023-10-17 Ji Qi , Kaixuan Ji , Xiaozhi Wang , Jifan Yu , Kaisheng Zeng , Lei Hou , Juanzi Li , Bin Xu

Large Language Models (LLMs) are increasingly used in educational settings as interactive tools for collaboration. However, their tendency toward sycophancy, aligning with user beliefs even when incorrect, raises concerns for learning and…

Human-Computer Interaction · Computer Science 2026-05-22 Cansu Koyuturk , Sabrina Guidotti , Dimitri Ognibene

This survey reviews how large language models (LLMs) are transforming synthetic training data generation in both natural language and code domains. By producing artificial but task-relevant examples, these models can significantly augment…

Computation and Language · Computer Science 2025-11-21 Mihai Nadas , Laura Diosan , Andreea Tomescu

Although Large Language Models (LLMs) have demonstrated impressive text generation capabilities, they are easily misled by untruthful contexts provided by users or knowledge augmentation tools, leading to hallucinations. To alleviate LLMs…

Computation and Language · Computer Science 2024-09-16 Tian Yu , Shaolei Zhang , Yang Feng

Large language models (LLMs) offer substantial promise for text classification in political science, yet their effectiveness often depends on high-quality prompts and exemplars. To address this, we introduce a three-stage framework that…

Computation and Language · Computer Science 2025-04-08 Menglin Liu , Ge Shi

Low-resource languages pose a challenge for machine translation with large language models (LLMs), which require large amounts of training data. One potential way to circumvent this data dependence is to rely on LLMs' ability to use…

Computation and Language · Computer Science 2026-04-09 Jackson Petty , Jaulie Goe , Tal Linzen

Large language models (LLMs) hold promise for generating plans for complex tasks, but their effectiveness is limited by sequential execution, lack of control flow models, and difficulties in skill retrieval. Addressing these issues is…

Computation and Language · Computer Science 2024-10-18 Andrei Cosmin Redis , Mohammadreza Fani Sani , Bahram Zarrin , Andrea Burattin

In-context learning (ICL) is a crucial capability of current large language models (LLMs), where the selection of examples plays a key role in performance. While most existing approaches focus on selecting the most similar examples to the…

Computation and Language · Computer Science 2025-06-06 Wenyang Xiao , Haoyu Zhao , Lingxiao Huang

The in-context learning paradigm with LLMs has been instrumental in advancing a wide range of natural language processing tasks. The selection of few-shot examples (exemplars / demonstration samples) is essential for constructing effective…

Machine Learning · Computer Science 2025-06-11 Kiran Purohit , V Venktesh , Sourangshu Bhattacharya , Avishek Anand

Providing Language Models (LMs) with relevant evidence in the context (either via retrieval or user-provided) can significantly improve their ability to provide better-grounded responses. However, recent studies have found that LMs often…

Computation and Language · Computer Science 2025-05-27 Zhining Liu , Rana Ali Amjad , Ravinarayana Adkathimar , Tianxin Wei , Hanghang Tong