中文
相关论文

相关论文: Effective Context Selection in LLM-based Leaderboa…

200 篇论文

This paper introduces a novel approach for identifying the possible large language models (LLMs) involved in text generation. Instead of adding an additional classification layer to a base LM, we reframe the classification task as a…

计算与语言 · 计算机科学 2024-02-08 Yutian Chen , Hao Kang , Vivian Zhai , Liangze Li , Rita Singh , Bhiksha Raj

Recent Large Language Models (LLMs) have demonstrated remarkable capabilities in generating text that closely resembles human writing across wide range of styles and genres. However, such capabilities are prone to potential abuse, such as…

Context graphs are essential for modern AI applications including question answering, pattern discovery, and data analysis. Building accurate context graphs from structured databases requires inferring join relationships between entities.…

数据库 · 计算机科学 2026-03-05 Shivani Tripathi , Ravi Shetye , Shi Qiao , Alekh Jindal

The rapid emergence of generative AI tools is transforming the way software is developed. Consequently, software engineering education must adapt to ensure that students not only learn traditional development methods but also understand how…

软件工程 · 计算机科学 2025-12-08 Uwe M. Borghoff , Mark Minas , Jannis Schopp

Large language models (LLMs) bring unprecedented flexibility in defining and executing complex, creative natural language generation (NLG) tasks. Yet, this flexibility brings new challenges, as it introduces new degrees of freedom in…

计算与语言 · 计算机科学 2024-07-08 Furkan Şahinuç , Ilia Kuznetsov , Yufang Hou , Iryna Gurevych

Large Language Models (LLMs) are being increasingly employed in data science for tasks like data preprocessing and analytics. However, data scientists encounter substantial obstacles when conversing with LLM-powered chatbots and acting on…

人机交互 · 计算机科学 2023-10-26 Bhavya Chopra , Ananya Singha , Anna Fariha , Sumit Gulwani , Chris Parnin , Ashish Tiwari , Austin Z. Henley

Long-context language models (LCLMs) have the potential to revolutionize our approach to tasks traditionally reliant on external tools like retrieval systems or databases. Leveraging LCLMs' ability to natively ingest and process entire…

This paper introduces Leaderboard Auto Generation (LAG), a novel and well-organized framework for automatic generation of leaderboards on a given research topic in rapidly evolving fields like Artificial Intelligence (AI). Faced with a…

计算与语言 · 计算机科学 2025-10-07 Jian Wu , Jiayu Zhang , Dongyuan Li , Linyi Yang , Aoxiao Zhong , Renhe Jiang , Qingsong Wen , Yue Zhang

This paper focuses on extending the success of large language models (LLMs) to sequential decision making. Existing efforts either (i) re-train or finetune LLMs for decision making, or (ii) design prompts for pretrained LLMs. The former…

机器学习 · 计算机科学 2025-06-17 Dingyang Chen , Qi Zhang , Yinglun Zhu

The remarkable ability of Large Language Models (LLMs) to understand and follow instructions has sometimes been limited by their in-context learning (ICL) performance in low-resource languages. To address this, we introduce a novel approach…

计算与语言 · 计算机科学 2023-12-06 Xiaoqian Li , Ercong Nie , Sheng Liang

Open Information Extraction (OIE) aims to extract objective structured knowledge from natural texts, which has attracted growing attention to build dedicated models with human experience. As the large language models (LLMs) have exhibited…

计算与语言 · 计算机科学 2023-10-17 Ji Qi , Kaixuan Ji , Xiaozhi Wang , Jifan Yu , Kaisheng Zeng , Lei Hou , Juanzi Li , Bin Xu

Large Language Models (LLMs) are increasingly used in educational settings as interactive tools for collaboration. However, their tendency toward sycophancy, aligning with user beliefs even when incorrect, raises concerns for learning and…

人机交互 · 计算机科学 2026-05-22 Cansu Koyuturk , Sabrina Guidotti , Dimitri Ognibene

This survey reviews how large language models (LLMs) are transforming synthetic training data generation in both natural language and code domains. By producing artificial but task-relevant examples, these models can significantly augment…

计算与语言 · 计算机科学 2025-11-21 Mihai Nadas , Laura Diosan , Andreea Tomescu

Although Large Language Models (LLMs) have demonstrated impressive text generation capabilities, they are easily misled by untruthful contexts provided by users or knowledge augmentation tools, leading to hallucinations. To alleviate LLMs…

计算与语言 · 计算机科学 2024-09-16 Tian Yu , Shaolei Zhang , Yang Feng

Large language models (LLMs) offer substantial promise for text classification in political science, yet their effectiveness often depends on high-quality prompts and exemplars. To address this, we introduce a three-stage framework that…

计算与语言 · 计算机科学 2025-04-08 Menglin Liu , Ge Shi

Low-resource languages pose a challenge for machine translation with large language models (LLMs), which require large amounts of training data. One potential way to circumvent this data dependence is to rely on LLMs' ability to use…

计算与语言 · 计算机科学 2026-04-09 Jackson Petty , Jaulie Goe , Tal Linzen

Large language models (LLMs) hold promise for generating plans for complex tasks, but their effectiveness is limited by sequential execution, lack of control flow models, and difficulties in skill retrieval. Addressing these issues is…

计算与语言 · 计算机科学 2024-10-18 Andrei Cosmin Redis , Mohammadreza Fani Sani , Bahram Zarrin , Andrea Burattin

In-context learning (ICL) is a crucial capability of current large language models (LLMs), where the selection of examples plays a key role in performance. While most existing approaches focus on selecting the most similar examples to the…

计算与语言 · 计算机科学 2025-06-06 Wenyang Xiao , Haoyu Zhao , Lingxiao Huang

The in-context learning paradigm with LLMs has been instrumental in advancing a wide range of natural language processing tasks. The selection of few-shot examples (exemplars / demonstration samples) is essential for constructing effective…

机器学习 · 计算机科学 2025-06-11 Kiran Purohit , V Venktesh , Sourangshu Bhattacharya , Avishek Anand

Providing Language Models (LMs) with relevant evidence in the context (either via retrieval or user-provided) can significantly improve their ability to provide better-grounded responses. However, recent studies have found that LMs often…

计算与语言 · 计算机科学 2025-05-27 Zhining Liu , Rana Ali Amjad , Ravinarayana Adkathimar , Tianxin Wei , Hanghang Tong