English
Related papers

Related papers: S3Eval: A Synthetic, Scalable, Systematic Evaluati…

200 papers

Large Language Models (LLMs) with extended context windows promise direct reasoning over long documents, reducing the need for chunking or retrieval. Constructing annotated resources for training and evaluation, however, remains costly.…

Computation and Language · Computer Science 2025-11-13 Mohamed Elaraby , Jyoti Prakash Maheswari

We present SynthTextEval, a toolkit for conducting comprehensive evaluations of synthetic text. The fluency of large language model (LLM) outputs has made synthetic text potentially viable for numerous applications, such as reducing the…

Computation and Language · Computer Science 2025-11-04 Krithika Ramesh , Daniel Smolyak , Zihao Zhao , Nupoor Gandhi , Ritu Agarwal , Margrét Bjarnadóttir , Anjalie Field

Recently, there has been growing interest in extending the context length of large language models (LLMs), aiming to effectively process long inputs of one turn or conversations with more extensive histories. While proprietary models such…

Computation and Language · Computer Science 2023-10-05 Chenxin An , Shansan Gong , Ming Zhong , Xingjian Zhao , Mukai Li , Jun Zhang , Lingpeng Kong , Xipeng Qiu

Systematic reviews are crucial for synthesizing scientific evidence but remain labor-intensive, especially when extracting detailed methodological information. Large language models (LLMs) offer potential for automating methodological…

Computation and Language · Computer Science 2025-10-14 Wenqing Zhang , Trang Nguyen , Elizabeth A. Stuart , Yiqun T. Chen

The rapid advancements in generative AI and large language models (LLMs) have opened up new avenues for producing synthetic data, particularly in the realm of structured tabular formats, such as product reviews. Despite the potential…

Machine Learning · Computer Science 2025-07-25 Yefeng Yuan , Yuhong Liu , Liang Cheng

Large Language Models (LLMs) have achieved remarkable success in various natural language processing tasks, yet their ability to generate long-form content remains poorly understood and evaluated. Our analysis reveals that current LLMs…

Computation and Language · Computer Science 2025-03-10 Siwei Wu , Yizhi Li , Xingwei Qu , Rishi Ravikumar , Yucheng Li , Tyler Loakman , Shanghaoran Quan , Xiaoyong Wei , Riza Batista-Navarro , Chenghua Lin

Large language models (LLMs) are advancing at an unprecedented pace globally, with regions increasingly adopting these models for applications in their primary language. Evaluation of these models in diverse linguistic environments,…

Generative speech technologies are progressing rapidly, but evaluating the perceptual quality of synthetic speech remains a core challenge. Existing methods typically rely on scalar scores or binary decisions, which lack interpretability…

The rapid development of large language model (LLM) evaluation methodologies and datasets has led to a profound challenge: integrating state-of-the-art evaluation techniques cost-effectively while ensuring reliability, reproducibility, and…

Computation and Language · Computer Science 2024-04-10 Zhuohao Yu , Chang Gao , Wenjin Yao , Yidong Wang , Zhengran Zeng , Wei Ye , Jindong Wang , Yue Zhang , Shikun Zhang

We introduce LongSkywork, a long-context Large Language Model (LLM) capable of processing up to 200,000 tokens. We provide a training recipe for efficiently extending context length of LLMs. We identify that the critical element in…

Computation and Language · Computer Science 2024-06-04 Liang Zhao , Tianwen Wei , Liang Zeng , Cheng Cheng , Liu Yang , Peng Cheng , Lijie Wang , Chenxia Li , Xuejie Wu , Bo Zhu , Yimeng Gan , Rui Hu , Shuicheng Yan , Han Fang , Yahui Zhou

Large Language Models have evolved from single-round generators into long-horizon agents, capable of complex text synthesis scenarios. However, current evaluation frameworks lack the ability to assess the actual synthesis operations, such…

Computation and Language · Computer Science 2026-03-03 Andrew Zhuoer Feng , Cunxiang Wang , Yu Luo , Bosi Wen , Yidong Wang , Lin Fan , Yilin Zhou , Zikang Wang , Wenbo Yu , Lindong Wu , Hongning Wang , Minlie Huang

Generative large language models (LLMs) have revolutionized natural language processing with their transformative and emergent capabilities. However, recent evidence indicates that LLMs can produce harmful content that violates social…

Cryptography and Security · Computer Science 2025-04-08 Xiaohan Yuan , Jinfeng Li , Dongxia Wang , Yuefeng Chen , Xiaofeng Mao , Longtao Huang , Jialuo Chen , Hui Xue , Xiaoxia Liu , Wenhai Wang , Kui Ren , Jingyi Wang

Despite the utility of Large Language Models (LLMs) across a wide range of tasks and scenarios, developing a method for reliably evaluating LLMs across varied contexts continues to be challenging. Modern evaluation approaches often use LLMs…

Computation and Language · Computer Science 2024-01-31 Steffi Chern , Ethan Chern , Graham Neubig , Pengfei Liu

This survey reviews how large language models (LLMs) are transforming synthetic training data generation in both natural language and code domains. By producing artificial but task-relevant examples, these models can significantly augment…

Computation and Language · Computer Science 2025-11-21 Mihai Nadas , Laura Diosan , Andreea Tomescu

Despite the successes of language models, their evaluation remains a daunting challenge for new and existing tasks. We consider the task of text simplification, commonly used to improve information accessibility, where evaluation faces two…

Computation and Language · Computer Science 2025-04-17 Joseph Liu , Yoonsoo Nam , Xinyue Cui , Swabha Swayamdipta

Large Language Model (LLM) evaluation is currently one of the most important areas of research, with existing benchmarks proving to be insufficient and not completely representative of LLMs' various capabilities. We present a curated…

Computation and Language · Computer Science 2024-06-05 Aisha Khatun , Daniel G. Brown

The era of Large Language Models (LLMs) raises new demands for automatic evaluation metrics, which should be adaptable to various application scenarios while maintaining low cost and effectiveness. Traditional metrics for automatic text…

Computation and Language · Computer Science 2024-10-29 Shuqian Sheng , Yi Xu , Tianhang Zhang , Zanwei Shen , Luoyi Fu , Jiaxin Ding , Lei Zhou , Xiaoying Gan , Xinbing Wang , Chenghu Zhou

Large language models (LLMs) have demonstrated remarkable progress in understanding long-context inputs. However, benchmarks for evaluating the long-context reasoning abilities of LLMs fall behind the pace. Existing benchmarks often focus…

Computation and Language · Computer Science 2025-11-19 Zhan Ling , Kang Liu , Kai Yan , Yifan Yang , Weijian Lin , Ting-Han Fan , Lingfeng Shen , Zhengyin Du , Jiecao Chen

Developing Large Language Models (LLMs) with robust long-context capabilities has been the recent research focus, resulting in the emergence of long-context LLMs proficient in Chinese. However, the evaluation of these models remains…

Computation and Language · Computer Science 2024-10-17 Zexuan Qiu , Jingjing Li , Shijue Huang , Xiaoqi Jiao , Wanjun Zhong , Irwin King

Log analysis is crucial for ensuring the orderly and stable operation of information systems, particularly in the field of Artificial Intelligence for IT Operations (AIOps). Large Language Models (LLMs) have demonstrated significant…

Computation and Language · Computer Science 2024-07-03 Tianyu Cui , Shiyu Ma , Ziang Chen , Tong Xiao , Shimin Tao , Yilun Liu , Shenglin Zhang , Duoming Lin , Changchang Liu , Yuzhe Cai , Weibin Meng , Yongqian Sun , Dan Pei
‹ Prev 1 2 3 10 Next ›