English
Related papers

Related papers: ExPerT: Effective and Explainable Evaluation of Pe…

200 papers

Large Language Models (LLMs) like GPT-4o can help automate text classification tasks at low cost and scale. However, there are major concerns about the validity and reliability of LLM outputs. By contrast, human coding is generally more…

Computation and Language · Computer Science 2025-01-17 Conrad Borchers , Danielle R. Thomas , Jionghao Lin , Ralph Abboud , Kenneth R. Koedinger

The paper explores stylometry as a method to distinguish between texts created by Large Language Models (LLMs) and humans, addressing issues of model attribution, intellectual property, and ethical AI use. Stylometry has been used…

Computation and Language · Computer Science 2025-07-25 Karol Przystalski , Jan K. Argasiński , Iwona Grabska-Gradzińska , Jeremi K. Ochab

Understanding a Reinforcement Learning (RL) policy is crucial for ensuring that autonomous agents behave according to human expectations. This goal can be achieved using Explainable Reinforcement Learning (XRL) techniques. Although textual…

Artificial Intelligence · Computer Science 2026-01-07 Ahmad Terra , Mohit Ahmed , Rafia Inam , Elena Fersman , Martin Törngren

Large language models (LLMs) have shown impressive results while requiring little or no direct supervision. Further, there is mounting evidence that LLMs may have potential in information-seeking scenarios. We believe the ability of an LLM…

The powerful text understanding and generation capabilities of large language models (LLMs) have brought new vitality to general recommendation with implicit feedback. One possible strategy involves generating a unique user (or item)…

Information Retrieval · Computer Science 2025-12-15 Yi Zhang , Yiwen Zhang , Yu Wang , Tong Chen , Hongzhi Yin

Conventional predictive modeling of parametric relationships in manufacturing processes is limited by the subjectivity of human expertise and intuition on the one hand and by the cost and time of experimental data generation on the other…

Computation and Language · Computer Science 2025-06-26 Kiarash Naghavi Khanghah , Anandkumar Patel , Rajiv Malhotra , Hongyi Xu

Integrating free-text explanations to in-context learning of large language models (LLM) is shown to elicit strong reasoning capabilities along with reasonable explanations. In this paper, we consider the problem of leveraging the…

Computation and Language · Computer Science 2022-10-14 Shiyang Li , Jianshu Chen , Yelong Shen , Zhiyu Chen , Xinlu Zhang , Zekun Li , Hong Wang , Jing Qian , Baolin Peng , Yi Mao , Wenhu Chen , Xifeng Yan

Text-based recommendation holds a wide range of practical applications due to its versatility, as textual descriptions can represent nearly any type of item. However, directly employing the original item descriptions may not yield optimal…

Computation and Language · Computer Science 2024-04-03 Hanjia Lyu , Song Jiang , Hanqing Zeng , Yinglong Xia , Qifan Wang , Si Zhang , Ren Chen , Christopher Leung , Jiajie Tang , Jiebo Luo

Personalized user understanding from large-scale digital traces remains a fundamental challenge. Traditional user profiling methods rely on discriminative models and manual feature engineering to predict discrete attributes, often producing…

Information Retrieval · Computer Science 2026-05-12 Yunyi Xuan , Hao Yi , Fengling Mao , Daye Cai , Leikun Liang , Xingsheng He , Jiangnan Xie , Guoshuai Wang , Yushan Han , Wenwen Guo , Xiaoxiao Xu , Lin Qu

Large Language Models (LLMs) have succeeded remarkably in understanding long-form contents. However, exploring their capability for generating long-form contents, such as reports and articles, has been relatively unexplored and inadequately…

Computation and Language · Computer Science 2024-06-05 Haochen Tan , Zhijiang Guo , Zhan Shi , Lu Xu , Zhili Liu , Yunlong Feng , Xiaoguang Li , Yasheng Wang , Lifeng Shang , Qun Liu , Linqi Song

Large pre-trained language models (LMs) have been shown to perform surprisingly well when fine-tuned on tasks that require commonsense and world knowledge. However, in end-to-end architectures, it is difficult to explain what is the…

Computation and Language · Computer Science 2020-04-14 Veronica Latcinnik , Jonathan Berant

With the rising human-like precision of Large Language Models (LLMs) in numerous tasks, their utilization in a variety of real-world applications is becoming more prevalent. Several studies have shown that LLMs excel on many standard NLP…

Computation and Language · Computer Science 2024-04-03 Rishav Hada , Varun Gumma , Mohamed Ahmed , Kalika Bali , Sunayana Sitaram

The quality of texts generated by natural language generation (NLG) systems is hard to measure automatically. Conventional reference-based metrics, such as BLEU and ROUGE, have been shown to have relatively low correlation with human…

Computation and Language · Computer Science 2023-05-25 Yang Liu , Dan Iter , Yichong Xu , Shuohang Wang , Ruochen Xu , Chenguang Zhu

The rapid advancements in large language models (LLMs) have significantly improved their ability to generate natural language, making texts generated by LLMs increasingly indistinguishable from human-written texts. Recent research has…

Computation and Language · Computer Science 2024-12-05 Sergio E. Zanotto , Segun Aroyehun

Safe deployment of large language models (LLMs) may benefit from a reliable method for assessing their generated content to determine when to abstain or to selectively generate. While likelihood-based metrics such as perplexity are widely…

Computation and Language · Computer Science 2023-12-18 Jie Ren , Yao Zhao , Tu Vu , Peter J. Liu , Balaji Lakshminarayanan

The development of Generative AI Large Language Models (LLMs) raised the alarm regarding identifying content produced through generative AI or humans. In one case, issues arise when students heavily rely on such tools in a manner that can…

Computation and Language · Computer Science 2025-01-07 Ayat Najjar , Huthaifa I. Ashqar , Omar Darwish , Eman Hammad

Previous work adopts large language models (LLMs) as evaluators to evaluate natural language process (NLP) tasks. However, certain shortcomings, e.g., fairness, scope, and accuracy, persist for current LLM evaluators. To analyze whether…

Computation and Language · Computer Science 2025-01-22 Qintong Li , Leyang Cui , Lingpeng Kong , Wei Bi

Since the natural language processing (NLP) community started to make large language models (LLMs) act as a critic to evaluate the quality of generated texts, most of the existing works train a critique generation model on the evaluation…

Computation and Language · Computer Science 2024-06-27 Pei Ke , Bosi Wen , Zhuoer Feng , Xiao Liu , Xuanyu Lei , Jiale Cheng , Shengyuan Wang , Aohan Zeng , Yuxiao Dong , Hongning Wang , Jie Tang , Minlie Huang

Ensuring that large language models (LLMs) reflect diverse user values and preferences is crucial as their user bases expand globally. It is therefore encouraging to see the growing interest in LLM personalization within the research…

Computation and Language · Computer Science 2024-06-18 Yijiang River Dong , Tiancheng Hu , Nigel Collier

Due to their architecture and vast pre-training data, large language models (LLMs) demonstrate strong text classification performance. However, LLM output - here, the category assigned to a text - depends heavily on the wording of the…

Computation and Language · Computer Science 2025-12-04 Kylie L. Anglin , Stephanie Milan , Brittney Hernandez , Claudia Ventura