English
Related papers

Related papers: Shepherd: A Critic for Language Model Generation

200 papers

We present HealthBench, an open-source benchmark measuring the performance and safety of large language models in healthcare. HealthBench consists of 5,000 multi-turn conversations between a model and an individual user or healthcare…

Ever since the emergence of large language models (LLMs) and related applications, such as ChatGPT, its performance and error analysis for programming tasks have been subject to research. In this work-in-progress paper, we explore the…

Artificial Intelligence · Computer Science 2023-09-04 Natalie Kiesler , Dominic Lohr , Hieke Keuning

OpenAI has released the Chat Generative Pre-trained Transformer (ChatGPT) and revolutionized the approach in artificial intelligence to human-model interaction. Several publications on ChatGPT evaluation test its effectiveness on well-known…

Upon its release in late 2022, ChatGPT has brought a seismic shift in the entire landscape of AI, both in research and commerce. Through instruction-tuning a large language model (LLM) with supervised fine-tuning and reinforcement learning…

Computation and Language · Computer Science 2024-01-17 Hailin Chen , Fangkai Jiao , Xingxuan Li , Chengwei Qin , Mathieu Ravaut , Ruochen Zhao , Caiming Xiong , Shafiq Joty

Large Language Models can emulate different writing styles, ranging from composing poetry that appears indistinguishable from that of famous poets to using slang that can convince people that they are chatting with a human online. While…

Computation and Language · Computer Science 2025-08-25 Vittoria Dentella , Weihang Huang , Silvia Angela Mansi , Jack Grieve , Evelina Leivada

ChatGPT and Bard are AI chatbots based on Large Language Models (LLM) that are slated to promise different applications in diverse areas. In education, these AI technologies have been tested for applications in assessment and teaching. In…

Computation and Language · Computer Science 2023-05-11 Abdolvahab Khademi

We investigate the potential of ChatGPT as a multidimensional evaluator for the task of \emph{Text Style Transfer}, alongside, and in comparison to, existing automatic metrics as well as human judgements. We focus on a zero-shot setting,…

Computation and Language · Computer Science 2023-04-27 Huiyuan Lai , Antonio Toral , Malvina Nissim

Automatic methods for generating and gathering linguistic data have proven effective for fine-tuning Language Models (LMs) in languages less resourced than English. Still, while there has been emphasis on data quantity, less attention has…

Computation and Language · Computer Science 2024-06-12 Daniela Occhipinti , Michele Marchi , Irene Mondella , Huiyuan Lai , Felice Dell'Orletta , Malvina Nissim , Marco Guerini

Large language models (LLMs) have shown excellent mastering of human language, but still struggle in real-world applications that require mathematical problem-solving. While many strategies and datasets to enhance LLMs' mathematics are…

Computation and Language · Computer Science 2024-04-04 Yifan Xu , Xiao Liu , Xinghan Liu , Zhenyu Hou , Yueyan Li , Xiaohan Zhang , Zihan Wang , Aohan Zeng , Zhengxiao Du , Wenyi Zhao , Jie Tang , Yuxiao Dong

Generative AI and large language models hold great promise in enhancing programming education by generating individualized feedback and hints for learners. Recent works have primarily focused on improving the quality of generated feedback…

Machine Learning · Computer Science 2025-03-10 Nachiket Kotalwar , Alkis Gotovos , Adish Singla

Generative language models are promising for assisting human writing in various domains. This manuscript aims to build generative language models in the patent domain and evaluate model performance from a human-centric perspective. The…

Computation and Language · Computer Science 2023-06-06 Jieh-Sheng Lee

Over the past decade, predictive language modeling for code has proven to be a valuable tool for enabling new forms of automation for developers. More recently, we have seen the advent of general purpose "large language models", based on…

Software Engineering · Computer Science 2023-06-05 Sajed Jalil , Suzzana Rafi , Thomas D. LaToza , Kevin Moran , Wing Lam

Learning from human preferences is important for language models to match human needs and to align with human and social values. Prior works have achieved remarkable successes by learning from human feedback to understand and follow…

Machine Learning · Computer Science 2023-10-19 Hao Liu , Carmelo Sferrazza , Pieter Abbeel

End-to-end spoken dialogue models such as GPT-4o-audio have recently garnered significant attention in the speech domain. However, the evaluation of spoken dialogue models' conversational performance has largely been overlooked. This is…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-24 Shengpeng Ji , Tianle Liang , Yangzhuo Li , Jialong Zuo , Minghui Fang , Jinzheng He , Yifu Chen , Zhengqing Liu , Ziyue Jiang , Xize Cheng , Siqi Zheng , Jin Xu , Junyang Lin , Zhou Zhao

This paper explores the potential of leveraging Large Language Models (LLMs) for data augmentation in multilingual commonsense reasoning datasets where the available training data is extremely limited. To achieve this, we utilise several…

Computation and Language · Computer Science 2023-10-24 Chenxi Whitehouse , Monojit Choudhury , Alham Fikri Aji

Pre-trained language models have been widely used in dependency parsing task and have achieved significant improvements in parser performance. However, it remains an understudied question whether pre-trained language models can…

Computation and Language · Computer Science 2023-10-26 Boda Lin , Xinyi Zhou , Binghao Tang , Xiaocheng Gong , Si Li

We propose TuringAdvice, a new challenge task and dataset for language understanding models. Given a written situation that a real person is currently facing, a model must generate helpful advice in natural language. Our evaluation…

Computation and Language · Computer Science 2021-04-14 Rowan Zellers , Ari Holtzman , Elizabeth Clark , Lianhui Qin , Ali Farhadi , Yejin Choi

Sycophancy refers to the tendency of a large language model to align its outputs with the user's perceived preferences, beliefs, or opinions, in order to look favorable, regardless of whether those statements are factually correct. This…

Artificial Intelligence · Computer Science 2024-12-05 María Victoria Carro

Parameter Efficient Finetuning (PEFT) has emerged as a viable solution for improving the performance of Large Language Models (LLMs) without requiring massive resources and compute. Prior work on multilingual evaluation has shown that there…

Computation and Language · Computer Science 2024-07-23 Divyanshu Aggarwal , Ashutosh Sathe , Ishaan Watts , Sunayana Sitaram

In the era of artificial intelligence, data is gold but costly to annotate. The paper demonstrates a groundbreaking solution to this dilemma using ChatGPT for text augmentation in sentiment analysis. We leverage ChatGPT's generative…

Computation and Language · Computer Science 2023-12-11 Stanisław Woźniak , Jan Kocoń