English
Related papers

Related papers: The Moral Gap of Large Language Models

200 papers

Large language models (LLMs) have shown significant progress in reasoning tasks. However, recent studies show that transformers and LLMs fail catastrophically once reasoning problems exceed modest complexity. We revisit these findings…

Artificial Intelligence · Computer Science 2025-10-28 Revanth Rameshkumar , Jimson Huang , Yunxin Sun , Fei Xia , Abulhair Saparov

Probing techniques for large language models (LLMs) have primarily focused on English, overlooking the vast majority of the world's languages. In this paper, we extend these probing methods to a multilingual context, investigating the…

Computation and Language · Computer Science 2025-02-03 Daoyang Li , Haiyan Zhao , Qingcheng Zeng , Mengnan Du

Current Large Language Models (LLMs) are unparalleled in their ability to generate grammatically correct, fluent text. LLMs are appearing rapidly, and debates on LLM capacities have taken off, but reflection is lagging behind. Thus, in this…

Computation and Language · Computer Science 2023-11-01 Bram M. A. van Dijk , Tom Kouwenhoven , Marco R. Spruit , Max J. van Duijn

This paper investigates whether large language models (LLMs) are state-of-the-art quality estimators for machine translation of user-generated content (UGC) that contains emotional expressions, without the use of reference translations. To…

Computation and Language · Computer Science 2024-10-10 Shenbin Qian , Constantin Orăsan , Diptesh Kanojia , Félix do Carmo

Detecting hateful content is a challenging and important problem. Automated tools, like machine-learning models, can help, but they require continuous training to adapt to the ever-changing landscape of social media. In this work, we…

Computation and Language · Computer Science 2025-11-06 Jay Patel , Hrudayangam Mehta , Jeremy Blackburn

In this work, we investigate to use Large Language Models (LLMs) for rumor detection on social media. However, it is challenging for LLMs to reason over the entire propagation information on social media, which contains news contents and…

Information Retrieval · Computer Science 2024-02-09 Qiang Liu , Xiang Tao , Junfei Wu , Shu Wu , Liang Wang

Although there has been growing interest in the self-correction capability of Large Language Models (LLMs), there are varying conclusions about its effectiveness. Prior research has largely concentrated on intrinsic self-correction,…

Computation and Language · Computer Science 2026-01-23 Guangliang Liu , Zimo Qi , Xitong Zhang , Lu Cheng , Kristen Marie Johnson

Market sentiment analysis on social media content requires knowledge of both financial markets and social media jargon, which makes it a challenging task for human raters. The resulting lack of high-quality labeled data stands in the way of…

Computation and Language · Computer Science 2022-12-23 Xiang Deng , Vasilisa Bashlovkina , Feng Han , Simon Baumgartner , Michael Bendersky

Large Language Models (LLMs) are increasingly used for accessing information on the web. Their truthfulness and factuality are thus of great interest. To help users make the right decisions about the information they get, LLMs should not…

Computation and Language · Computer Science 2024-04-03 Chenglei Si , Navita Goyal , Sherry Tongshuang Wu , Chen Zhao , Shi Feng , Hal Daumé , Jordan Boyd-Graber

As Large Language Models (LLMs) are increasingly being employed in real-world applications in critical domains such as healthcare, it is important to ensure that the Chain-of-Thought (CoT) reasoning generated by these models faithfully…

Computation and Language · Computer Science 2024-07-02 Sree Harsha Tanneru , Dan Ley , Chirag Agarwal , Himabindu Lakkaraju

Large language models (LLMs) demonstrate outstanding capabilities, but challenges remain regarding their ability to solve complex reasoning tasks, as well as their transparency, robustness, truthfulness, and ethical alignment. In this…

Computers and Society · Computer Science 2023-12-19 Konstantin Hebenstreit , Robert Praas , Matthias Samwald

Large Language Models (LLMs) can achieve strong performance on many tasks by producing step-by-step reasoning before giving a final output, often referred to as chain-of-thought reasoning (CoT). It is tempting to interpret these CoT…

Computation and Language · Computer Science 2023-12-12 Miles Turpin , Julian Michael , Ethan Perez , Samuel R. Bowman

Evaluating reasoning ability in Large Language Models (LLMs) is important for advancing artificial intelligence, as it transcends mere linguistic task performance. It involves understanding whether these models truly understand information,…

Artificial Intelligence · Computer Science 2025-10-29 Benjamin Grando Moreira

There have been rapid advancements in the capabilities of large language models (LLMs) in recent years, greatly revolutionizing the field of natural language processing (NLP) and artificial intelligence (AI) to understand and interact with…

Computation and Language · Computer Science 2024-09-26 Zeyneb N. Kaya , Souvick Ghosh

Large language models (LLMs) are currently at the forefront of intertwining artificial intelligence (AI) systems with human communication and everyday life. Thus, aligning them with human values is of great importance. However, given the…

Computation and Language · Computer Science 2024-06-06 Thilo Hagendorff

There is a growing literature on reasoning by large language models (LLMs), but the discussion on the uncertainty in their responses is still lacking. Our aim is to assess the extent of confidence that LLMs have in their answers and how it…

Computation and Language · Computer Science 2024-12-23 Yudi Pawitan , Chris Holmes

Theory of Mind (ToM), the ability to attribute mental states to others, is fundamental for human social intelligence and a critical capability for advanced Artificial Intelligence. Recent advancements in Large Language Models (LLMs) have…

Computation and Language · Computer Science 2025-05-19 Yi-Long Lu , Chunhui Zhang , Jiajun Song , Lifeng Fan , Wei Wang

Artificial Intelligence (AI) and Large Language Models (LLMs) have rapidly evolved in recent years, showcasing remarkable capabilities in natural language understanding and generation. However, these advancements also raise critical ethical…

Computation and Language · Computer Science 2025-05-09 Yehor Tereshchenko , Mika Hämäläinen

The pervasive influence of social media during the COVID-19 pandemic has been a double-edged sword, enhancing communication while simultaneously propagating misinformation. This \textit{Digital Infodemic} has highlighted the urgent need for…

Computation and Language · Computer Science 2024-12-24 Tanjim Bin Faruk

Cross-modal reasoning (CMR), the intricate process of synthesizing and drawing inferences across divergent sensory modalities, is increasingly recognized as a crucial capability in the progression toward more sophisticated and…

Computation and Language · Computer Science 2024-10-01 Shengsheng Qian , Zuyi Zhou , Dizhan Xue , Bing Wang , Changsheng Xu