English
Related papers

Related papers: Is ChatGPT a Good Causal Reasoner? A Comprehensive…

200 papers

Causal networks are widely used in many fields, including epidemiology, social science, medicine, and engineering, to model the complex relationships between variables. While it can be convenient to algorithmically infer these models…

Artificial Intelligence · Computer Science 2023-12-29 Yanming Zhang , Brette Fitzgibbon , Dino Garofolo , Akshith Kota , Eric Papenhausen , Klaus Mueller

Explanatory inference is the creation and evaluation of hypotheses that provide explanations, and is sometimes known as abduction or abductive inference. Generative AI is a new set of artificial intelligence models based on novel algorithms…

Artificial Intelligence · Computer Science 2024-09-20 Paul Thagard

This report provides a preliminary evaluation of ChatGPT for machine translation, including translation prompt, multilingual translation, and translation robustness. We adopt the prompts advised by ChatGPT to trigger its translation ability…

Computation and Language · Computer Science 2023-11-03 Wenxiang Jiao , Wenxuan Wang , Jen-tse Huang , Xing Wang , Shuming Shi , Zhaopeng Tu

Extractive summarization is a crucial task in natural language processing that aims to condense long documents into shorter versions by directly extracting sentences. The recent introduction of large language models has attracted…

Computation and Language · Computer Science 2023-10-11 Haopeng Zhang , Xiao Liu , Jiawei Zhang

Causal reasoning capabilities are essential for large language models (LLMs) in a wide range of applications, such as education and healthcare. But there is still a lack of benchmarks for a better understanding of such capabilities. Current…

Computation and Language · Computer Science 2024-12-25 Ruibo Tu , Hedvig Kjellström , Gustav Eje Henter , Cheng Zhang

In recent years, personality has been regarded as a valuable personal factor being incorporated into numerous tasks such as sentiment analysis and product recommendation. This has led to widespread attention to text-based personality…

Computation and Language · Computer Science 2023-12-29 Yu Ji , Wen Wu , Hong Zheng , Yi Hu , Xi Chen , Liang He

Causal reasoning, the ability to identify cause-and-effect relationship, is crucial in human thinking. Although large language models (LLMs) succeed in many NLP tasks, it is still challenging for them to conduct complex causal reasoning…

Computation and Language · Computer Science 2023-05-31 Xiao Liu , Da Yin , Chen Zhang , Yansong Feng , Dongyan Zhao

Although large language models (LLMs) have achieved excellent performance in a variety of evaluation benchmarks, they still struggle in complex reasoning tasks which require specific knowledge and multi-hop reasoning. To improve the…

Computation and Language · Computer Science 2023-11-07 Zhipeng Chen , Kun Zhou , Beichen Zhang , Zheng Gong , Wayne Xin Zhao , Ji-Rong Wen

Chain-of-Thought (CoT) prompting can effectively elicit complex multi-step reasoning from Large Language Models~(LLMs). For example, by simply adding CoT instruction ``Let's think step-by-step'' to each input query of MultiArith dataset,…

Artificial Intelligence · Computer Science 2023-04-19 Jiuhai Chen , Lichang Chen , Heng Huang , Tianyi Zhou

ChatGPT, a large-scale language model based on the advanced GPT-3.5 architecture, has shown remarkable potential in various Natural Language Processing (NLP) tasks. However, there is currently a dearth of comprehensive study exploring its…

Computation and Language · Computer Science 2023-04-05 Tao Fang , Shu Yang , Kaixin Lan , Derek F. Wong , Jinpeng Hu , Lidia S. Chao , Yue Zhang

Causal reasoning capability is critical in advancing large language models (LLMs) toward strong artificial intelligence. While versatile LLMs appear to have demonstrated capabilities in understanding contextual causality and providing…

Artificial Intelligence · Computer Science 2025-06-30 Haoang Chi , He Li , Wenjing Yang , Feng Liu , Long Lan , Xiaoguang Ren , Tongliang Liu , Bo Han

Large language models (LLMs) such as ChatGPT and GPT-4 have shown impressive performance in complex reasoning tasks. However, it is difficult to know whether the models are reasoning based on deep understandings of truth and logic, or…

Computation and Language · Computer Science 2023-10-11 Boshi Wang , Xiang Yue , Huan Sun

Large language models (LLMs) such as ChatGPT have demonstrated superior performance on a variety of natural language processing (NLP) tasks including sentiment analysis, mathematical reasoning and summarization. Furthermore, since these…

Computation and Language · Computer Science 2023-10-18 Shiyuan Huang , Siddarth Mamidanna , Shreedhar Jangam , Yilun Zhou , Leilani H. Gilpin

The emergence of ChatGPT has recently garnered significant attention from the computational linguistics community. To demonstrate its capabilities as a keyphrase generator, we conduct a preliminary evaluation of ChatGPT for the keyphrase…

Computation and Language · Computer Science 2023-12-25 Mingyang Song , Haiyun Jiang , Shuming Shi , Songfang Yao , Shilong Lu , Yi Feng , Huafeng Liu , Liping Jing

The ability to robustly identify causal relationships is essential for autonomous decision-making and adaptation to novel scenarios. However, accurately inferring causal structure requires integrating both world knowledge and abstract…

Machine Learning · Computer Science 2025-06-17 Khurram Yamin , Shantanu Gupta , Gaurav R. Ghosal , Zachary C. Lipton , Bryan Wilder

A fundamental goal of scientific research is to learn about causal relationships. However, despite its critical role in the life and social sciences, causality has not had the same importance in Natural Language Processing (NLP), which has…

Although Chain-of-Thought (CoT) has achieved remarkable success in enhancing the reasoning ability of large language models (LLMs), the mechanism of CoT remains a ``black box''. Even if the correct answers can frequently be obtained,…

Machine Learning · Computer Science 2025-02-26 Jiarun Fu , Lizhong Ding , Hao Li , Pengqi Li , Qiuning Wei , Xu Chen

Understanding causality is key to the success of NLP applications, especially in high-stakes domains. Causality comes in various perspectives such as enable and prevent that, despite their importance, have been largely ignored in the…

Computation and Language · Computer Science 2022-04-18 Linyi Yang , Zhen Wang , Yuxiang Wu , Jie Yang , Yue Zhang

While large language models have transformed how we interact with AI systems, they have a critical weakness: they confidently state false information that sounds entirely plausible. This "hallucination" problem has become a major barrier to…

Artificial Intelligence · Computer Science 2025-11-18 Piyushkumar Patel

Causal reasoning is one of the primary bottlenecks that Large Language Models (LLMs) must overcome to attain human-level intelligence. Recent studies indicate that LLMs display near-random performance on reasoning tasks. To address this, we…

Logic in Computer Science · Computer Science 2025-11-10 Abdolmahdi Bagheri , Matin Alinejad , Mahdi Dehshiri , Kevin Bello , Alireza Akhondi-Asl