English
Related papers

Related papers: Is ChatGPT a Good Causal Reasoner? A Comprehensive…

200 papers

The rampant spread of fake news has adversely affected society, resulting in extensive research on curbing its spread. As a notable milestone in large language models (LLMs), ChatGPT has gained significant attention due to its exceptional…

Computation and Language · Computer Science 2024-04-09 Yue Huang , Lichao Sun

I shall quantify the logical faults generated by ChatGPT when applied to reasoning tasks. For experiments, I use the 144 puzzles from the library \url{https://users.utcluj.ro/~agroza/puzzles/maloga}~\cite{groza:fol}. The library contains…

Artificial Intelligence · Computer Science 2023-10-11 Adrian Groza

Apart from what (little) OpenAI may be concealing from us, we all know (roughly) how ChatGPT works (its huge text database, its statistics, its vector representations, and their huge number of parameters, its next-word training, and so on).…

Computation and Language · Computer Science 2025-02-18 Stevan Harnad

The development of explanations for scientific phenomena is essential in science assessment, but scoring student-written explanations remains challenging and resource-intensive. Large language models (LLMs) have shown promise in addressing…

Artificial Intelligence · Computer Science 2025-01-14 Jie Yang , Ehsan Latif , Yuze He , Xiaoming Zhai

Large language models (LLMs) have been utilized in solving diverse reasoning tasks, encompassing common sense, arithmetic and deduction tasks. However, with difficulties of reversing thinking patterns and irrelevant premises, how to…

Artificial Intelligence · Computer Science 2024-09-10 Jinwei He , Feng Lu

Large language models excel at generating fluent text but frequently struggle with structured reasoning involving temporal constraints, causal relationships, and probabilistic reasoning. To address these limitations, we propose Temporal…

Artificial Intelligence · Computer Science 2025-06-24 Hong Qing Yu

Large language models (LLMs) have dramatically enhanced the field of language intelligence, as demonstrably evidenced by their formidable empirical performance across a spectrum of complex reasoning tasks. Additionally, theoretical proofs…

Computation and Language · Computer Science 2023-11-21 Zhuosheng Zhang , Yao Yao , Aston Zhang , Xiangru Tang , Xinbei Ma , Zhiwei He , Yiming Wang , Mark Gerstein , Rui Wang , Gongshen Liu , Hai Zhao

ChatGPT's emergence heralds a transformative phase in NLP, particularly demonstrated through its excellent performance on many English benchmarks. However, the model's efficacy across diverse linguistic contexts remains largely uncharted…

Computation and Language · Computer Science 2023-10-24 Md Tawkat Islam Khondaker , Abdul Waheed , El Moatez Billah Nagoudi , Muhammad Abdul-Mageed

Large Language Models (LLM) have become sophisticated enough that complex computer programs can be created through interpretation of plain English sentences and implemented in a variety of modern languages such as Python, Java Script, C++…

Software Engineering · Computer Science 2023-09-04 Simon Thorne

Causal reasoning is the main learning and explanation tool used by humans. AI systems should possess causal reasoning capabilities to be deployed in the real world with trust and reliability. Introducing the ideas of causality to machine…

Machine Learning · Computer Science 2021-06-11 Abbavaram Gowtham Reddy

Large language models (LLMs) like ChatGPT demonstrate the remarkable progress of artificial intelligence. However, their tendency to hallucinate -- generate plausible but false information -- poses a significant challenge. This issue is…

Computation and Language · Computer Science 2024-06-13 Philip Feldman , James R. Foulds , Shimei Pan

The recently released ChatGPT model demonstrates unprecedented capabilities in zero-shot question-answering. In this work, we probe ChatGPT for its conversational understanding and introduce a conversational framework (protocol) that can be…

Computation and Language · Computer Science 2023-06-06 Laura Cabello , Jiaang Li , Ilias Chalkidis

The emergence of ChatGPT has once again sparked research in generative artificial intelligence (GAI). While people have been amazed by the generated results, they have also noticed the reasoning potential reflected in the generated textual…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Xiaochuan Li , Baoyu Fan , Runze Zhang , Liang Jin , Di Wang , Zhenhua Guo , Yaqian Zhao , Rengang Li

Long-sequence causal reasoning seeks to uncover causal relationships within extended time series data but is hindered by complex dependencies and the challenges of validating causal links. To address the limitations of large-scale language…

Computation and Language · Computer Science 2025-01-03 Yuxuan Zhang , Yulong Li , Zichen Yu , Feilong Tang , Zhixiang Lu , Chong Li , Kang Dang , Jionglong Su

In this case study, we explore the capabilities and limitations of ChatGPT, a natural language processing model developed by OpenAI, in the field of string theoretical swampland conjectures. We find that it is effective at paraphrasing and…

Popular Physics · Physics 2023-01-20 Kay Lehnert

Software logs play an essential role in ensuring the reliability and maintainability of large-scale software systems, as they are often the sole source of runtime information. Log parsing, which converts raw log messages into structured…

Software Engineering · Computer Science 2023-08-22 Van-Hoang Le , Hongyu Zhang

As an essential component of human cognition, cause-effect relations appear frequently in text, and curating cause-effect relations from text helps in building causal networks for predictive tasks. Existing causality extraction techniques…

Information Retrieval · Computer Science 2021-11-02 Jie Yang , Soyeon Caren Han , Josiah Poon

Humans use causality and hypothetical retrospection in their daily decision-making, planning, and understanding of life events. The human mind, while retrospecting a given situation, think about questions such as "What was the cause of the…

Artificial Intelligence · Computer Science 2022-01-12 Utkarshani Jaimini , Amit Sheth

In recent years the search for a proper formal definition of actual causation -- i.e., the relation of cause-effect as it is instantiated in specific observations, rather than general causal relations -- has taken on impressive proportions.…

Artificial Intelligence · Computer Science 2015-03-04 Sander Beckers , Joost Vennekens

Reasoning is a fundamental component of language understanding. Recent prompting techniques, such as chain of thought, have consistently improved LLMs' performance on various reasoning tasks. Nevertheless, there is still little…

Computation and Language · Computer Science 2024-10-01 Haritz Puerto , Martin Tutek , Somak Aditya , Xiaodan Zhu , Iryna Gurevych