English
Related papers

Related papers: General Intelligence Requires Reward-based Pretrai…

200 papers

Achieving human-level intelligence requires refining the transition from the fast, intuitive System 1 to the slower, more deliberate System 2 reasoning. While System 1 excels in quick, heuristic decisions, System 2 relies on logical…

Reasoning is a fundamental aspect of human intelligence that plays a crucial role in activities such as problem solving, decision making, and critical thinking. In recent years, large language models (LLMs) have made significant progress in…

Computation and Language · Computer Science 2023-05-29 Jie Huang , Kevin Chen-Chuan Chang

In this paper, we propose a new approach to building a artificial general intelligence with self awareness, which includes: (1) a new method to implement attention mechanisms; (2) a way to give machines self-demands; (3) how to form a value…

Machine Learning · Computer Science 2025-01-07 Yongcong Chen , Ting Zeng , Xingyue Chen

Artificial intelligence is making spectacular progress, and one of the best examples is the development of large language models (LLMs) such as OpenAI's GPT series. In these lectures, written for readers with a background in mathematics or…

Computation and Language · Computer Science 2023-10-09 Michael R. Douglas

With the development of artificial intelligence (AI), large language models (LLM) are widely used in many fields. However, the reasoning ability of LLM is still very limited when it comes to mathematical reasoning. Mathematics plays an…

Computation and Language · Computer Science 2024-08-06 Wenbei Xie , Donglin Liu , Haoran Yan , Wenjie Wu , Zongyang Liu

This paper introduces an approach to increasing the explainability of artificial intelligence (AI) systems by embedding Large Language Models (LLMs) within standardized analytical processes. While traditional explainable AI (XAI) methods…

Artificial Intelligence · Computer Science 2025-11-11 Marc Jansen , Marcel Pehlke

The development of Large Language Models (LLMs) provides human-centered Artificial General Intelligence (AGI) with a glimmer of hope. Empathy serves as a key emotional attribute of humanity, playing an irreplaceable role in human-centered…

Artificial Intelligence · Computer Science 2024-08-26 Linzhuang Sun , Yao Dong , Nan Xu , Jingxuan Wei , Bihui Yu , Yin Luo

We conduct the first empirical study on using knowledge transfer to improve the generalization ability of large language models (LLMs) in software engineering tasks, which often require LLMs to generalize beyond their training data. Our…

Software Engineering · Computer Science 2023-08-10 Qing Huang , Yishun Wu , Zhenchang Xing , He Jiang , Yu Cheng , Huan Jin

Evaluating reasoning ability in Large Language Models (LLMs) is important for advancing artificial intelligence, as it transcends mere linguistic task performance. It involves understanding whether these models truly understand information,…

Artificial Intelligence · Computer Science 2025-10-29 Benjamin Grando Moreira

Artificial Intelligence (AI) techniques play a pivotal role in optimizing wireless communication networks. However, traditional deep learning approaches often act as closed boxes, lacking the structured reasoning abilities needed to tackle…

Networking and Internet Architecture · Computer Science 2025-09-12 Haoxiang Luo , Yu Yan , Yanhui Bian , Wenjiao Feng , Ruichen Zhang , Yinqiu Liu , Jiacheng Wang , Gang Sun , Dusit Niyato , Hongfang Yu , Abbas Jamalipour , Shiwen Mao

The rapid advancement of large language models (LLMs) has enabled an emergence of agentic artificial intelligence (AI) with powerful reasoning and autonomous decision-making capabilities. This integration with edge computing has led to the…

Artificial Intelligence · Computer Science 2026-02-10 Mingyi Luo , Ruichen Zhang , Xiangwang Hou , Jun Du , Chunxiao Jiang , Yong Ren , Dusit Niyato , Shiwen Mao

Large language models (LLMs) excel on a variety of reasoning benchmarks, but previous studies suggest they sometimes struggle to generalize to unseen questions, potentially due to over-reliance on memorized training examples. However, the…

Computation and Language · Computer Science 2025-04-01 Yihuai Hong , Dian Zhou , Meng Cao , Lei Yu , Zhijing Jin

Edge Intelligence (EI) has been instrumental in delivering real-time, localized services by leveraging the computational capabilities of edge networks. The integration of Large Language Models (LLMs) empowers EI to evolve into the next…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-07 Handi Chen , Weipeng Deng , Shuo Yang , Jinfeng Xu , Zhihan Jiang , Edith C. H. Ngai , Jiangchuan Liu , Xue Liu

Large Language Models (LLMs) have been touted as AI models possessing advanced reasoning abilities. In theory, autoregressive LLMs with Chain-of-Thought (CoT) can perform more serial computations to solve complex reasoning tasks. However,…

Artificial Intelligence · Computer Science 2025-04-08 Rishi Hazra , Gabriele Venturato , Pedro Zuidberg Dos Martires , Luc De Raedt

Reinforcement learning (RL) has become a key technique for enhancing the reasoning abilities of large language models (LLMs), with policy-gradient algorithms dominating the post-training stage because of their efficiency and effectiveness.…

Artificial Intelligence · Computer Science 2025-08-08 Chang Tian , Matthew B. Blaschko , Mingzhe Xing , Xiuxing Li , Yinliang Yue , Marie-Francine Moens

This paper delves into the dynamic landscape of artificial intelligence, specifically focusing on the burgeoning prominence of large language models (LLMs). We underscore the pivotal role of Reinforcement Learning from Human Feedback (RLHF)…

Computers and Society · Computer Science 2024-03-18 Dana Alsagheer , Rabimba Karanjai , Nour Diallo , Weidong Shi , Yang Lu , Suha Beydoun , Qiaoning Zhang

Mathematical reasoning and optimization are fundamental to artificial intelligence and computational problem-solving. Recent advancements in Large Language Models (LLMs) have significantly improved AI-driven mathematical reasoning, theorem…

Artificial Intelligence · Computer Science 2025-03-25 Ali Forootani

A moderately detailed consideration of interactive LLMs as cognitive systems is given, focusing on LLMs circa mid-2023 such as ChatGPT, GPT-4, Bard, Llama, etc.. Cognitive strengths of these systems are reviewed, and then careful attention…

Artificial Intelligence · Computer Science 2023-09-20 Ben Goertzel

Artificial intelligence (AI) has achieved human-level performance in specialized tasks such as Go, image recognition, and protein folding, raising the prospect of an AI singularity-where machines not only match but surpass human reasoning.…

Fluid Dynamics · Physics 2025-12-30 Zhongxin Yang , Yuanwei Bin , Yipeng Shi , Xiang I. A. Yang

Reasoning is a fundamental cognitive process that enables logical inference, problem-solving, and decision-making. With the rapid advancement of large language models (LLMs), reasoning has emerged as a key capability that distinguishes…