English
Related papers

Related papers: Exploring an LM to generate Prolog Predicates from…

200 papers

Large language models (LLMs) have made impressive progress in handling simple math problems, yet they still struggle with more challenging and complex mathematical tasks. In this paper, we introduce a series of LLMs that employs the…

Computation and Language · Computer Science 2024-07-18 Chengpeng Li , Guanting Dong , Mingfeng Xue , Ru Peng , Xiang Wang , Dayiheng Liu

Large Language Models (LLMs) have demonstrated remarkable zero-shot generalization across various language-related tasks, including search engines. However, existing work utilizes the generative ability of LLMs for Information Retrieval…

Computation and Language · Computer Science 2024-12-31 Weiwei Sun , Lingyong Yan , Xinyu Ma , Shuaiqiang Wang , Pengjie Ren , Zhumin Chen , Dawei Yin , Zhaochun Ren

Ever since the emergence of large language models (LLMs) and related applications, such as ChatGPT, its performance and error analysis for programming tasks have been subject to research. In this work-in-progress paper, we explore the…

Artificial Intelligence · Computer Science 2023-09-04 Natalie Kiesler , Dominic Lohr , Hieke Keuning

We explore and improve the capabilities of LLMs to generate data for grammatical error correction (GEC). When merely producing parallel sentences, their patterns are too simplistic to be valuable as a corpus. To address this issue, we…

Computation and Language · Computer Science 2024-06-12 Jeiyoon Park , Chanjun Park , Heuiseok Lim

Large Language models (LLMs), while powerful, exhibit harmful social biases. Debiasing is often challenging due to computational costs, data constraints, and potential degradation of multi-task language capabilities. This work introduces a…

Computation and Language · Computer Science 2024-09-17 Pengrui Han , Rafal Kocielnik , Adhithya Saravanan , Roy Jiang , Or Sharir , Anima Anandkumar

Generative artificial intelligence (AI) and large language models (LLMs) have gained rapid popularity through publicly available tools such as ChatGPT. The adoption of LLMs for personal and professional use is fueled by the natural…

Computation and Language · Computer Science 2024-07-25 Sinan Abdulhak , Wayne Hubbard , Karthik Gopalakrishnan , Max Z. Li

This paper examines the application of ChatGPT, a large language model (LLM), for question-and-answer (Q&A) tasks in the highly specialized field of nuclear data. The primary focus is on evaluating ChatGPT's performance on a curated test…

Computation and Language · Computer Science 2024-09-04 Muhammad Anwar , Mischa de Costa , Issam Hammad , Daniel Lau

The challenge of formal proof generation has a rich history, but with modern techniques, we may finally be at the stage of making actual progress in real-life mathematical problems. This paper explores the integration of ChatGPT and basic…

Logic in Computer Science · Computer Science 2025-02-20 Sangjun Han , Taeil Hur , Youngmi Hur , Kathy Sangkyung Lee , Myungyoon Lee , Hyojae Lim

Large language models (LLMs), such as GPT series and Llama series have demonstrated strong capabilities in natural language processing, contextual understanding, and text generation. In recent years, researchers are trying to enhance the…

Computation and Language · Computer Science 2024-10-08 Ziyang Chen , Stylios Moscholios

Enhancing the reasoning capabilities of Large Language Models remains a critical challenge in artificial intelligence. We introduce RDoLT, Recursive Decomposition of Logical Thought prompting, a novel framework that significantly boosts LLM…

Computation and Language · Computer Science 2025-01-07 Kaleem Ullah Qasim , Jiashu Zhang , Tariq Alsahfi , Ateeq Ur Rehman Butt

Recent advancements in large language models have showcased their remarkable generalizability across various domains. However, their reasoning abilities still have significant room for improvement, especially when confronted with scenarios…

Computation and Language · Computer Science 2024-03-27 Xufeng Zhao , Mengdi Li , Wenhao Lu , Cornelius Weber , Jae Hee Lee , Kun Chu , Stefan Wermter

Prior work has combined chain-of-thought prompting in large language models (LLMs) with programmatic representations to perform effective and transparent reasoning. While such an approach works well for tasks that only require forward…

Computation and Language · Computer Science 2023-10-13 Xi Ye , Qiaochu Chen , Isil Dillig , Greg Durrett

Large language models (LLMs) have demonstrated impressive performance in code generation, particularly when augmented with chain-of-thought (CoT) prompting techniques. They break down requirements into intermediate reasoning steps, which…

Software Engineering · Computer Science 2025-07-10 Binquan Zhang , Li Zhang , Zhiwen Luo , Yuxin Du , Fang Liu , Song Wang , Lin Shi

Reasoning based on Large Language Models (LLMs) has garnered increasing attention due to outstanding performance of these models in mathematical and complex logical tasks. Beginning with the Chain-of-Thought (CoT) prompting technique,…

Artificial Intelligence · Computer Science 2025-11-27 Yuto Suzuki , Farnoush Banaei-Kashani

The capabilities of large language models (LLMs) have been enhanced by training on data that reflects human thought processes, such as the Chain-of-Thought format. However, evidence suggests that the conventional scheme of next-word…

Computation and Language · Computer Science 2025-06-05 Quang Hieu Pham , Thuy Duong Nguyen , Tung Pham , Anh Tuan Luu , Dat Quoc Nguyen

Chain-of-thought (CoT) has emerged as a groundbreaking tool in NLP, notably for its efficacy in complex reasoning tasks, such as mathematical proofs. However, its application in code generation faces a distinct challenge, i.e., although the…

Software Engineering · Computer Science 2024-02-26 Dong Huang , Qingwen Bu , Yuhao Qing , Heming Cui

Empathetic dialogue is an indispensable part of building harmonious social relationships and contributes to the development of a helpful AI. Previous approaches are mainly based on fine small-scale language models. With the advent of…

Computation and Language · Computer Science 2024-07-29 Yushan Qian , Wei-Nan Zhang , Ting Liu

The Chain-of-Thought (CoT) paradigm has emerged as a critical approach for enhancing the reasoning capabilities of large language models (LLMs). However, despite their widespread adoption and success, CoT methods often exhibit instability…

Artificial Intelligence · Computer Science 2024-09-06 Yu Wang , Shiwan Zhao , Zhihu Wang , Heyuan Huang , Ming Fan , Yubo Zhang , Zhixing Wang , Haijun Wang , Ting Liu

Integrating free-text explanations to in-context learning of large language models (LLM) is shown to elicit strong reasoning capabilities along with reasonable explanations. In this paper, we consider the problem of leveraging the…

Computation and Language · Computer Science 2022-10-14 Shiyang Li , Jianshu Chen , Yelong Shen , Zhiyu Chen , Xinlu Zhang , Zekun Li , Hong Wang , Jing Qian , Baolin Peng , Yi Mao , Wenhu Chen , Xifeng Yan

Large Language Models (LLMs) are primarily trained on high-resource natural languages, limiting their effectiveness in low-resource settings and in tasks requiring deep logical reasoning. This research introduces Rosetta-PL, a benchmark…

Computation and Language · Computer Science 2025-05-06 Shaun Baek , Shaun Esua-Mensah , Cyrus Tsui , Sejan Vigneswaralingam , Abdullah Alali , Michael Lu , Vasu Sharma , Sean O'Brien , Kevin Zhu