English
Related papers

Related papers: Investigating Language Model Capabilities to Repre…

200 papers

We are interested in understanding how well Transformer language models (TLMs) can perform reasoning tasks when trained on knowledge encoded in the form of natural language. We investigate their systematic generalization abilities on a…

Machine Learning · Computer Science 2020-10-22 Nicolas Gontier , Koustuv Sinha , Siva Reddy , Christopher Pal

Do large language models (LLMs) display rational reasoning? LLMs have been shown to contain human biases due to the data they have been trained on; whether this is reflected in rational reasoning remains less clear. In this paper, we answer…

Computation and Language · Computer Science 2024-02-16 Olivia Macmillan-Scott , Mirco Musolesi

Large language models (LLMs) have showcased remarkable reasoning capabilities, yet they remain susceptible to errors, particularly in temporal reasoning tasks involving complex temporal logic. Existing research has explored LLM performance…

Computation and Language · Computer Science 2024-06-14 Bahare Fatemi , Mehran Kazemi , Anton Tsitsulin , Karishma Malkan , Jinyeong Yim , John Palowitch , Sungyong Seo , Jonathan Halcrow , Bryan Perozzi

Large Language Models have been found to create plans that are neither executable nor verifiable in grounded environments. An emerging line of work demonstrates success in using the LLM as a formalizer to generate a formal representation of…

Computation and Language · Computer Science 2025-06-03 Cassie Huang , Li Zhang

Large language models have demonstrated remarkable capabilities across a wide range of tasks, yet their ability to process structured symbolic knowledge remains underexplored. To address this gap, we propose a taxonomy of ontological…

Computation and Language · Computer Science 2025-10-03 Xiao Zhang , Huiyuan Lai , Qianru Meng , Johan Bos

Large Language Models (LLMs) have recently demonstrated remarkable capabilities in natural language processing tasks and beyond. This success of LLMs has led to a large influx of research contributions in this direction. These works…

Computation and Language · Computer Science 2024-10-18 Humza Naveed , Asad Ullah Khan , Shi Qiu , Muhammad Saqib , Saeed Anwar , Muhammad Usman , Naveed Akhtar , Nick Barnes , Ajmal Mian

Recent large language models (LLMs) have demonstrated promising capabilities in modeling real-world knowledge and enhancing knowledge-based generation tasks. In this paper, we further explore the potential of using LLMs to aid in the design…

Robotics · Computer Science 2024-11-04 Weicheng Ma , Luyang Zhao , Chun-Yi She , Yitao Jiang , Alan Sun , Bo Zhu , Devin Balkcom , Soroush Vosoughi

Knowledge Base Question Answering (KBQA) aims to answer natural language questions based on facts in knowledge bases. A typical approach to KBQA is semantic parsing, which translates a question into an executable logical form in a formal…

Computation and Language · Computer Science 2024-06-17 Jinxin Liu , Shulin Cao , Jiaxin Shi , Tingjian Zhang , Lunyiu Nie , Linmei Hu , Lei Hou , Juanzi Li

Over the past few years, the abilities of large language models (LLMs) have received extensive attention, which have performed exceptionally well in complicated scenarios such as logical reasoning and symbolic inference. A significant…

Computation and Language · Computer Science 2024-02-20 Junbing Yan , Chengyu Wang , Jun Huang , Wei Zhang

The use of Large Language Models (LLMs) has drawn growing interest within the scientific community. LLMs can handle large volumes of textual data and support methods for evidence synthesis. Although recent studies highlight the potential of…

Software Engineering · Computer Science 2026-02-12 Cauã Ferreira Barros , Marcos Kalinowski , Mohamad Kassab , Valdemar Vicente Graciano Neto

Large Language Models (LLMs) are widely used for writing economic analysis reports or providing financial advice, but their ability to understand economic knowledge and reason about potential results of specific economic events lacks…

Computation and Language · Computer Science 2024-07-02 Yue Guo , Yi Yang

Investigating whether pre-trained language models (LMs) can function as knowledge bases (KBs) has raised wide research interests recently. However, existing works focus on simple, triple-based, relational KBs, but omit more sophisticated,…

Computation and Language · Computer Science 2023-05-09 Yuan He , Jiaoyan Chen , Ernesto Jiménez-Ruiz , Hang Dong , Ian Horrocks

The profusion of knowledge encoded in large language models (LLMs) and their ability to apply this knowledge zero-shot in a range of settings makes them promising candidates for use in decision-making. However, they are currently limited by…

Computation and Language · Computer Science 2026-05-08 Gabriel Freedman , Adam Dejl , Deniz Gorur , Xiang Yin , Antonio Rago , Francesca Toni

Ontologies of research topics are crucial for structuring scientific knowledge, enabling scientists to navigate vast amounts of research, and forming the backbone of intelligent systems such as search engines and recommendation systems.…

Digital Libraries · Computer Science 2025-06-12 Tanay Aggarwal , Angelo Salatino , Francesco Osborne , Enrico Motta

The potential for Large Language Models (LLMs) to generate new information offers a potential step change for research and innovation. This is challenging to assert as it can be difficult to determine what an LLM has previously seen during…

Computation and Language · Computer Science 2024-05-24 Thomas Greatrix , Roger Whitaker , Liam Turner , Walter Colombo

Efforts to apply transformer-based language models (TLMs) to the problem of reasoning in natural language have enjoyed ever-increasing success in recent years. The most fundamental task in this area to which nearly all others can be reduced…

Computation and Language · Computer Science 2025-08-26 Tharindu Madusanka , Ian Pratt-Hartmann , Riza Batista-Navarro

Recent studies show that large language models (LLMs) are powerful tools for working with natural language, bringing advances in many areas of computational linguistics. However, these models face challenges when applied to low-resource…

Computation and Language · Computer Science 2024-12-09 Zhaojun Ding , Zhengliang Liu , Hanqi Jiang , Yizhu Gao , Xiaoming Zhai , Tianming Liu , Ninghao Liu

A Large Language Model (LLM) represents a cutting-edge artificial intelligence model that generates coherent content, including grammatically precise sentences, human-like paragraphs, and syntactically accurate code snippets. LLMs can play…

Software Engineering · Computer Science 2023-12-11 Robson Santos , Italo Santos , Cleyton Magalhaes , Ronnie de Souza Santos

Integrating knowledge graphs (KGs) into the reasoning processes of large language models (LLMs) has emerged as a promising approach to mitigate hallucination. However, existing work in this area often relies on proprietary or extremely…

Computation and Language · Computer Science 2025-09-10 Yi-Jie Cheng , Oscar Chew , Yun-Nung Chen

Large Language Models (LLMs) have introduced a paradigm shift in interaction with AI technology, enabling knowledge workers to complete tasks by specifying their desired outcome in natural language. LLMs have the potential to increase…

Human-Computer Interaction · Computer Science 2025-03-24 Michelle Brachman , Amina El-Ashry , Casey Dugan , Werner Geyer