English
Related papers

Related papers: IDEA2: Expert-in-the-loop competency question elic…

200 papers

Automating the translation of natural language (NL) software requirements into formal specifications remains a critical challenge in scaling formal verification practices to industrial settings, particularly in safety-critical domains.…

Software Engineering · Computer Science 2025-12-22 Zhi Ma , Cheng Wen , Zhexin Su , Xiao Liang , Cong Tian , Shengchao Qin , Mengfei Yang

Large language models (LLMs) have demonstrated remarkable performance on question-answering (QA) tasks because of their superior capabilities in natural language understanding and generation. However, LLM-based QA struggles with complex QA…

Computation and Language · Computer Science 2025-09-23 Chuangtao Ma , Yongrui Chen , Tianxing Wu , Arijit Khan , Haofen Wang

We investigate how large language models can be used as research tools in scientific computing while preserving mathematical rigor. We propose a human-in-the-loop workflow for interactive theorem proving and discovery with LLMs. Human…

Human-Computer Interaction · Computer Science 2025-12-12 Chenyi Li , Zhijian Lai , Dong An , Jiang Hu , Zaiwen Wen

Background. Endowing intelligent systems with semantic data commonly requires designing and instantiating ontologies with domain-specific knowledge. Especially in the early phases, those activities are typically performed manually by human…

Artificial Intelligence · Computer Science 2025-01-24 Giovanni Ciatto , Andrea Agiollo , Matteo Magnini , Andrea Omicini

Large Language Models (LLMs) are key technologies driving intelligent systems to handle multiple tasks. To meet the demands of various tasks, an increasing number of LLMs-driven experts with diverse capabilities have been developed,…

Artificial Intelligence · Computer Science 2024-12-06 Yuanshuai Wang , Xingjian Zhang , Jinkun Zhao , Siwei Wen , Peilin Feng , Shuhao Liao , Lei Huang , Wenjun Wu

Recent advancements in Large Language Models (LLMs) have showcased striking results on existing logical reasoning benchmarks, with some models even surpassing human performance. However, the true depth of their competencies and robustness…

Computation and Language · Computer Science 2024-11-05 Pengfei Hong , Navonil Majumder , Deepanway Ghosal , Somak Aditya , Rada Mihalcea , Soujanya Poria

The preservation of intangible cultural heritage is a critical challenge as collective memory fades over time. While Large Language Models (LLMs) offer a promising avenue for generating engaging narratives, their propensity for factual…

Artificial Intelligence · Computer Science 2026-04-06 Naga Sowjanya Barla , Jacopo de Berardinis

Entity Alignment (EA) is vital for integrating diverse knowledge graph (KG) data, playing a crucial role in data-driven AI applications. Traditional EA methods primarily rely on comparing entity embeddings, but their effectiveness is…

Computation and Language · Computer Science 2024-10-11 Xuhui Jiang , Yinghan Shen , Zhichao Shi , Chengjin Xu , Wei Li , Zixuan Li , Jian Guo , Huawei Shen , Yuanzhuo Wang

Large Language Models (LLMs) have achieved state-of-the-art accuracies in a variety of natural language processing (NLP) tasks. However, this success comes at the cost of increased model sizes which leads to additional computational burden.…

Machine Learning · Computer Science 2025-12-01 Shrihari Sridharan , Sourjya Roy , Anand Raghunathan , Kaushik Roy

Large language models (LLMs) have demonstrated remarkable performance in a wide range of natural language tasks. However, as these models continue to grow in size, they face significant challenges in terms of computational costs.…

Computation and Language · Computer Science 2023-08-08 Ankush Agarwal , Sakharam Gawade , Amar Prakash Azad , Pushpak Bhattacharyya

The organization of latent knowledge within large-scale models poses unique challenges when addressing overlapping representations and optimizing contextual accuracy. Conceptual redundancies embedded across layers often result in…

Computation and Language · Computer Science 2025-03-26 Joseph Sakau , Evander Kozlowski , Roderick Thistledown , Basil Steinberger

Knowledge graphs have become the primary vehicle for data integration and are critical to the success of modern AI, but the diversity of KG modelling practices, from lightweight vocabularies to richly axiomatised ontologies, makes…

Artificial Intelligence · Computer Science 2026-05-26 Enrico Daga , Valentina Tamma , Terry Payne

This study explores the potential of large language models (LLMs) for identifying and examining intertextual relationships within biblical, Koine Greek texts. By evaluating the performance of LLMs on various intertextuality scenarios the…

Computation and Language · Computer Science 2024-10-01 Ray Umphrey , Jesse Roberts , Lindsey Roberts

Ontologies are pivotal for structuring knowledge bases to enhance question answering (QA) systems powered by Large Language Models (LLMs). However, traditional ontology creation relies on manual efforts by domain experts, a process that is…

Artificial Intelligence · Computer Science 2025-06-03 Yash Tiwari , Owais Ahmad Lone , Mayukha Pal

Community Question Answering (CQA) websites can be claimed as the most major venues for knowledge sharing, and the most effective way of exchanging knowledge at present. Considering that massive amount of users are participating online and…

Information Retrieval · Computer Science 2018-10-29 Chaoran Huang , Lina Yao , Xianzhi Wang , Boualem Benatallah , Xiang Zhang

Large Language Models (LLMs) are transforming scholarly tasks like search and summarization, but their reliability remains uncertain. Current evaluation metrics for testing LLM reliability are primarily automated approaches that prioritize…

Human-Computer Interaction · Computer Science 2026-02-25 Anna Martin-Boyle , William Humphreys , Martha Brown , Cara Leckey , Harmanpreet Kaur

Large language models (LLMs) are incredibly powerful at comprehending and generating data in the form of text, but are brittle and error-prone. There has been an advent of toolkits and recipes centered around so-called prompt…

Databases · Computer Science 2023-08-09 Aditya G. Parameswaran , Shreya Shankar , Parth Asawa , Naman Jain , Yujie Wang

Human-AI conversation frequently relies on quoting earlier text-"check it with the formula I just highlighted"-yet today's large language models (LLMs) lack an explicit mechanism for locating and exploiting such spans. We formalise the…

Artificial Intelligence · Computer Science 2025-06-02 Yueqi Zhang , Peiwen Yuan , Shaoxiong Feng , Yiwei Li , Xinglin Wang , Jiayi Shi , Chuyi Tan , Boyuan Pan , Yao Hu , Kan Li

Recent advances in large language models (LLMs) have accelerated AI-assisted software development, yet practical deployment remains constrained by incomplete implementations, weak modularization, and inconsistent security practices. We…

Software Engineering · Computer Science 2026-03-13 Yen-Ku Liu , Yun-Cheng Tsai

Domain-specific quantitative reasoning remains a major challenge for large language models (LLMs), especially in fields requiring expert knowledge and complex question answering (QA). In this work, we propose Expert Question Decomposition…

Computation and Language · Computer Science 2025-10-03 Mengyu Wang , Sotirios Sabanis , Miguel de Carvalho , Shay B. Cohen , Tiejun Ma