English
Related papers

Related papers: Learning to Debug: LLM-Organized Knowledge Trees f…

200 papers

Large language models have shown good potential in supporting software development tasks. This is why more and more developers turn to LLMs (e.g. ChatGPT) to support them in fixing their buggy code. While this can save time and effort, many…

Software Engineering · Computer Science 2024-09-06 Yacine Majdoub , Eya Ben Charrada

Large Language Models (LLMs) have demonstrated impressive capability in many natural language tasks. However, the auto-regressive generation process makes LLMs prone to produce errors, hallucinations and inconsistent statements when…

Artificial Intelligence · Computer Science 2024-07-23 Chaojie Wang , Yanchen Deng , Zhiyi Lyu , Liang Zeng , Jujie He , Shuicheng Yan , Bo An

Large Language Models (LLM) have shown remarkable language capabilities fueling attempts to integrate them into applications across a wide range of domains. An important application area is question answering over private enterprise…

Artificial Intelligence · Computer Science 2024-06-07 Masoomali Fatehkia , Ji Kim Lucas , Sanjay Chawla

Enterprise-scale knowledge management faces significant challenges in integrating multi-source heterogeneous data and enabling effective semantic reasoning. Traditional knowledge graphs often struggle with implicit relationship discovery…

Computation and Language · Computer Science 2026-02-03 Yao Zhang , Hongyin Zhu

Modern large language models (LLMs) are powerful generators driven by statistical next-token prediction. While effective at producing fluent text, this design biases models toward high-probability continuations rather than exhaustive and…

Machine Learning · Computer Science 2026-02-09 Zhaoyang Chen , Cody Fleming

Assessing the reliability of Large Language Models (LLMs) by confidence elicitation is a prominent approach to AI safety in high-stakes applications, such as healthcare and finance. Existing methods either require expensive computational…

Computation and Language · Computer Science 2026-04-08 Zhaohan Zhang , Ziquan Liu , Ioannis Patras

Large language models (LLMs) have shown remarkable promise but remain challenging to continually improve through traditional finetuning, particularly when integrating capabilities from other specialized LLMs. Popular methods like ensemble…

Computation and Language · Computer Science 2025-06-02 Zhenglun Kong , Zheng Zhan , Shiyue Hou , Yifan Gong , Xin Meng , Pengwei Sui , Peiyan Dong , Xuan Shen , Zifeng Wang , Pu Zhao , Hao Tang , Stratis Ioannidis , Yanzhi Wang

Large language models (LLMs) have shown increasing competence in solving mathematical reasoning problems. However, many open-source LLMs still struggle with errors in calculation and semantic understanding during intermediate reasoning…

Computation and Language · Computer Science 2024-12-18 Vernon Y. H. Toh , Deepanway Ghosal , Soujanya Poria

Problem-solving has been a fundamental driver of human progress in numerous domains. With advancements in artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools capable of tackling complex problems across…

Machine Learning · Computer Science 2025-05-07 Da Zheng , Lun Du , Junwei Su , Yuchen Tian , Yuqi Zhu , Jintian Zhang , Lanning Wei , Ningyu Zhang , Huajun Chen

Efficient knowledge management plays a pivotal role in augmenting both the operational efficiency and the innovative capacity of businesses and organizations. By indexing knowledge through vectorization, a variety of knowledge retrieval…

Computation and Language · Computer Science 2024-04-23 Feihu Jiang , Chuan Qin , Kaichun Yao , Chuyu Fang , Fuzhen Zhuang , Hengshu Zhu , Hui Xiong

In real practice, questions are typically complex and knowledge-intensive, requiring Large Language Models (LLMs) to recognize the multifaceted nature of the question and reason across multiple information sources. Iterative and adaptive…

Computation and Language · Computer Science 2025-12-05 Boyi Zhang , Zhuo Liu , Hangfeng He

Large Language Models (LLMs) and their agent systems have recently demonstrated strong potential in automating code reasoning and vulnerability detection. However, when applied to large-scale firmware, their performance degrades due to the…

Cryptography and Security · Computer Science 2025-11-25 Xiangrui Zhang , Zeyu Chen , Haining Wang , Qiang Li

While Large Language Models (LLMs) achieve near-human performance on standard benchmarks, their capabilities often fail to generalize to complex, real-world problems. To bridge this gap, we introduce DeepQuestion, a scalable, automated…

Computation and Language · Computer Science 2026-03-02 Ali Khoramfar , Ali Ramezani , Mohammad Mahdi Mohajeri , Mohammad Javad Dousti , Majid Nili Ahmadabadi , Heshaam Faili

Many automated test generation techniques have been developed to aid developers with writing tests. To facilitate full automation, most existing techniques aim to either increase coverage, or generate exploratory inputs. However, existing…

Software Engineering · Computer Science 2023-07-26 Sungmin Kang , Juyeon Yoon , Shin Yoo

Diffusion Large Language Models (dLLMs) have demonstrated promising generative capabilities and are increasingly used to produce formal languages defined by context-free grammars, such as source code and chemical expressions. However, as…

Computation and Language · Computer Science 2026-02-10 Yitong Zhang , Yongmin Li , Yuetong Liu , Jia Li , Xiaoran Jia , Zherui Li , Ge Li

RTL design often relies heavily on ad-hoc testbench creation early in the design cycle. While large language models (LLMs) show promise for RTL code generation, their ability to reason about hardware specifications and generate targeted…

Hardware Architecture · Computer Science 2026-01-13 Dimple Vijay Kochar , Nathaniel Pinckney , Guan-Ting Liu , Chia-Tung Ho , Chenhui Deng , Haoxing Ren , Brucek Khailany

Large Language Models (LLMs) have demonstrated remarkable capabilities in text generation and understanding, yet their reliance on implicit, unstructured knowledge often leads to factual inaccuracies and limited interpretability. Knowledge…

Computation and Language · Computer Science 2025-06-17 Qinggang Zhang

Large language models (LLMs) are being rapidly integrated into decision-support tools, automation workflows, and AI-enabled software systems. However, their behavior in production environments remains poorly understood, and their failure…

Artificial Intelligence · Computer Science 2025-11-27 Vaishali Vinay

Program repair techniques offer cost-saving benefits for debugging within software development and programming education scenarios. With the proven effectiveness of Large Language Models (LLMs) in code-related tasks, researchers have…

Software Engineering · Computer Science 2024-07-09 Boyang Yang , Haoye Tian , Weiguo Pian , Haoran Yu , Haitao Wang , Jacques Klein , Tegawendé F. Bissyandé , Shunfu Jin

Large Language Models (LLMs) are accelerating scientific idea generation, but rigorously evaluating these numerous, often superficial, AI-generated propositions for novelty and factual accuracy is a critical bottleneck; manual verification…

Artificial Intelligence · Computer Science 2025-07-22 Xin Wang , Jiyao Liu , Yulong Xiao , Junzhi Ning , Lihao Liu , Junjun He , Botian Shi , Kaicheng Yu