English
Related papers

Related papers: UniKnow: A Unified Framework for Reliable Language…

200 papers

Knowledge probing quantifies how much relational knowledge a language model (LM) has acquired during pre-training. Existing knowledge probes evaluate model capabilities through metrics like prediction accuracy and precision. Such…

Computation and Language · Computer Science 2026-01-28 Christopher Kissling , Elena Merdjanovska , Alan Akbik

LLMs and AI chatbots have improved people's efficiency in various fields. However, the necessary knowledge for answering the question may be beyond the models' knowledge boundaries. To mitigate this issue, many researchers try to introduce…

Computation and Language · Computer Science 2023-11-15 Yi Liu , Lianzhe Huang , Shicheng Li , Sishuo Chen , Hao Zhou , Fandong Meng , Jie Zhou , Xu Sun

Unified Structured Knowledge Reasoning (USKR) aims to answer natural language questions (NLQs) by using structured sources such as tables, databases, and knowledge graphs in a unified way. Existing USKR methods either rely on employing…

Computation and Language · Computer Science 2025-09-24 Yongrui Chen , Junhao He , Linbo Fu , Shenyu Zhang , Rihui Jin , Xinbang Dai , Jiaqi Li , Dehai Min , Nan Hu , Yuxin Zhang , Guilin Qi , Yi Huang , Tongtong Wu

Large language models (LLMs) encode vast world knowledge but struggle to stay up-to-date, often leading to errors and hallucinations. Knowledge editing offers an efficient alternative to retraining, enabling targeted modifications by…

Computation and Language · Computer Science 2025-06-03 Weitao Ma , Xiyuan Du , Xiaocheng Feng , Lei Huang , Yichong Huang , Huiyi Zhang , Xiaoliang Yang , Baohang Li , Xiachong Feng , Ting Liu , Bing Qin

We present a framework for systematically combining data of an unknown linear time-invariant system with prior knowledge on the system matrices or on the uncertainty for robust controller design. Our approach leads to linear matrix…

Systems and Control · Electrical Eng. & Systems 2024-12-04 Julian Berberich , Carsten W. Scherer , Frank Allgöwer

Large language models (LLMs) are increasingly deployed in agentic and multi-turn workflows where they are tasked to perform actions of significant consequence. In order to deploy them reliably and manage risky outcomes in these settings, it…

Machine Learning · Computer Science 2026-02-10 Arka Pal , Teo Kitanovski , Arthur Liang , Akilesh Potti , Micah Goldblum

This paper introduces a novel, multi-source framework for the relational validation of Large Language Models (LLMs). While existing benchmarks have demonstrated LLMs' proficiency at factual recall, their ability to understand and reproduce…

Social and Information Networks · Computer Science 2026-05-22 Moses Boudourides

Vision-Language Models (VLMs), such as CLIP, play a foundational role in various cross-modal applications. To fully leverage VLMs' potential in adapting to downstream tasks, context optimization methods like Prompt Tuning are essential.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Enming Zhang , Bingke Zhu , Yingying Chen , Qinghai Miao , Ming Tang , Jinqiao Wang

We present KNOW--the Knowledge Navigator Ontology for the World--the first ontology designed to capture everyday knowledge to augment large language models (LLMs) in real-world generative AI use cases such as personal AI assistants. Our…

Artificial Intelligence · Computer Science 2024-05-31 Arto Bendiken

In recent years, substantial advancements have been made in the development of large language models, achieving remarkable performance across diverse tasks. To evaluate the knowledge ability of language models, previous studies have…

Computation and Language · Computer Science 2024-05-30 Xunjian Yin , Xu Zhang , Jie Ruan , Xiaojun Wan

The interest in Artificial Intelligence (AI) and its applications has seen unprecedented growth in the last few years. The success can be partly attributed to the advancements of deep neural networks made in the sub-fields of AI such as…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Xuewen Yang

We study open-domain question answering with structured, unstructured and semi-structured knowledge sources, including text, tables, lists and knowledge bases. Departing from prior work, we propose a unifying approach that homogenizes all…

Computation and Language · Computer Science 2022-05-05 Barlas Oguz , Xilun Chen , Vladimir Karpukhin , Stan Peshterliev , Dmytro Okhonko , Michael Schlichtkrull , Sonal Gupta , Yashar Mehdad , Scott Yih

Reliable uncertainty quantification (UQ) is essential when employing large language models (LLMs) in high-risk domains such as clinical question answering (QA). In this work, we evaluate uncertainty estimation methods for clinical QA…

Computation and Language · Computer Science 2026-01-27 Alberto Testoni , Iacer Calixto

In the era of Large Language Models (LLMs), tremendous strides have been made in the field of multimodal understanding. However, existing advanced algorithms are limited to effectively utilizing the immense representation capabilities and…

Artificial Intelligence · Computer Science 2023-09-06 Hao Feng , Zijian Wang , Jingqun Tang , Jinghui Lu , Wengang Zhou , Houqiang Li , Can Huang

Although large language models (LLMs) excel in knowledge recall and reasoning, their static nature leads to outdated information as the real world evolves or when adapting to domain-specific knowledge, highlighting the need for effective…

Computation and Language · Computer Science 2025-04-02 Ruoxi Xu , Yunjie Ji , Boxi Cao , Yaojie Lu , Hongyu Lin , Xianpei Han , Ben He , Yingfei Sun , Xiangang Li , Le Sun

While 3D body reconstruction methods have made remarkable progress recently, it remains difficult to acquire the sufficiently accurate and numerous 3D supervisions required for training. In this paper, we propose \textbf{KNOWN}, a framework…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Yufei Zhang , Hanjing Wang , Jeffrey O. Kephart , Qiang Ji

Significant research efforts have been made to scale and improve vision-language model (VLM) training approaches. Yet, with an ever-growing number of benchmarks, researchers are tasked with the heavy burden of implementing each protocol,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Haider Al-Tahan , Quentin Garrido , Randall Balestriero , Diane Bouchacourt , Caner Hazirbas , Mark Ibrahim

Step-by-step reasoning has become a standard approach for large language models (LLMs) to tackle complex tasks. While this paradigm has proven effective, it raises a fundamental question: How can we verify that an LLM's reasoning is…

Computation and Language · Computer Science 2025-11-04 Hyeon Hwang , Yewon Cho , Chanwoong Yoon , Yein Park , Minju Song , Kyungjae Lee , Gangwoo Kim , Jaewoo Kang

Deep neural networks have become foundational to advancements in multiple domains, including recommendation systems, natural language processing, and so on. Despite their successes, these models often contain incompatible parameters that…

Machine Learning · Computer Science 2025-03-04 Zheqi Lv , Keming Ye , Zishu Wei , Qi Tian , Shengyu Zhang , Wenqiao Zhang , Wenjie Wang , Kun Kuang , Tat-Seng Chua , Fei Wu

Recent research has shown that integrating domain knowledge into deep learning architectures is effective -- it helps reduce the amount of required data, improves the accuracy of the models' decisions, and improves the interpretability of…