中文
相关论文

相关论文: Knowledge Dependency Estimation for Reliable Quest…

200 篇论文

Knowledge underpins reasoning. Recent research demonstrates that when relevant knowledge is provided as additional context to commonsense question answering (QA), it can substantially enhance the performance even on top of state-of-the-art.…

计算与语言 · 计算机科学 2022-10-25 Jiacheng Liu , Skyler Hallinan , Ximing Lu , Pengfei He , Sean Welleck , Hannaneh Hajishirzi , Yejin Choi

Extractive QA models have shown very promising performance in predicting the correct answer to a question for a given passage. However, they sometimes result in predicting the correct answer text but in a context irrelevant to the given…

计算与语言 · 计算机科学 2020-11-06 Yeon Seonwoo , Ji-Hoon Kim , Jung-Woo Ha , Alice Oh

Knowledge base question answering (KBQA) is a challenging task that aims to retrieve correct answers from large-scale knowledge bases. Existing attempts primarily focus on entity representation and final answer reasoning, which results in…

计算与语言 · 计算机科学 2023-05-26 Yong Cao , Xianzhi Li , Huiwen Liu , Wen Dai , Shuai Chen , Bin Wang , Min Chen , Daniel Hershcovich

Can engineering neural networks be approached in a disciplined way similar to how engineers build software for civil aircraft? We present nn-dependability-kit, an open-source toolbox to support safety engineering of neural networks for…

机器学习 · 计算机科学 2019-07-30 Chih-Hong Cheng , Chung-Hao Huang , Georg Nührenberg

Large Language Models (LLMs) have revolutionized numerous applications, making them an integral part of our digital ecosystem. However, their reliability becomes critical, especially when these models are exposed to misinformation. We…

计算与语言 · 计算机科学 2024-09-12 Alina Fastowski , Gjergji Kasneci

Large language models (LLMs) encode parametric knowledge about world facts and have shown remarkable performance in knowledge-driven NLP tasks. However, their reliance on parametric knowledge may cause them to overlook contextual cues,…

计算与语言 · 计算机科学 2023-10-24 Wenxuan Zhou , Sheng Zhang , Hoifung Poon , Muhao Chen

We consider the task of KBP slot filling -- extracting relation information from newswire documents for knowledge base construction. We present our pipeline, which employs Relational Dependency Networks (RDNs) to learn linguistic patterns…

人工智能 · 计算机科学 2016-07-05 Dileep Viswanathan , Ameet Soni , Jude Shavlik , Sriraam Natarajan

Vision-language models (VLMs) are increasingly deployed in high-stakes settings where reliable uncertainty quantification (UQ) is as important as predictive accuracy. Extended reasoning via chain-of-thought (CoT) prompting or…

机器学习 · 计算机科学 2026-03-18 Robert Welch , Emir Konuk , Kevin Smith

As Large Language Models (LLMs) are increasingly deployed in real-world applications, reliable uncertainty quantification (UQ) becomes critical for safe and effective use. Most existing UQ approaches for language models aim to produce a…

计算与语言 · 计算机科学 2026-04-14 Maiya Goloburda , Roman Vashurin , Fedor Chernogorsky , Nurkhan Laiyk , Daniil Orel , Preslav Nakov , Maxim Panov

If a Large Language Model (LLM) answers "yes" to the question "Are mountains tall?" then does it know what a mountain is? Can you rely on it responding correctly or incorrectly to other questions about mountains? The success of Large…

计算与语言 · 计算机科学 2022-10-03 Pritish Sahu , Michael Cogswell , Yunye Gong , Ajay Divakaran

In ontology-mediated query answering, access to incomplete data sources is mediated by a conceptual layer constituted by an ontology. To correctly compute answers to queries, it is necessary to perform complex reasoning over the constraints…

数据库 · 计算机科学 2022-08-17 Christian Alrabbaa , Stefan Borgwardt , Patrick Koopmann , Alisa Kovtunova

Latent Chain-of-Thought (Latent CoT) models promise efficient reasoning via continuous representations, yet exhibit puzzling performance inconsistencies: excelling at exploration (ProsQA: 97.0%) but failing at computation (GSM8K: 34.1%). We…

人工智能 · 计算机科学 2026-02-03 Jiaxuan Zou , Yaozhong Xiong , Yong Liu

While large language models (LLMs) demonstrate strong capabilities across diverse user queries, they still suffer from hallucinations, often arising from knowledge misalignment between pre-training and fine-tuning. To address this…

计算与语言 · 计算机科学 2026-04-08 Joosung Lee , Hwiyeol Jo , Donghyeon Ko , Kyubyung Chae , Cheonbok Park , Jeonghoon Kim

Knowledge Tracing (KT) infers a student's knowledge state from past interactions to predict future performance. Conventional Deep Learning (DL)-based KT models are typically tied to platform-specific identifiers and latent representations,…

人工智能 · 计算机科学 2026-04-23 Zhiyi Duan , Hongyu Yuan , Rui Liu

Trusting machine learning algorithms requires having confidence in their outputs. Confidence is typically interpreted in terms of model reliability, where a model is reliable if it produces a high proportion of correct outputs. However,…

机器学习 · 计算机科学 2023-11-01 Jonathan Vandenburgh

The quality of web sources has been traditionally evaluated using exogenous signals such as the hyperlink structure of the graph. We propose a new approach that relies on endogenous signals, namely, the correctness of factual information…

Previous studies have relied on existing question-answering benchmarks to evaluate the knowledge stored in large language models (LLMs). However, this approach has limitations regarding factual knowledge coverage, as it mostly focuses on…

计算与语言 · 计算机科学 2023-10-31 Linhao Luo , Thuy-Trang Vu , Dinh Phung , Gholamreza Haffari

Search engines based on keyword retrieval can no longer adapt to the way of information acquisition in the era of intelligent Internet of Things due to the return of keyword related Internet pages. How to quickly, accurately and effectively…

计算与语言 · 计算机科学 2022-01-03 Gaochen Wu , Bin Xu , Yuxin Qin , Yang Liu , Lingyu Liu , Ziwei Wang

Neural networks (NNs) can achieved high performance in various fields such as computer vision, and natural language processing. However, deploying NNs in resource-constrained safety-critical systems has challenges due to uncertainty in the…

机器学习 · 计算机科学 2024-01-17 Soyed Tuhin Ahmed

Large Language Models (LLMs) have recently emerged as promising tools for knowledge tracing (KT) due to their strong reasoning and generalization abilities. While recent LLM-based KT methods have proposed new prompt formats, they struggle…

计算与语言 · 计算机科学 2025-06-06 JongWoo Kim , SeongYeub Chu , Bryan Wong , Mun Yi