English
Related papers

Related papers: Knowledge Base Completion: Baselines Strike Back

200 papers

Recent advancements in multi-modal artificial intelligence (AI) have revolutionized the fields of stock market forecasting and heart rate monitoring. Utilizing diverse data sources can substantially improve prediction accuracy. Nonetheless,…

Machine Learning · Computer Science 2024-03-21 Zihong Luo , Zheng Tao , Yuxuan Huang , Kexin He , Chengzhi Liu

Reliable uncertainty calibration is essential for safely deploying deep neural networks in high-stakes applications. Deep neural networks are known to exhibit systematic overconfidence, especially under distribution shifts. Although…

Machine Learning · Computer Science 2025-06-12 Achim Hekler , Lukas Kuhn , Florian Buettner

Knowledge base completion is formulated as a binary classification problem in this work, where an XGBoost binary classifier is trained for each relation using relevant links in knowledge graphs (KGs). The new method, named KGBoost, adopts a…

Machine Learning · Computer Science 2022-04-08 Yun-Cheng Wang , Xiou Ge , Bin Wang , C. -C. Jay Kuo

Fine-tuning pre-trained transformer-based language models such as BERT has become a common practice dominating leaderboards across various NLP benchmarks. Despite the strong empirical performance of fine-tuned models, fine-tuning is an…

Machine Learning · Computer Science 2021-03-26 Marius Mosbach , Maksym Andriushchenko , Dietrich Klakow

Knowledge graph completion refers to predicting missing triples. Most approaches achieve this goal by predicting entities, given an entity and a relation. We predict missing triples via the relation prediction. To this end, we frame the…

Machine Learning · Computer Science 2021-01-25 Caglar Demir , Diego Moussallem , Axel-Cyrille Ngonga Ngomo

Recent work establishes dataset difficulty and removes annotation artifacts via partial-input baselines (e.g., hypothesis-only models for SNLI or question-only models for VQA). When a partial-input baseline gets high accuracy, a dataset is…

Machine Learning · Computer Science 2019-06-19 Shi Feng , Eric Wallace , Jordan Boyd-Graber

A vast amount of instruction tuning data is crucial for the impressive performance of Large Multimodal Models (LMMs), but the associated computational costs and data collection demands during supervised fine-tuning make it impractical for…

Machine Learning · Computer Science 2025-07-22 Haiyang Guo , Fanhu Zeng , Fei Zhu , Wenzhuo Liu , Da-Han Wang , Jian Xu , Xu-Yao Zhang , Cheng-Lin Liu

Foundation models serve as the backbone for numerous specialized models developed through fine-tuning. However, when the underlying pretrained model is updated or retrained (e.g., on larger and more curated datasets), the fine-tuned model…

Obtaining labeled data to train a model for a task of interest is often expensive. Prior work shows training models on multitask data augmented with task descriptions (prompts) effectively transfers knowledge to new tasks. Towards…

Computation and Language · Computer Science 2023-05-26 Hamish Ivison , Noah A. Smith , Hannaneh Hajishirzi , Pradeep Dasigi

Pre-trained and fine-tuned transformer models like BERT and T5 have improved the state of the art in ad-hoc retrieval and question-answering, but not as yet in high-recall information retrieval, where the objective is to retrieve…

Information Retrieval · Computer Science 2022-08-16 Nima Sadri , Gordon V. Cormack

Deep networks have shown remarkable performance across a wide range of tasks, yet getting a global concept-level understanding of how they function remains a key challenge. Many post-hoc concept-based approaches have been introduced to…

Machine Learning · Computer Science 2026-04-15 Amin Parchami-Araghi , Sukrut Rao , Jonas Fischer , Bernt Schiele

Recent papers address the issue of updating the instance level of knowledge bases expressed in Description Logic following a model-based approach. One of the outcomes of these papers is that the result of updating a knowledge base K is…

Artificial Intelligence · Computer Science 2011-04-21 Maurizio Lenzerini , Domenico Fabio Savo

Knowledge base construction (KBC) is the process of populating a knowledge base, i.e., a relational database together with inference rules, with information extracted from documents and structured sources. KBC blurs the distinction between…

Databases · Computer Science 2014-09-19 Christopher Ré , Amir Abbas Sadeghian , Zifei Shan , Jaeho Shin , Feiran Wang , Sen Wu , Ce Zhang

While several matrix factorization (MF) and tensor factorization (TF) models have been proposed for knowledge base (KB) inference, they have rarely been compared across various datasets. Is there a single model that performs well across…

Artificial Intelligence · Computer Science 2017-06-05 Prachi Jain , Shikhar Murty , Mausam , Soumen Chakrabarti

The task of inductive knowledge graph completion requires models to learn inference patterns from a training graph, which can then be used to make predictions on a disjoint test graph. Rule-based methods seem like a natural fit for this…

Artificial Intelligence · Computer Science 2024-03-26 Akash Anil , Víctor Gutiérrez-Basulto , Yazmín Ibañéz-García , Steven Schockaert

This paper presents a parameter-lite transfer learning approach of pretrained language models (LM) for knowledge graph (KG) completion. Instead of finetuning, which modifies all LM parameters, we only tune a few new parameters while keeping…

Computation and Language · Computer Science 2022-10-26 Jianhao Shen , Chenguang Wang , Ye Yuan , Jiawei Han , Heng Ji , Koushik Sen , Ming Zhang , Dawn Song

Knowledge bases provide applications with the benefit of easily accessible, systematic relational knowledge but often suffer in practice from their incompleteness and lack of knowledge of new entities and relations. Much work has focused on…

Computation and Language · Computer Science 2013-03-19 Danqi Chen , Richard Socher , Christopher D. Manning , Andrew Y. Ng

Configuration tuning is critical for database performance. Although recent advancements in database tuning have shown promising results in throughput and latency improvement, challenges remain. First, the vast knob space makes direct…

Databases · Computer Science 2025-11-10 Xinyue Yang , Chen Zheng , Yaoyang Hou , Renhao Zhang , Yinyan Zhang , Yanjun Wu , Heng Zhang

With the advent of DeepSeek-R1, a new wave of reinforcement learning (RL) methods has emerged that seem to unlock stronger mathematical reasoning. However, a closer look at the open-source ecosystem reveals a critical limitation: with…

Machine Learning · Computer Science 2025-10-14 Prasanna Mayilvahanan , Ricardo Dominguez-Olmedo , Thaddäus Wiedemer , Wieland Brendel

Since large knowledge bases are typically incomplete, missing facts need to be inferred from observed facts in a task called knowledge base completion. The most successful approaches to this task have typically explored explicit paths…

Artificial Intelligence · Computer Science 2018-04-24 Yelong Shen , Po-Sen Huang , Ming-Wei Chang , Jianfeng Gao