English
Related papers

Related papers: Using Large Language Models for Knowledge Engineer…

200 papers

Large language models (LLMs) have emerged as powerful tools in natural language processing (NLP), showing a promising future of artificial generated intelligence (AGI). Despite their notable performance in the general domain, LLMs have…

Computation and Language · Computer Science 2025-01-23 Jingyuan Chen , Tao Wu , Wei Ji , Fei Wu

The advent of Large Language Models (LLMs) has significantly advanced web-based Question Answering (QA) systems over semi-structured content, raising questions about the continued utility of knowledge extraction for question answering. This…

Large Language Models (LLMs) can memorize and reveal personal information, raising concerns regarding compliance with the EU's GDPR, particularly the Right to Be Forgotten (RTBF). Existing machine unlearning methods assume the data to…

Computation and Language · Computer Science 2025-07-16 Dimitri Staufer

Adapting large language models (LLMs) to new and diverse knowledge is essential for their lasting effectiveness in real-world applications. This survey provides an overview of state-of-the-art methods for expanding the knowledge of LLMs,…

Computation and Language · Computer Science 2025-02-19 Mingyang Wang , Alisa Stoll , Lukas Lange , Heike Adel , Hinrich Schütze , Jannik Strötgen

Large-scale knowledge bases (KBs) like Freebase and Wikidata house millions of structured knowledge. Knowledge Base Question Answering (KBQA) provides a user-friendly way to access these valuable KBs via asking natural language questions.…

Computation and Language · Computer Science 2024-06-24 Lingxi Zhang , Jing Zhang , Yanling Wang , Cuiping Li , Hong Chen

Specialized entity linking (EL) models are well-trained at mapping mentions to unique knowledge base (KB) entities according to a given context. However, specialized EL models struggle to disambiguate long-tail entities due to their limited…

Computation and Language · Computer Science 2025-09-29 Amy Xin , Yunjia Qi , Zijun Yao , Fangwei Zhu , Kaisheng Zeng , Xu Bin , Lei Hou , Juanzi Li

Citations in scholarly work serve the essential purpose of acknowledging and crediting the original sources of knowledge that have been incorporated or referenced. Depending on their surrounding textual context, these citations are used for…

Digital Libraries · Computer Science 2023-09-19 Yang Zhang , Yufei Wang , Kai Wang , Quan Z. Sheng , Lina Yao , Adnan Mahmood , Wei Emma Zhang , Rongying Zhao

Several initiatives have been undertaken to conceptually model the domain of scholarly data using ontologies and to create respective Knowledge Graphs. Yet, the full potential seems unleashed, as automated means for automatic population of…

Digital Libraries · Computer Science 2024-11-14 Nandana Mihindukulasooriya , Sanju Tiwari , Daniil Dobriy , Finn Årup Nielsen , Tek Raj Chhetri , Axel Polleres

Data science plays a critical role in biomedical research, but it requires professionals with expertise in coding and medical data analysis. Large language models (LLMs) have shown great potential in supporting medical tasks and performing…

Artificial Intelligence · Computer Science 2025-04-10 Zifeng Wang , Benjamin Danek , Ziwei Yang , Zheng Chen , Jimeng Sun

Large Language Models (LLMs) are increasingly used for tasks involving Knowledge Graphs (KGs), whose evaluation typically focuses on accuracy and output correctness. We propose a complementary task characterization approach using three…

Computation and Language · Computer Science 2025-09-25 Sara Todorovikj , Lars-Peter Meyer , Michael Martin

Knowledge tagging for questions plays a crucial role in contemporary intelligent educational applications, including learning progress diagnosis, practice question recommendations, and course content organization. Traditionally, these…

Computation and Language · Computer Science 2024-06-21 Hang Li , Tianlong Xu , Jiliang Tang , Qingsong Wen

Large language models (LLMs) have been touted to enable increased productivity in many areas of today's work life. Scientific research as an area of work is no exception: the potential of LLM-based tools to assist in the daily work of…

Software Engineering · Computer Science 2024-04-24 Mohamed Nejjar , Luca Zacharias , Fabian Stiehle , Ingo Weber

Large Language Models (LLMs) have demonstrated remarkable success in diverse natural language processing (NLP) tasks in general domains. However, LLMs sometimes generate responses with the hallucination about medical facts due to limited…

Computation and Language · Computer Science 2025-01-14 Haochun Wang , Sendong Zhao , Zewen Qiang , Zijian Li , Nuwa Xi , Yanrui Du , MuZhen Cai , Haoqiang Guo , Yuhan Chen , Haoming Xu , Bing Qin , Ting Liu

Pretrained Large Language Models (LLMs) have gained significant attention for addressing open-domain Question Answering (QA). While they exhibit high accuracy in answering questions related to common knowledge, LLMs encounter difficulties…

Computation and Language · Computer Science 2024-03-05 Rohan Kumar , Youngmin Kim , Sunitha Ravi , Haitian Sun , Christos Faloutsos , Ruslan Salakhutdinov , Minji Yoon

Language models (LMs) increasingly drive real-world applications that require world knowledge. However, the internal processes through which models turn data into representations of knowledge and beliefs about the world, are poorly…

Computation and Language · Computer Science 2025-09-04 Daniela Gottesman , Alon Gilae-Dotan , Ido Cohen , Yoav Gur-Arieh , Marius Mosbach , Ori Yoran , Mor Geva

While training large language models (LLMs) from scratch can generate models with distinct functionalities and strengths, it comes at significant costs and may result in redundant capabilities. Alternatively, a cost-effective and compelling…

Computation and Language · Computer Science 2024-01-23 Fanqi Wan , Xinting Huang , Deng Cai , Xiaojun Quan , Wei Bi , Shuming Shi

Despite their impressive performance on diverse tasks, large language models (LMs) still struggle with tasks requiring rich world knowledge, implying the limitations of relying solely on their parameters to encode a wealth of world…

Computation and Language · Computer Science 2023-07-04 Alex Mallen , Akari Asai , Victor Zhong , Rajarshi Das , Daniel Khashabi , Hannaneh Hajishirzi

Knowledge Bases (KBs) are easy to query, verifiable, and interpretable. They however scale with man-hours and high-quality data. Masked Language Models (MLMs), such as BERT, scale with computing power as well as unstructured raw text data.…

Computation and Language · Computer Science 2020-09-16 Louis Clouatre , Philippe Trempe , Amal Zouaq , Sarath Chandar

We present a system for knowledge graph population with Language Models, evaluated on the Knowledge Base Construction from Pre-trained Language Models (LM-KBC) challenge at ISWC 2022. Our system involves task-specific pre-training to…

Computation and Language · Computer Science 2022-09-01 Tianyi Li , Wenyu Huang , Nikos Papasarantopoulos , Pavlos Vougiouklis , Jeff Z. Pan

Large Language Models (LLMs) are advancing at a rapid pace, with significant improvements at natural language processing and coding tasks. Yet, their ability to work with formal languages representing data, specifically within the realm of…

Artificial Intelligence · Computer Science 2023-10-02 Johannes Frey , Lars-Peter Meyer , Natanael Arndt , Felix Brei , Kirill Bulert