English
Related papers

Related papers: GraphGen: Enhancing Supervised Fine-Tuning for LLM…

200 papers

Large language models (LLMs) often struggle with knowledge-intensive tasks due to hallucinations and outdated parametric knowledge. While Retrieval-Augmented Generation (RAG) addresses this by integrating external corpora, its effectiveness…

Computation and Language · Computer Science 2026-02-04 Su Dong , Qinggang Zhang , Yilin Xiao , Shengyuan Chen , Chuang Zhou , Xiao Huang

Data augmentation is necessary for graph representation learning due to the scarcity and noise present in graph data. Most of the existing augmentation methods overlook the context information inherited from the dataset as they rely solely…

Machine Learning · Computer Science 2025-02-20 Yushi Feng , Tsai Hor Chan , Guosheng Yin , Lequan Yu

Machine learning in materials science faces challenges due to limited experimental data, as generating synthesis data is costly and time-consuming, especially with in-house experiments. Mining data from existing literature introduces issues…

Computational Physics · Physics 2025-03-11 Devi Dutta Biswajeet , Sara Kadkhodaei

Extracting relevant and structured knowledge from large, complex technical documents within the Reliability and Maintainability (RAM) domain is labor-intensive and prone to errors. Our work addresses this challenge by presenting OntoKGen, a…

Artificial Intelligence · Computer Science 2024-12-11 Mohammad Sadeq Abolhasani , Rong Pan

In today's rapidly evolving landscape of Artificial Intelligence, large language models (LLMs) have emerged as a vibrant research topic. LLMs find applications in various fields and contribute significantly. Despite their powerful language…

Computation and Language · Computer Science 2024-09-10 Tuan Bui , Oanh Tran , Phuong Nguyen , Bao Ho , Long Nguyen , Thang Bui , Tho Quan

Clinical natural language processing requires methods that can address domain-specific challenges, such as complex medical terminology and clinical contexts. Recently, large language models (LLMs) have shown promise in this domain. Yet,…

Computation and Language · Computer Science 2025-01-28 Ran Xu , Hejie Cui , Yue Yu , Xuan Kan , Wenqi Shi , Yuchen Zhuang , Wei Jin , Joyce Ho , Carl Yang

Recently, Retrieval-Augmented Generation (RAG) has achieved remarkable success in addressing the challenges of Large Language Models (LLMs) without necessitating retraining. By referencing an external knowledge base, RAG refines LLM…

Artificial Intelligence · Computer Science 2024-09-11 Boci Peng , Yun Zhu , Yongchao Liu , Xiaohe Bo , Haizhou Shi , Chuntao Hong , Yan Zhang , Siliang Tang

The advent of large language models (LLMs) has allowed numerous applications, including the generation of queried responses, to be leveraged in chatbots and other conversational assistants. Being trained on a plethora of data, LLMs often…

Computation and Language · Computer Science 2025-05-16 Deeksha Prahlad , Chanhee Lee , Dongha Kim , Hokeun Kim

The growing trend of Large Language Models (LLM) development has attracted significant attention, with models for various applications emerging consistently. However, the combined application of Large Language Models with semantic…

Computation and Language · Computer Science 2023-05-09 Milena Trajanoska , Riste Stojanov , Dimitar Trajanov

As the field of Large Language Models (LLMs) evolves at an accelerated pace, the critical need to assess and monitor their performance emerges. We introduce a benchmarking framework focused on knowledge graph engineering (KGE) accompanied…

Artificial Intelligence · Computer Science 2023-09-01 Lars-Peter Meyer , Johannes Frey , Kurt Junghanns , Felix Brei , Kirill Bulert , Sabine Gründer-Fahrer , Michael Martin

Despite their success at many natural language processing (NLP) tasks, large language models still struggle to effectively leverage knowledge for knowledge-intensive tasks, manifesting limitations such as generating incomplete, non-factual,…

Computation and Language · Computer Science 2024-10-03 Yougang Lyu , Lingyong Yan , Shuaiqiang Wang , Haibo Shi , Dawei Yin , Pengjie Ren , Zhumin Chen , Maarten de Rijke , Zhaochun Ren

Financial documents like earning reports or balance sheets often involve long tables and multi-page reports. Large language models have become a new tool to help numerical reasoning and understanding these documents. However, prompt quality…

Artificial Intelligence · Computer Science 2025-11-17 Yaoning Yu , Kai-Min Chang , Ye Yu , Kai Wei , Haojing Luo , Haohan Wang

Retrieval-augmented generation (RAG) has demonstrated its ability to enhance Large Language Models (LLMs) by integrating external knowledge sources. However, multi-hop questions, which require the identification of multiple knowledge…

Machine Learning · Computer Science 2026-04-28 Yuchen Yan , Peiyan Zhang , Zhihua Liu , Hao Wang , Yatao Bian , Weiming Li , Xiaoshuai Hao

In the era of big data, access to abundant data is crucial for driving research forward. However, such data is often inaccessible due to privacy concerns or high costs, particularly in healthcare domain. Generating synthetic (tabular) data…

Machine Learning · Computer Science 2026-04-10 Yaobin Ling , Xiaoqian Jiang , Yejin Kim

Schemas play a vital role in ensuring data quality and supporting usability in the Semantic Web and natural language processing. Traditionally, their creation demands substantial involvement from knowledge engineers and domain experts.…

Artificial Intelligence · Computer Science 2025-10-03 Bohui Zhang , Yuan He , Lydia Pintscher , Albert Meroño Peñuela , Elena Simperl

Integrating Large Language Models (LLMs) with Knowledge Graphs (KGs) results in complex systems with numerous hyperparameters that directly affect performance. While such systems are increasingly common in retrieval-augmented generation,…

Artificial Intelligence · Computer Science 2025-06-02 Vasilije Markovic , Lazar Obradovic , Laszlo Hajdu , Jovan Pavlovic

The scarcity of high-quality knowledge graphs (KGs) remains a critical bottleneck for downstream AI applications, as existing extraction methods rely heavily on error-prone pattern-matching techniques or resource-intensive large language…

Computation and Language · Computer Science 2025-10-28 Teng Lin

Although Large Language Models (LLMs) are effective in performing various NLP tasks, they still struggle to handle tasks that require extensive, real-world knowledge, especially when dealing with long-tail facts (facts related to long-tail…

Computation and Language · Computer Science 2024-05-13 Wenyu Huang , Guancheng Zhou , Mirella Lapata , Pavlos Vougiouklis , Sebastien Montella , Jeff Z. Pan

Despite recent advancements in domain adaptation techniques for large language models, these methods remain computationally intensive, and the resulting models can still exhibit hallucination issues. Most existing adaptation methods do not…

Computation and Language · Computer Science 2025-05-28 Bogdan Bogachov , Yaoyao Fiona Zhao

Large Language Models (LLMs) present massive inherent knowledge and superior semantic comprehension capability, which have revolutionized various tasks in natural language processing. Despite their success, a critical gap remains in…

Computation and Language · Computer Science 2025-02-11 Ben Liu , Jihai Zhang , Fangquan Lin , Cheng Yang , Min Peng