English
Related papers

Related papers: FinReflectKG -- EvalBench: Benchmarking Financial …

200 papers

In recent years, the introduction of knowledge graphs (KGs) has significantly advanced recommender systems by facilitating the discovery of potential associations between items. However, existing methods still face several limitations.…

Information Retrieval · Computer Science 2025-04-18 Ziqiang Cui , Yunpeng Weng , Xing Tang , Fuyuan Lyu , Dugang Liu , Xiuqiang He , Chen Ma

Large Language Models (LLMs) and Knowledge Graphs (KGs) offer a promising approach to robust and explainable Question Answering (QA). While LLMs excel at natural language understanding, they suffer from knowledge gaps and hallucinations.…

Machine Learning · Computer Science 2025-04-15 Jasper Linders , Jakub M. Tomczak

As large language models (LLMs) continue to grow in size, their abilities to tackle complex tasks have significantly improved. However, issues such as hallucination and the lack of up-to-date knowledge largely remain unresolved. Knowledge…

Artificial Intelligence · Computer Science 2026-03-17 Lihui Liu

Real-world financial decision-making is a challenging problem that requires reasoning over heterogeneous signals, including company fundamentals derived from regulatory filings and trading signals computed from price dynamics. Recently,…

Computational Engineering, Finance, and Science · Computer Science 2026-03-24 Yogesh Agrawal , Aniruddha Dutta , Md Mahadi Hasan , Santu Karmaker , Aritra Dutta

Large language models (LLMs) have demonstrated impressive reasoning abilities in complex tasks. However, they lack up-to-date knowledge and experience hallucinations during reasoning, which can lead to incorrect reasoning processes and…

Computation and Language · Computer Science 2024-02-27 Linhao Luo , Yuan-Fang Li , Gholamreza Haffari , Shirui Pan

The Knowledge Graph Completion~(KGC) task aims to infer the missing entity from an incomplete triple. Existing embedding-based methods rely solely on triples in the KG, which is vulnerable to specious relation patterns and long-tail…

Artificial Intelligence · Computer Science 2025-05-01 Muzhi Li , Cehao Yang , Chengjin Xu , Xuhui Jiang , Yiyan Qi , Jian Guo , Ho-fung Leung , Irwin King

Large Language Models (LLMs) demonstrate significant potential but face challenges in complex financial reasoning tasks requiring both domain knowledge and sophisticated reasoning. Current evaluation benchmarks often fall short by not…

Computation and Language · Computer Science 2025-11-07 Shaoyu Dou , Yutian Shen , Mofan Chen , Zixuan Wang , Jiajie Xu , Qi Guo , Kailai Shao , Chao Chen , Haixiang Hu , Haibo Shi , Min Min , Liwen Zhang

Due to the remarkable reasoning ability, Large language models (LLMs) have demonstrated impressive performance in knowledge graph question answering (KGQA) tasks, which find answers to natural language questions over knowledge graphs (KGs).…

Computation and Language · Computer Science 2025-02-25 Xiao Long , Liansheng Zhuang , Aodi Li , Minghong Yao , Shafei Wang

Large language models (LLMs) are increasingly deployed in financial research workflows, where their role is evolving from single-model assistance for human analysts toward autonomous collaboration among multiple agents. Yet real-world…

Computation and Language · Computer Science 2026-05-11 Yiyun Zhu , Yidong Jiang , Ziwen Xu , Yinsheng Yao , Dawei Cheng , Jinru Ding , Jie Xu

Large Language Models (LLMs) are increasingly used for tasks involving Knowledge Graphs (KGs), whose evaluation typically focuses on accuracy and output correctness. We propose a complementary task characterization approach using three…

Computation and Language · Computer Science 2025-09-25 Sara Todorovikj , Lars-Peter Meyer , Michael Martin

The recent advances in large language models (LLM) and foundation models with emergent capabilities have been shown to improve the performance of many NLP tasks. LLMs and Knowledge Graphs (KG) can complement each other such that LLMs can be…

Computation and Language · Computer Science 2023-08-07 Nandana Mihindukulasooriya , Sanju Tiwari , Carlos F. Enguix , Kusum Lata

Evaluating the open-form textual responses generated by Large Language Models (LLMs) typically requires measuring the semantic similarity of the response to a (human generated) reference. However, there is evidence that current semantic…

Artificial Intelligence · Computer Science 2025-11-26 Qiyao Wei , Edward Morrell , Lea Goetz , Mihaela van der Schaar

Recent advances in information extraction have motivated the automatic construction of huge Knowledge Graphs (KGs) by mining from large-scale text corpus. However, noisy facts are unavoidably introduced into KGs that could be caused by…

Computation and Language · Computer Science 2020-08-18 Yaqing Wang , Fenglong Ma , Jing Gao

Large Language Models (LLMs) have shown unprecedented performance in various real-world applications. However, they are known to generate factually inaccurate outputs, a.k.a. the hallucination problem. In recent years, incorporating…

Computation and Language · Computer Science 2024-06-21 Haochen Liu , Song Wang , Yaochen Zhu , Yushun Dong , Jundong Li

Large Language Models (LLMs) exhibit strong reasoning capabilities in complex tasks. However, they still struggle with hallucinations and factual errors in knowledge-intensive scenarios like knowledge graph question answering (KGQA). We…

Computation and Language · Computer Science 2025-11-12 Songze Li , Zhiqiang Liu , Zhengke Gui , Huajun Chen , Wen Zhang

Large language models (LLMs) are increasingly applied to financial analysis, yet their ability to audit structured financial statements under explicit accounting principles remains poorly explored. Existing benchmarks primarily evaluate…

Artificial Intelligence · Computer Science 2026-03-13 Arun Vignesh Malarkkan , Manan Roy Choudhury , Guangwei Zhang , Vivek Gupta , Qingyun Wang , Yanjie Fu , Denghui Zhang

Large language models (LLMs) have demonstrated impressive generative capabilities with the potential to innovate in medicine. However, the application of LLMs in real clinical settings remains challenging due to the lack of factual…

Computation and Language · Computer Science 2024-07-08 Rui Yang , Haoran Liu , Edison Marrese-Taylor , Qingcheng Zeng , Yu He Ke , Wanxin Li , Lechao Cheng , Qingyu Chen , James Caverlee , Yutaka Matsuo , Irene Li

Knowledge Graph-based Retrieval-Augmented Generation (KG-RAG) is an increasingly explored approach for combining the reasoning capabilities of large language models with the structured evidence of knowledge graphs. However, current…

Artificial Intelligence · Computer Science 2026-01-13 Dongzhuoran Zhou , Yuqicheng Zhu , Xiaxia Wang , Hongkuan Zhou , Yuan He , Jiaoyan Chen , Steffen Staab , Evgeny Kharlamov

The scarcity of high-quality knowledge graphs (KGs) remains a critical bottleneck for downstream AI applications, as existing extraction methods rely heavily on error-prone pattern-matching techniques or resource-intensive large language…

Computation and Language · Computer Science 2025-10-28 Teng Lin

Current Large Language Models (LLMs) can assist developing program code beside many other things, but can they support working with Knowledge Graphs (KGs) as well? Which LLM is offering the best capabilities in the field of Semantic Web and…

Artificial Intelligence · Computer Science 2025-06-03 Lars-Peter Meyer , Johannes Frey , Desiree Heim , Felix Brei , Claus Stadler , Kurt Junghanns , Michael Martin