English
Related papers

Related papers: AmbiGraph-Eval: Can LLMs Effectively Handle Ambigu…

200 papers

Recent advancements in Large Language Models (LLMs) have significantly improved text generation capabilities, but these systems are still known to hallucinate, and granular uncertainty estimation for long-form LLM generations remains…

Computation and Language · Computer Science 2024-10-29 Mingjian Jiang , Yangjun Ruan , Prasanna Sattigeri , Salim Roukos , Tatsunori Hashimoto

Graph-structured data are the commonly used and have wide application scenarios in the real world. For these diverse applications, the vast variety of learning tasks, graph domains, and complex graph learning procedures present challenges…

Machine Learning · Computer Science 2024-02-26 Lanning Wei , Jun Gao , Huan Zhao , Quanming Yao

Large Language Models (LLMs) exhibit strong reasoning capabilities in complex tasks. However, they still struggle with hallucinations and factual errors in knowledge-intensive scenarios like knowledge graph question answering (KGQA). We…

Computation and Language · Computer Science 2025-11-12 Songze Li , Zhiqiang Liu , Zhengke Gui , Huajun Chen , Wen Zhang

Graph-structured data is prevalent in the real world. Recently, due to the powerful emergent capabilities, Large Language Models (LLMs) have shown promising performance in modeling graphs. The key to effectively applying LLMs on graphs is…

Computation and Language · Computer Science 2024-10-16 Haitong Luo , Xuying Meng , Suhang Wang , Tianxiang Zhao , Fali Wang , Hanyun Cao , Yujun Zhang

Diagrams play a central role in research papers for conveying ideas, yet they are often notoriously complex and labor-intensive to create. Although diagrams are presented as images, standard image generative models struggle to produce clear…

Computation and Language · Computer Science 2025-11-03 Chumeng Liang , Jiaxuan You

Attention mechanisms are critical to the success of large language models (LLMs), driving significant advancements in multiple fields. However, for graph-structured data, which requires emphasis on topological connections, they fall short…

Artificial Intelligence · Computer Science 2025-05-06 Zhong Guan , Likang Wu , Hongke Zhao , Ming He , Jianpin Fan

Graphs with abundant attributes are essential in modeling interconnected entities and enhancing predictions across various real-world applications. Traditional Graph Neural Networks (GNNs) often require re-training for different graph tasks…

Computation and Language · Computer Science 2026-05-26 Yanchao Tan , Hang Lv , Pengxiang Zhan , Shiping Wang , Carl Yang

Language models have recently achieved strong performance across a wide range of NLP benchmarks. However, unlike benchmarks, real world tasks are often poorly specified, and agents must deduce the user's intended behavior from a combination…

Computation and Language · Computer Science 2022-12-22 Alex Tamkin , Kunal Handa , Avash Shrestha , Noah Goodman

Tables have gained significant attention in large language models (LLMs) and multimodal large language models (MLLMs) due to their complex and flexible structure. Unlike linear text inputs, tables are two-dimensional, encompassing formats…

Computation and Language · Computer Science 2025-08-04 Xiaofeng Wu , Alan Ritter , Wei Xu

We devise an algorithm to generate propositions that objectively instantiate graphs supporting coherence-driven inference. We also benchmark the ability of large language models (LLMs) to reconstruct coherence graphs from (a simple…

Artificial Intelligence · Computer Science 2025-08-21 Steve Huntsman , Jewell Thomas

Handling heterogeneous data in tabular datasets poses a significant challenge for deep learning models. While attention-based architectures and self-supervised learning have achieved notable success, their application to tabular data…

Machine Learning · Computer Science 2025-02-27 Anay Majee , Maria Xenochristou , Wei-Peng Chen

Methods to evaluate Large Language Model (LLM) responses and detect inconsistencies, also known as hallucinations, with respect to the provided knowledge, are becoming increasingly important for LLM applications. Current metrics fall short…

Computation and Language · Computer Science 2024-07-16 Hannah Sansford , Nicholas Richardson , Hermina Petric Maretic , Juba Nait Saada

We focus on a conversational question answering task which combines the challenges of understanding questions in context and reasoning over evidence gathered from heterogeneous sources like text, knowledge graphs, tables, and infoboxes. Our…

Computation and Language · Computer Science 2024-07-16 Parag Jain , Mirella Lapata

Large Language Models (LLMs) have achieved remarkable success in many formal language oriented tasks, such as structural data-to-text and semantic parsing. However current benchmarks mostly follow the data distribution of the pre-training…

Computation and Language · Computer Science 2023-11-14 Chengwen Qi , Bowen Li , Binyuan Hui , Bailin Wang , Jinyang Li , Jinwang Wu , Yuanjun Laili

Identifying inter-firm relationships such as supply and competitive ties is critical for financial analysis and corporate governance, yet remains challenging due to the scale, sparsity, and contextual dependence of corporate data.…

Machine Learning · Computer Science 2025-10-14 Qianyou Sun , Jiexin Zheng , Bohan Jin , Lihua Chen , Yijie Peng

Large language models (LLMs) have achieved significant success in reasoning tasks, including mathematical reasoning and logical deduction. Among these reasoning tasks, graph problems stand out due to their complexity and unique structural…

Artificial Intelligence · Computer Science 2025-10-15 Yuyao Ge , Shenghua Liu , Baolong Bi , Yiwei Wang , Lingrui Mei , Wenjie Feng , Lizhe Chen , Xueqi Cheng

Recently proposed evaluation benchmarks aim to characterize the effective context length and the forgetting tendencies of large language models (LLMs). However, these benchmarks often rely on simplistic 'needle in a haystack' retrieval or…

Computation and Language · Computer Science 2025-10-07 Raquib Bin Yousuf , Aadyant Khatri , Shengzhe Xu , Mandar Sharma , Naren Ramakrishnan

While multi-modal models have successfully integrated information from image, video, and audio modalities, integrating graph modality into large language models (LLMs) remains unexplored. This discrepancy largely stems from the inherent…

Computation and Language · Computer Science 2023-10-13 Yuanchun Shen , Ruotong Liao , Zhen Han , Yunpu Ma , Volker Tresp

Large Language Models (LLMs) for Graph Reasoning have been extensively studied over the past two years, involving enabling LLMs to understand graph structures and reason on graphs to solve various graph problems, with graph algorithm…

Artificial Intelligence · Computer Science 2025-10-03 Yuwei Hu , Xinyi Huang , Zhewei Wei , Yongchao Liu , Chuntao Hong

Learning on Graphs has attracted immense attention due to its wide real-world applications. The most popular pipeline for learning on graphs with textual node attributes primarily relies on Graph Neural Networks (GNNs), and utilizes shallow…

Machine Learning · Computer Science 2024-01-17 Zhikai Chen , Haitao Mao , Hang Li , Wei Jin , Hongzhi Wen , Xiaochi Wei , Shuaiqiang Wang , Dawei Yin , Wenqi Fan , Hui Liu , Jiliang Tang