English
Related papers

Related papers: ViTaB-A: Evaluating Multimodal Large Language Mode…

200 papers

We present the findings of the Machine Learning Model Attribution Challenge. Fine-tuned machine learning models may derive from other trained models without obvious attribution characteristics. In this challenge, participants identify the…

Machine Learning · Computer Science 2023-02-20 Elizabeth Merkhofer , Deepesh Chaudhari , Hyrum S. Anderson , Keith Manville , Lily Wong , João Gante

We study how well large language models (LLMs) explain their generations through rationales -- a set of tokens extracted from the input text that reflect the decision-making process of LLMs. Specifically, we systematically study rationales…

Computation and Language · Computer Science 2024-10-23 Mohsen Fayyaz , Fan Yin , Jiao Sun , Nanyun Peng

Citations in scholarly work serve the essential purpose of acknowledging and crediting the original sources of knowledge that have been incorporated or referenced. Depending on their surrounding textual context, these citations are used for…

Digital Libraries · Computer Science 2023-09-19 Yang Zhang , Yufei Wang , Kai Wang , Quan Z. Sheng , Lina Yao , Adnan Mahmood , Wei Emma Zhang , Rongying Zhao

Large language models (LLMs) are becoming attractive as few-shot reasoners to solve Natural Language (NL)-related tasks. However, the understanding of their capability to process structured data like tables remains an under-explored area.…

Computation and Language · Computer Science 2024-07-18 Yuan Sui , Mengyu Zhou , Mingjie Zhou , Shi Han , Dongmei Zhang

Many cultural institutions have made large digitized visual collections available online, often under permissible re-use licences. Creating interfaces for exploring and searching these collections is difficult, particularly in the absence…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Taylor Arnold , Lauren Tilton

Visualizations play a pivotal role in daily communication in an increasingly data-driven world. Research on multimodal large language models (MLLMs) for automated chart understanding has accelerated massively, with steady improvements on…

Computation and Language · Computer Science 2026-04-20 Jonathan Tonglet , Tinne Tuytelaars , Marie-Francine Moens , Iryna Gurevych

Data visualizations like charts are fundamental tools for quantitative analysis and decision-making across fields, requiring accurate interpretation and mathematical reasoning. The emergence of Multimodal Large Language Models (MLLMs)…

Artificial Intelligence · Computer Science 2025-08-26 Anku Rani , Aparna Garimella , Apoorv Saxena , Balaji Vasan Srinivasan , Paul Pu Liang

State-of-the-art performance in QA tasks is currently achieved by systems employing Large Language Models (LLMs), however these models tend to hallucinate information in their responses. One approach focuses on enhancing the generation…

Computation and Language · Computer Science 2024-11-28 Moshe Berchansky , Daniel Fleischer , Moshe Wasserblat , Peter Izsak

Large Language Models (LLMs)-based question answering (QA) systems play a critical role in modern AI, demonstrating strong performance across various tasks. However, LLM-generated responses often suffer from hallucinations, unfaithful…

Computation and Language · Computer Science 2026-01-29 Yuqing Zhao , Ziyao Liu , Yongsen Zheng , Kwok-Yan Lam

Although achieving great success, Large Language Models (LLMs) usually suffer from unreliable hallucinations. Although language attribution can be a potential solution, there are no suitable benchmarks and evaluation metrics to attribute…

Computation and Language · Computer Science 2024-05-24 Xinze Li , Yixin Cao , Liangming Pan , Yubo Ma , Aixin Sun

Multimodal tables i.e. tabular layouts interleaved with charts, maps, icons, and color encodings are ubiquitous in real applications yet remain difficult for Multimodal Large Language Models (MLLMs). Despite advances in text and image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Prasham Titiya , Jainil Trivedi , Chitta Baral , Vivek Gupta

Large language models (LLMs) have shown promise in synthetic tabular data generation, yet existing methods struggle to preserve complex feature dependencies, particularly among categorical variables. This work introduces a…

Machine Learning · Computer Science 2025-05-07 Andrey Sidorenko

Large Language Models (LLMs) have demonstrated potential as effective search relevance evaluators. However, there is a lack of comprehensive guidance on which models consistently perform optimally across various contexts or within specific…

Machine Learning · Computer Science 2024-10-29 Silvia Terragni , Hoang Cuong , Joachim Daiber , Pallavi Gudipati , Pablo N. Mendes

Multimodal large language models (MLLMs) have been integrated into visual interpretation applications to support Blind and Low Vision (BLV) users because of their accuracy and ability to provide rich, human-like interpretations. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Ricardo Gonzalez Penuela , Felipe Arias-Russi , Victor Capriles

Large Language Models (LLMs) have shown remarkable ability in solving complex tasks, making them a promising tool for enhancing tabular learning. However, existing LLM-based methods suffer from high resource requirements, suboptimal…

Machine Learning · Computer Science 2025-05-12 Ruxue Shi , Hengrui Gu , Xu Shen , Xin Wang

With the widespread application of Large Language Models (LLMs) in various tasks, the mainstream LLM platforms generate massive user-model interactions daily. In order to efficiently analyze the performance of models and diagnose failures…

Computation and Language · Computer Science 2025-07-14 Zishan Xu , Shuyi Xie , Qingsong Lv , Shupei Xiao , Linlin Song , Sui Wenjuan , Fan Lin

Large Language Models (LLMs) are increasingly used for accessing information on the web. Their truthfulness and factuality are thus of great interest. To help users make the right decisions about the information they get, LLMs should not…

Computation and Language · Computer Science 2024-04-03 Chenglei Si , Navita Goyal , Sherry Tongshuang Wu , Chen Zhao , Shi Feng , Hal Daumé , Jordan Boyd-Graber

Large Language Models (LLMs) are becoming increasingly popular in pervasive computing due to their versatility and strong performance. However, despite their ubiquitous use, the exact mechanisms underlying their outstanding performance…

Computation and Language · Computer Science 2026-02-02 Alhassan Abdelhalim , Janick Edinger , Sören Laue , Michaela Regneri

Tables, typically two-dimensional and structured to store large amounts of data, are essential in daily activities like database queries, spreadsheet manipulations, web table question answering, and image table information extraction.…

Artificial Intelligence · Computer Science 2024-11-05 Weizheng Lu , Jing Zhang , Ju Fan , Zihao Fu , Yueguo Chen , Xiaoyong Du

Large Language Models (LLMs) have emerged as powerful support tools across various natural language tasks and a range of application domains. Recent studies focus on exploring their capabilities for data annotation. This paper provides a…

Computation and Language · Computer Science 2025-07-01 Maja Pavlovic , Massimo Poesio