English
Related papers

Related papers: GLEAN: Grounded Lightweight Evaluation Anchors for…

200 papers

Large Language Model-based generative recommendation (LLMRec) has achieved notable success, but it suffers from high inference latency due to massive computational overhead and memory pressure of KV Cache. Existing KV Cache reduction…

Information Retrieval · Computer Science 2025-07-02 Chaoqun Yang , Xinyu Lin , Wenjie Wang , Yongqi Li , Teng Sun , Xianjing Han , Tat-Seng Chua

ScenarioBench is a policy-grounded, trace-aware benchmark for evaluating Text-to-SQL and retrieval-augmented generation in compliance contexts. Each YAML scenario includes a no-peek gold-standard package with the expected decision, a…

Computation and Language · Computer Science 2025-09-30 Zahra Atf , Peter R Lewis

Tables provide valuable knowledge that can be used to verify textual statements. While a number of works have considered table-based fact verification, direct alignments of tabular data with tokens in textual statements are rarely…

Computation and Language · Computer Science 2021-09-10 Fei Wang , Kexuan Sun , Jay Pujara , Pedro Szekely , Muhao Chen

Generating realistic synthetic tabular data presents a critical challenge in machine learning. It adds another layer of complexity when this data contain class imbalance problems. This paper presents a novel token-aware data imputation…

Machine Learning · Computer Science 2025-06-05 Shreenidhi Srinivasan , Lydia Manikonda

While many have shown how Large Language Models (LLMs) can be applied to a diverse set of tasks, the critical issues of data contamination and memorization are often glossed over. In this work, we address this concern for tabular data.…

Machine Learning · Computer Science 2024-03-12 Sebastian Bordt , Harsha Nori , Rich Caruana

Visual markups such as highlights, underlines, and bold text are common in table-centric documents. Although multimodal large language models (MLLMs) have made substantial progress in document understanding, their ability to treat such cues…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Lexin Wang , Shenghua Liu , Yiwei Wang , Yujun Cai , Yuyao Ge , Jiayu Yao , Jiafeng Guo , Xueqi Cheng

Synthetic tabular data generation is increasingly essential in data management, supporting downstream applications when real-world and high-quality tabular data is insufficient. Existing tabular generation approaches, such as generative…

Machine Learning · Computer Science 2025-09-15 Mingxuan Jiang , Yongxin Wang , Ziyue Dai , Yicun Liu , Hongyi Nie , Sen Liu , Hongfeng Chai

We introduce Falcon, a cross-domain Chinese text-to-SQL benchmark grounded in an enterprise-compatible dialect (MaxCompute/Hive). It contains 600 Chinese questions over 28 databases; 77% require multi-table reasoning and over half touch…

Computation and Language · Computer Science 2025-10-30 Wenzhen Luo , Wei Guan , Yifan Yao , Yimin Pan , Feng Wang , Zhipeng Yu , Zhe Wen , Liang Chen , Yihong Zhuang

Recent observations have underscored a disparity between the inflated benchmark scores and the actual performance of LLMs, raising concerns about potential contamination of evaluation benchmarks. This issue is especially critical for…

Computation and Language · Computer Science 2024-04-05 Chunyuan Deng , Yilun Zhao , Xiangru Tang , Mark Gerstein , Arman Cohan

Despite recent advancements in domain adaptation techniques for large language models, these methods remain computationally intensive, and the resulting models can still exhibit hallucination issues. Most existing adaptation methods do not…

Computation and Language · Computer Science 2025-05-28 Bogdan Bogachov , Yaoyao Fiona Zhao

Large Language Models (LLMs) have demonstrated remarkable capabilities across various cybersecurity tasks, including vulnerability classification, detection, and patching. However, their potential in automated vulnerability report…

Laser Powder Bed Fusion (LPBF) is highly sensitive to process parameters, which influence defect formation through complex thermal and fluid mechanisms. However, defect-related knowledge is dispersed across the literature, limiting…

Cloud quantum platforms give users access to many backends with different qubit technologies, coupling layouts, and noise levels. The execution of a circuit, however, depends on internal allocation and routing policies that are not…

Quantum Physics · Physics 2025-12-17 Subrata Das , Archisman Ghosh , Swaroop Ghosh

Existing benchmarks for tool-augmented language models (TaLMs) lack fine-grained control over task difficulty and remain vulnerable to data contamination. We present FuncBenchGen, a unified, contamination-free framework that evaluates TaLMs…

Computation and Language · Computer Science 2026-02-10 Seiji Maekawa , Jackson Hassell , Pouya Pezeshkpour , Tom Mitchell , Estevam Hruschka

We study LLMs for tabular prediction with mixed text, numeric, and categorical fields. We introduce TabGemma, a schema-agnostic in-context learner that treats rows as sequences and tackles two practical hurdles when adapting pretrained LLMs…

Machine Learning · Computer Science 2025-11-06 Günther Schindler , Maximilian Schambach , Michael Medek , Sam Thelin

Table Question Answering (TableQA) poses a significant challenge for large language models (LLMs) because conventional linearization of tables often disrupts the two-dimensional relationships intrinsic to structured data. Existing methods,…

Computation and Language · Computer Science 2026-02-03 Seho Pyo , Jiheon Seok , Jaejin Lee

While large language models (LLMs) have achieved remarkable success in providing trustworthy responses for knowledge-intensive tasks, they still face critical limitations such as hallucinations and outdated knowledge. To address these…

Computation and Language · Computer Science 2025-08-06 Zizhong Li , Haopeng Zhang , Jiawei Zhang

High-quality data scarcity hinders malware detection, limiting ML performance. We introduce MalDataGen, an open-source modular framework for generating high-fidelity synthetic tabular data using modular deep learning models (e.g., WGAN-GP,…

Cryptography and Security · Computer Science 2025-11-04 Kayua Oleques Paim , Angelo Gaspar Diniz Nogueira , Diego Kreutz , Weverton Cordeiro , Rodrigo Brandao Mansilha

In ML-aided decision-making tasks, such as fraud detection or medical diagnosis, the human-in-the-loop, usually a domain-expert without technical ML knowledge, prefers high-level concept-based explanations instead of low-level explanations…

Machine Learning · Computer Science 2021-04-27 Catarina Belém , Vladimir Balayan , Pedro Saleiro , Pedro Bizarro

The rise of social networks has not only facilitated communication but also allowed the spread of harmful content. Although significant advances have been made in detecting toxic language in textual data, the exploration of concept-based…

Computation and Language · Computer Science 2025-12-16 Samarth Garg , Divya Singh , Deeksha Varshney , Mamta