English
Related papers

Related papers: GLEAN: Grounded Lightweight Evaluation Anchors for…

200 papers

Text-to-SQL systems translate natural language (NL) questions into SQL queries, enabling non-technical users to interact with structured data. While large language models (LLMs) have shown promising results on the text-to-SQL task, they…

Computation and Language · Computer Science 2025-06-06 Yue Gong , Chuan Lei , Xiao Qin , Kapil Vaidya , Balakrishnan Narayanaswamy , Tim Kraska

Large language models (LLMs) are increasingly deployed on customer devices. To support them, current devices are adopting SoCs (System on Chip) with NPUs (Neural Processing Unit) installed. Although high performance is expected, LLM…

Hardware Architecture · Computer Science 2025-11-17 Jianyu Wei , Qingtao Li , Shijie Cao , Lingxiao Ma , Zixu Hao , Yanyong Zhang , Xiaoyan Hu , Ting Cao

This study proposes a method based on lightweight convolutional neural networks (CNN) and generative adversarial networks (GAN) for apple ripeness and damage level detection tasks. Initially, a lightweight CNN model is designed by…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yufei Liu , Manzhou Li , Qin Ma

Training Large Language Models (LLMs) for chain-of-thought reasoning presents a significant challenge: supervised fine-tuning on a single "golden" rationale hurts generalization as it penalizes equally valid alternatives, whereas…

Computation and Language · Computer Science 2025-11-14 Mingye Zhu , Yi Liu , Zheren Fu , Quan Wang , Yongdong Zhang

Identifying anomalous instances in tabular data is essential for improving data reliability and maintaining system stability. Due to the scarcity of ground-truth anomaly labels, existing methods mainly rely on unsupervised anomaly detection…

Artificial Intelligence · Computer Science 2026-04-21 Wei Huang , Yuxuan Xiong , Hezhe Qiao , Yu-Ming Shang , Xiangling Fu , Guansong Pang

Large Language Models (LLMs) offer a flexible means to generate synthetic tabular data, yet existing approaches often fail to preserve key causal parameters such as the average treatment effect (ATE). In this technical exploration, we first…

Machine Learning · Computer Science 2025-11-04 Dana Kim , Yichen Xu , Tiffany Lin

The Web is a rich source of structured data in the form of tables, from product catalogs and knowledge bases to scientific datasets. However, the heterogeneity of the structure and semantics of these tables makes it challenging to build a…

Computation and Language · Computer Science 2026-02-19 Inwon Kang , Parikshit Ram , Yi Zhou , Horst Samulowitz , Oshani Seneviratne

RL training of multi-turn LLM agents is inherently unstable, and reasoning quality directly determines task performance. Entropy is widely used to track reasoning stability. However, entropy only measures diversity within the same input,…

Querying tables with unstructured data is challenging due to the presence of text (or image), either embedded in the table or in external paragraphs, which traditional SQL struggles to process, especially for tasks requiring semantic…

Artificial Intelligence · Computer Science 2025-09-25 Rohit Khoja , Devanshu Gupta , Yanjie Fu , Dan Roth , Vivek Gupta

Autonomous multi-agent LLM systems are increasingly deployed to investigate operational incidents and produce structured diagnostic reports. Their trustworthiness hinges on whether each claim is grounded in observed evidence rather than…

Artificial Intelligence · Computer Science 2026-04-28 Federico A. Kamelhar

Assessing software test coverage at scale remains a bottleneck in QA pipelines. We present LLM-as-a-Judge (LAJ), a production-ready, rubric-driven framework for evaluating Gherkin acceptance tests with structured JSON outputs. Across 20…

Software Engineering · Computer Science 2025-12-02 Donghao Huang , Shila Chew , Anna Dutkiewicz , Zhaoxia Wang

Backtesting LLMs on resolved events assumes models reason only from pre-cutoff knowledge, yet pretrained models inevitably leak post-cutoff knowledge. We introduce a claim-level evaluation framework that decomposes prediction rationales…

Artificial Intelligence · Computer Science 2026-05-26 Zeyu Zhang , Ryan Chen , Bradly C. Stadie

Recent advancements in table-based reasoning have expanded beyond factoid-level QA to address insight-level tasks, where systems should synthesize implicit knowledge in the table to provide explainable analyses. Although effective, existing…

Computation and Language · Computer Science 2025-06-03 Kwangwook Seo , Donguk Kwon , Dongha Lee

How to generate a large, realistic set of tables along with joinability relationships, to stress-test dataset discovery methods? Dataset discovery methods aim to automatically identify related data assets in a data lake. The development and…

Databases · Computer Science 2025-07-09 Zhenwei Dai , Chuan Lei , Asterios Katsifodimos , Xiao Qin , Christos Faloutsos , Huzefa Rangwala

In recent years, continual learning (CL) techniques have made significant progress in learning from streaming data while preserving knowledge across sequential tasks, particularly in the realm of euclidean data. To foster fair evaluation…

Machine Learning · Computer Science 2024-06-10 Tianqi Zhao , Alan Hanjalic , Megha Khosla

The integration of Graph Neural Networks (GNNs) with Large Language Models (LLMs) has emerged as a promising paradigm for Graph Question Answering (GraphQA). However, effective methods for encoding complex structural information into the…

Machine Learning · Computer Science 2026-04-02 Ankit Grover , Lodovico Giaretta , Rémi Bourgerie , Sarunas Girdzijauskas

Causal discovery from observational data is fundamental to scientific fields like biology, where controlled experiments are often impractical. However, existing methods, including constraint-based (e.g., PC, causalMGM) and score-based…

Machine Learning · Computer Science 2025-10-14 Zhenjiang Fan , Zengyi Qin , Yuanning Zheng , Bo Xiong , Summer Han

Tabular foundation models, such as TabPFNv2 and TabICL, have recently dethroned gradient-boosted trees at the top of predictive benchmarks, demonstrating the value of in-context learning for tabular data. We introduce TabICLv2, a new…

Machine Learning · Computer Science 2026-02-12 Jingang Qu , David Holzmüller , Gaël Varoquaux , Marine Le Morvan

Controllers for structured LM reasoning (e.g., Chain-of-Thought, self-consistency, and Tree-of-Thoughts) often entangle what to try next with how to execute it, exposing only coarse global knobs and yielding brittle, compute-inefficient,…

Artificial Intelligence · Computer Science 2025-10-07 Abhinav Madahar

Software vulnerability detection (SVD) is a critical challenge in modern systems. Large language models (LLMs) offer natural-language explanations alongside predictions, but most work focuses on binary evaluation, and explanations often…

Software Engineering · Computer Science 2026-02-12 Samal Mukhtar , Yinghua Yao , Zhu Sun , Mustafa Mustafa , Yew Soon Ong , Youcheng Sun