English
Related papers

Related papers: Tabular Feature Discovery With Reasoning Type Expl…

200 papers

Large Language Models (LLMs) have demonstrated significant performance improvements across various cognitive tasks. An emerging application is using LLMs to enhance retrieval-augmented generation (RAG) capabilities. These systems require…

Computation and Language · Computer Science 2025-01-28 Satyapriya Krishna , Kalpesh Krishna , Anhad Mohananey , Steven Schwarcz , Adam Stambler , Shyam Upadhyay , Manaal Faruqui

Transformer networks, particularly those achieving performance comparable to GPT models, are well known for their robust feature extraction abilities. However, the nature of these extracted features and their alignment with human-engineered…

Information Retrieval · Computer Science 2025-07-23 Tanya Chowdhury , Atharva Nijasure , James Allan

Table reasoning, encompassing tasks such as table question answering, fact verification, and text-to-SQL, requires precise understanding of structured tabular data, coupled with numerical computation and code manipulation for effective…

Computation and Language · Computer Science 2025-06-03 Fangyu Lei , Jinxiang Meng , Yiming Huang , Tinghong Chen , Yun Zhang , Shizhu He , Jun Zhao , Kang Liu

Advanced table question answering (TableQA) methods prompt large language models (LLMs) to generate answer text, SQL query, Python code, or custom operation, which impressively improve the complex reasoning problems in the TableQA task.…

Computation and Language · Computer Science 2025-09-03 Zhongyuan Wang , Richong Zhang , Zhijie Nie , Hangyu Mao

Understanding the behavior of large language models (LLMs) is crucial for ensuring their safe and reliable use. However, existing explainable AI (XAI) methods for LLMs primarily rely on word-level explanations, which are often…

Computation and Language · Computer Science 2025-08-08 Furui Cheng , Vilém Zouhar , Robin Shing Moon Chan , Daniel Fürst , Hendrik Strobelt , Mennatallah El-Assady

This paper explores the application of large language models (LLMs) to extract nuanced and complex job features from unstructured job postings. Using a dataset of 1.2 million job postings provided by AdeptID, we developed a robust pipeline…

Computation and Language · Computer Science 2025-01-15 Karishma Thakrar , Nick Young

Large Language Models (LLMs) have shown strong potential for tabular data generation by modeling textualized feature-value pairs. However, tabular data inherently exhibits sparse feature-level dependencies, where many feature interactions…

Computation and Language · Computer Science 2025-09-09 Zheyu Zhang , Shuo Yang , Bardh Prenkaj , Gjergji Kasneci

Multi-view multi-label feature selection aims to identify informative features from heterogeneous views, where each sample is associated with multiple interdependent labels. This problem is particularly important in machine learning…

Artificial Intelligence · Computer Science 2025-11-20 Zhiqi Chen , Yuzhou Liu , Jiarui Liu , Wanfu Gao

In the domain of data science, the predictive tasks of classification, regression, and imputation of missing values are commonly encountered challenges associated with tabular data. This research endeavors to apply Large Language Models…

Machine Learning · Computer Science 2026-04-23 Yazheng Yang , Yuqi Wang , Yaxuan Li , Sankalok Sen , Lei Li , Lin Qiu , Qi Liu

Large language models (LLMs) have demonstrated remarkable reasoning capability in solving mathematical problems. However, existing approaches primarily focus on improving the quality of correct training data, e.g., distilling high-quality…

Machine Learning · Computer Science 2025-06-02 Zhuoshi Pan , Yu Li , Honglin Lin , Qizhi Pei , Zinan Tang , Wei Wu , Chenlin Ming , H. Vicky Zhao , Conghui He , Lijun Wu

While many have shown how Large Language Models (LLMs) can be applied to a diverse set of tasks, the critical issues of data contamination and memorization are often glossed over. In this work, we address this concern for tabular data.…

Machine Learning · Computer Science 2024-12-05 Sebastian Bordt , Harsha Nori , Vanessa Rodrigues , Besmira Nushi , Rich Caruana

Existing text representations such as embeddings and bag-of-words are not suitable for rule learning due to their high dimensionality and absent or questionable feature-level interpretability. This article explores whether large language…

Machine Learning · Computer Science 2025-10-02 Vojtěch Balek , Lukáš Sýkora , Vilém Sklenák , Tomáš Kliegr

Large language models (LLMs) have recently been adopted for recommendation by framing user preference modeling as a language generation problem. However, existing latent reasoning approaches typically represent user intent with a single…

Information Retrieval · Computer Science 2026-04-30 Tianqi Gao , Chengkai Huang , Zihan Wang , Cao Liu , Ke Zeng , Lina Yao

Feature engineering is crucial for optimizing machine learning model performance, particularly in tabular data classification tasks. Leveraging advancements in natural language processing, this study presents a systematic approach to enrich…

Machine Learning · Computer Science 2024-11-07 Gjergji Kasneci , Enkelejda Kasneci

Large Language Models (LLMs), excel in natural language understanding, but their capability for complex mathematical reasoning with an amalgamation of structured tables and unstructured text is uncertain. This study explores LLMs'…

Computation and Language · Computer Science 2025-10-10 Pragya Srivastava , Manuj Malik , Vivek Gupta , Tanuja Ganu , Dan Roth

Despite the impressive capabilities of large language models (LLMs), their performance on information extraction tasks is still not entirely satisfactory. However, their remarkable rewriting capabilities and extensive world knowledge offer…

Computation and Language · Computer Science 2024-02-23 Junjie Ye , Nuo Xu , Yikun Wang , Jie Zhou , Qi Zhang , Tao Gui , Xuanjing Huang

Feature generation (FG) aims to enhance the prediction potential of original data by constructing high-order feature combinations and removing redundant features. It is a key preprocessing step for tabular scientific data to improve…

Machine Learning · Computer Science 2025-07-10 Meng Xiao , Junfeng Zhou , Yuanchun Zhou

The remarkable capabilities and easy accessibility of large language models (LLMs) have significantly increased societal risks (e.g., fake news generation), necessitating the development of LLM-generated text (LGT) detection methods for…

Machine Learning · Computer Science 2024-11-08 Hyunseok Lee , Jihoon Tack , Jinwoo Shin

Since the advent of Large Language Models (LLMs), efforts have largely focused on improving their instruction-following and deductive reasoning abilities, leaving open the question of whether these models can truly discover new knowledge.…

Computation and Language · Computer Science 2025-10-31 Kaiyu He , Zhiyu Chen

While large language models (LLMs) have shown promise in the table question answering (TQA) task through prompt engineering, they face challenges in industrial applications, including structural heterogeneity, difficulties in target data…

Computation and Language · Computer Science 2025-09-03 Sishi Xiong , Ziyang He , Zhongjiang He , Yu Zhao , Changzai Pan , Jie Zhang , Zhenhe Wu , Shuangyong Song , Yongxiang Li