English
Related papers

Related papers: GraPPa: Grammar-Augmented Pre-Training for Table S…

200 papers

Recently, the emergence of large language models (LLMs) has motivated integrating language descriptions into graphs, forming text-attributed graphs (TAGs) that enhance model encoding capabilities from a data-centric perspective. A review of…

Machine Learning · Computer Science 2026-02-03 Zhihan Zhang , Xunkai Li , Lei Zhu , Guang Zeng , Bowen Fan , Yanzhe Wen , Hongchao Qin , Rong-Hua Li , Guoren Wang

Recent advances in Diffusion Transformers (DiTs) demonstrate that aligning noisy latent states with well-trained semantic features-as pioneered by Representation Alignment (REPA)-can substantially accelerate training and improve generation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Shaodong Xu , Zhendong Wang , Litong Gong , Zexian Li , Wengang Zhou , Tiezheng Ge , Houqiang Li

Most NLP datasets are manually labeled, so suffer from inconsistent labeling or limited size. We propose methods for automatically improving datasets by viewing them as graphs with expected semantic properties. We construct a paraphrase…

Computation and Language · Computer Science 2020-11-04 Hannah Chen , Yangfeng Ji , David Evans

In Natural Language Processing (NLP), Machine Reading Comprehension (MRC) is the task of answering a question based on a given context. To handle questions in the medical domain, modern language models such as BioBERT, SciBERT and even…

Computation and Language · Computer Science 2024-12-16 Saptarshi Sengupta , Connor Heaton , Suhan Cui , Soumalya Sarkar , Prasenjit Mitra

Recent research has demonstrated the efficacy of pre-training graph neural networks (GNNs) to capture the transferable graph semantics and enhance the performance of various downstream tasks. However, the semantic knowledge learned from…

Machine Learning · Computer Science 2023-12-19 Mouxiang Chen , Zemin Liu , Chenghao Liu , Jundong Li , Qiheng Mao , Jianling Sun

Video-aided grammar induction aims to leverage video information for finding more accurate syntactic grammars for accompanying text. While previous work focuses on building systems for inducing grammars on text that are well-aligned with…

Computation and Language · Computer Science 2022-10-25 Songyang Zhang , Linfeng Song , Lifeng Jin , Haitao Mi , Kun Xu , Dong Yu , Jiebo Luo

We present a dataset for evaluating the grammaticality of the predictions of a language model. We automatically construct a large number of minimally different pairs of English sentences, each consisting of a grammatical and an…

Computation and Language · Computer Science 2018-08-29 Rebecca Marvin , Tal Linzen

Multi-label image recognition is a fundamental task in computer vision. Recently, Vision-Language Models (VLMs) have made notable advancements in this area. However, previous methods fail to effectively leverage the rich knowledge in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Hao Tan , Zichang Tan , Jun Li , Jun Wan , Zhen Lei , Stan Z. Li

Table reasoning tasks have shown remarkable progress with the development of large language models (LLMs), which involve interpreting and drawing conclusions from tabular data based on natural language (NL) questions. Existing solutions…

Computation and Language · Computer Science 2024-10-11 Yuan Sui , Jiaru Zou , Mengyu Zhou , Xinyi He , Lun Du , Shi Han , Dongmei Zhang

We tackle the problem of weakly-supervised conversational Question Answering over large Knowledge Graphs using a neural semantic parsing approach. We introduce a new Logical Form (LF) grammar that can model a wide range of queries on the…

Computation and Language · Computer Science 2021-09-02 Pierre Marion , Paweł Krzysztof Nowak , Francesco Piccinno

We present an extension of sparse PCA, or sparse dictionary learning, where the sparsity patterns of all dictionary elements are structured and constrained to belong to a prespecified set of shapes. This \emph{structured sparse PCA} is…

Machine Learning · Statistics 2009-09-09 Rodolphe Jenatton , Guillaume Obozinski , Francis Bach

Large scale pretrained models have revolutionized Natural Language Processing (NLP) and Computer Vision (CV), showcasing remarkable cross domain generalization abilities. However, in graph learning, models are typically trained on…

Computation and Language · Computer Science 2025-10-03 Ruyue Liu , Rong Yin , Xiangzhen Bo , Xiaoshuai Hao , Yong Liu , Jinwen Zhong , Can Ma , Weiping Wang

Less than 1% of protein sequences are structurally and functionally annotated. Natural Language Processing (NLP) community has recently embraced self-supervised learning as a powerful approach to learn representations from unlabeled text,…

Biomolecules · Quantitative Biology 2020-12-08 Modestas Filipavicius , Matteo Manica , Joris Cadow , Maria Rodriguez Martinez

With the development of pre-trained language models, many prompt-based approaches to data-efficient knowledge graph construction have been proposed and achieved impressive performance. However, existing prompt-based learning methods for…

Computation and Language · Computer Science 2023-09-19 Yunzhi Yao , Shengyu Mao , Ningyu Zhang , Xiang Chen , Shumin Deng , Xi Chen , Huajun Chen

Though discourse parsing can help multiple NLP fields, there has been no wide language model search done on implicit discourse relation classification. This hinders researchers from fully utilizing public-available models in discourse…

Computation and Language · Computer Science 2023-07-10 Bruce W. Lee , BongSeok Yang , Jason Hyung-Jong Lee

Pronunciation assessment is a major challenge in the computer-aided pronunciation training system, especially at the word (phoneme)-level. To obtain word (phoneme)-level scores, current methods usually rely on aligning components to obtain…

Computation and Language · Computer Science 2023-06-06 Yukang Liang , Kaitao Song , Shaoguang Mao , Huiqiang Jiang , Luna Qiu , Yuqing Yang , Dongsheng Li , Linli Xu , Lili Qiu

Different from previous surveys in semantic parsing (Kamath and Das, 2018) and knowledge base question answering(KBQA)(Chakraborty et al., 2019; Zhu et al., 2019; Hoffner et al., 2017) we try to takes a different perspective on the study of…

Computation and Language · Computer Science 2021-08-23 Pawan Kumar , Srikanta Bedathur

Language Models (LMs) continue to advance, improving response quality and coherence. Given Internet-scale training datasets, LMs have likely encountered much of what users may ask them to generate in some form during their training. A…

Artificial Intelligence · Computer Science 2026-01-27 Michael Majurski , Cynthia Matuszek

I introduce a formalism for representing the syntax of recursively structured graph-like patterns. It does not use production rules, like a conventional graph grammar, but represents the syntactic structure in a more direct and declarative…

Formal Languages and Automata Theory · Computer Science 2025-04-25 Peter Fletcher

Synthetic tabular data generation has received increasing attention in recent years, particularly with the emergence of foundation models for tabular data. The breakthrough success of TabPFN (Hollmann et al.,2025), which leverages vast…

Machine Learning · Computer Science 2025-07-08 Frederik Hoppe , Astrid Franz , Lars Kleinemeier , Udo Göbel