English
Related papers

Related papers: Measuring and Improving Compositional Generalizati…

200 papers

In-context learning of large-language models (LLMs) has achieved remarkable success in the field of natural language processing, while extensive case studies reveal that the single-step chain-of-thought prompting approach faces challenges…

Computation and Language · Computer Science 2024-07-04 Yuanzhen Xie , Xinzhou Jin , Tao Xie , MingXiong Lin , Liang Chen , Chenyun Yu , Lei Cheng , ChengXiang Zhuo , Bo Hu , Zang Li

Recently, it has become easier to obtain speech data from various media such as the internet or YouTube, but directly utilizing them to train a neural text-to-speech (TTS) model is difficult. The proportion of clean speech is insufficient…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-05 Hanbin Bae , Jae-Sung Bae , Young-Sun Joo , Young-Ik Kim , Hoon-Young Cho

Although sequence-to-sequence models often achieve good performance in semantic parsing for i.i.d. data, their performance is still inferior in compositional generalization. Several data augmentation methods have been proposed to alleviate…

Computation and Language · Computer Science 2022-05-04 Jingfeng Yang , Le Zhang , Diyi Yang

Model collapse in synthetic data indicates that iterative training on self-generated data leads to a gradual decline in performance. With the proliferation of AI models, synthetic data will fundamentally reshape the web data ecosystem.…

Computation and Language · Computer Science 2025-05-29 Xuekai Zhu , Daixuan Cheng , Hengli Li , Kaiyan Zhang , Ermo Hua , Xingtai Lv , Ning Ding , Zhouhan Lin , Zilong Zheng , Bowen Zhou

Segmenting text into fine-grained units of meaning is important to a wide range of NLP applications. The default approach of segmenting text into sentences is often insufficient, especially since sentences are usually complex enough to…

Computation and Language · Computer Science 2024-11-05 Mohammad Javad Hosseini , Yang Gao , Tim Baumgärtner , Alex Fabrikant , Reinald Kim Amplayo

There are many recent advanced developments for the Text-to-SQL task, where the Picard model is one of the the top performing models as measured by the Spider dataset competition. However, bringing Text-to-SQL systems to realistic use-cases…

Computation and Language · Computer Science 2023-12-12 Irene Manotas , Octavian Popescu , Ngoc Phuoc An Vo , Vadim Sheinin

Training code-switched language models is difficult due to lack of data and complexity in the grammatical structure. Linguistic constraint theories have been used for decades to generate artificial code-switching sentences to cope with this…

Computation and Language · Computer Science 2019-09-19 Genta Indra Winata , Andrea Madotto , Chien-Sheng Wu , Pascale Fung

Leveraging the compositional nature of our world to expedite learning and facilitate generalization is a hallmark of human perception. In machine learning, on the other hand, achieving compositional generalization has proven to be an…

Machine Learning · Computer Science 2023-07-13 Thaddäus Wiedemer , Prasanna Mayilvahanan , Matthias Bethge , Wieland Brendel

Compositional understanding is crucial for human intelligence, yet it remains unclear whether contemporary vision models exhibit it. The dominant machine learning paradigm is built on the premise that scaling data and model sizes will…

Machine Learning · Computer Science 2025-07-10 Arnas Uselis , Andrea Dittadi , Seong Joon Oh

We present Spider, a large-scale, complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 college students. It consists of 10,181 questions and 5,693 unique complex SQL queries on 200 databases with multiple…

Computation and Language · Computer Science 2019-02-05 Tao Yu , Rui Zhang , Kai Yang , Michihiro Yasunaga , Dongxu Wang , Zifan Li , James Ma , Irene Li , Qingning Yao , Shanelle Roman , Zilin Zhang , Dragomir Radev

Systematic generalization is the ability to combine known parts into novel meaning; an important aspect of efficient human learning, but a weakness of neural network learning. In this work, we investigate how two well-known modeling…

Artificial Intelligence · Computer Science 2022-02-23 Laura Ruis , Brenden Lake

Sentence simplification reduces semantic complexity to benefit people with language impairments. Previous simplification studies on the sentence level and word level have achieved promising results but also meet great challenges. For…

Computation and Language · Computer Science 2017-04-10 Yaoyuan Zhang , Zhenxu Ye , Yansong Feng , Dongyan Zhao , Rui Yan

The DisCoCirc framework for natural language processing allows the construction of compositional models of text, by combining units for individual words together according to the grammatical structure of the text. The compositional nature…

Computation and Language · Computer Science 2025-07-08 Tiffany Duneau

Text-to-SQL is an important task that helps people obtain information from databases by automatically generating SQL queries. Considering the brilliant performance, approaches based on Large Language Models (LLMs) become the mainstream for…

Computation and Language · Computer Science 2024-08-28 Dingzirui Wang , Longxu Dou , Xuanliang Zhang , Qingfu Zhu , Wanxiang Che

Seq2seq models have been shown to struggle with compositional generalization in semantic parsing, i.e. generalizing to unseen compositions of phenomena that the model handles correctly in isolation. We phrase semantic parsing as a two-step…

Computation and Language · Computer Science 2023-05-29 Matthias Lindemann , Alexander Koller , Ivan Titov

Flexible neural sequence models outperform grammar- and automaton-based counterparts on a variety of tasks. However, neural models perform poorly in settings requiring compositional generalization beyond the training data -- particularly to…

Computation and Language · Computer Science 2021-06-09 Ekin Akyürek , Afra Feyza Akyürek , Jacob Andreas

Real-world applications of machine learning models often confront data distribution shifts, wherein discrepancies exist between the training and test data distributions. In the common multi-domain multi-class setup, as the number of classes…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Haoxiang Wang , Haozhe Si , Huajie Shao , Han Zhao

Classifying patents by their relevance to the UN Sustainable Development Goals (SDGs) is crucial for tracking how innovation addresses global challenges. However, the absence of a large, labeled dataset limits the use of supervised…

Computation and Language · Computer Science 2025-09-12 Grazia Sveva Ascione , Nicolò Tamagnone

We review the task of Sentence Pair Scoring, popular in the literature in various forms - viewed as Answer Sentence Selection, Semantic Text Scoring, Next Utterance Ranking, Recognizing Textual Entailment, Paraphrasing or e.g. a component…

Computation and Language · Computer Science 2016-05-18 Petr Baudiš , Jan Pichl , Tomáš Vyskočil , Jan Šedivý

Compositional generalization -- the ability to understand and generate novel combinations of learned concepts -- enables models to extend their capabilities beyond limited experiences. While effective, the data structures and principles…

Machine Learning · Computer Science 2025-12-12 Lingjing Kong , Shaoan Xie , Yang Jiao , Yetian Chen , Yanhui Guo , Simone Shao , Yan Gao , Guangyi Chen , Kun Zhang