English
Related papers

Related papers: Data Augmentation with In-Context Learning and Com…

200 papers

Chain-of-Thought (CoT) prompting methods have enabled large language models (LLMs) to generate reasoning paths and solve math word problems (MWPs). However, they are sensitive to mistakes in the paths, as any mistake can result in an…

Computation and Language · Computer Science 2023-12-13 Zhenyu Wu , Meng Jiang , Chao Shen

We present a method for augmenting a Large Language Model (LLM) with a combination of text and visual data to enable accurate question answering in visualization of scientific data, making conversational visualization possible. LLMs…

Human-Computer Interaction · Computer Science 2025-01-17 Omar Mena , Alexandre Kouyoumdjian , Lonni Besançon , Michael Gleicher , Ivan Viola , Anders Ynnerman

Previous neural solvers of math word problems (MWPs) are learned with full supervision and fail to generate diverse solutions. In this paper, we address this issue by introducing a \textit{weakly-supervised} paradigm for learning MWPs. Our…

Artificial Intelligence · Computer Science 2021-08-05 Yining Hong , Qing Li , Daniel Ciao , Siyuan Huang , Song-Chun Zhu

In this work, we examine methods for data augmentation for text-based tasks such as neural machine translation (NMT). We formulate the design of a data augmentation policy with desirable properties as an optimization problem, and derive a…

Computation and Language · Computer Science 2018-08-29 Xinyi Wang , Hieu Pham , Zihang Dai , Graham Neubig

The goal of Word Sense Disambiguation (WSD) is to identify the sense of a polysemous word in a specific context. Deep-learning techniques using BERT have achieved very promising results in the field and different methods have been proposed…

Computation and Language · Computer Science 2021-10-15 Guan-Ting Lin , Manuel Giambi

Developing automatic Math Word Problem (MWP) solvers has been an interest of NLP researchers since the 1960s. Over the last few years, there are a growing number of datasets and deep learning-based methods proposed for effectively solving…

Computation and Language · Computer Science 2021-09-21 Yihuai Lan , Lei Wang , Qiyuan Zhang , Yunshi Lan , Bing Tian Dai , Yan Wang , Dongxiang Zhang , Ee-Peng Lim

Most previous methods for text data augmentation are limited to simple tasks and weak baselines. We explore data augmentation on hard tasks (i.e., few-shot natural language understanding) and strong baselines (i.e., pretrained models with…

Computation and Language · Computer Science 2022-03-16 Jing Zhou , Yanan Zheng , Jie Tang , Jian Li , Zhilin Yang

In recent years, there has been significant progress in developing pre-trained language models for NLP. However, these models often struggle when fine-tuned on small datasets. To address this issue, researchers have proposed various…

Computation and Language · Computer Science 2023-08-25 Amirhossein Abaskohi , Sascha Rothe , Yadollah Yaghoobzadeh

Large Language Models (LLMs) have been applied to Math Word Problems (MWPs) with transformative impacts, revolutionizing how these complex problems are approached and solved in various domains including educational settings. However, the…

Computation and Language · Computer Science 2024-06-18 Joykirat Singh , Akshay Nambi , Vibhav Vineet

Machine translation (MT) models used in industries with constantly changing topics, such as translation or news agencies, need to adapt to new data to maintain their performance over time. Our aim is to teach a pre-trained MT model to…

Computation and Language · Computer Science 2021-04-01 Farid Arthaud , Rachel Bawden , Alexandra Birch

We study the performance of a commercially available large language model (LLM) known as ChatGPT on math word problems (MWPs) from the dataset DRAW-1K. To our knowledge, this is the first independent evaluation of ChatGPT. We found that…

Computation and Language · Computer Science 2023-03-01 Paulo Shakarian , Abhinav Koyyalamudi , Noel Ngu , Lakshmivihari Mareedu

Large language models (LLMs) have shown remarkable performance across various sentence-based linguistic phenomena, yet their ability to capture cross-sentence paradigmatic patterns, such as verb alternations, remains underexplored. In this…

Computation and Language · Computer Science 2026-03-17 Giuseppe Samo , Paola Merlo

Many natural language questions require qualitative, quantitative or logical comparisons between two entities or events. This paper addresses the problem of improving the accuracy and consistency of responses to comparison questions by…

Computation and Language · Computer Science 2020-05-26 Akari Asai , Hannaneh Hajishirzi

Data augmentation is an important component in the robustness evaluation of models in natural language processing (NLP) and in enhancing the diversity of the data they are trained on. In this paper, we present NL-Augmenter, a new…

Computation and Language · Computer Science 2022-10-14 Kaustubh D. Dhole , Varun Gangal , Sebastian Gehrmann , Aadesh Gupta , Zhenhao Li , Saad Mahamood , Abinaya Mahendiran , Simon Mille , Ashish Shrivastava , Samson Tan , Tongshuang Wu , Jascha Sohl-Dickstein , Jinho D. Choi , Eduard Hovy , Ondrej Dusek , Sebastian Ruder , Sajant Anand , Nagender Aneja , Rabin Banjade , Lisa Barthe , Hanna Behnke , Ian Berlot-Attwell , Connor Boyle , Caroline Brun , Marco Antonio Sobrevilla Cabezudo , Samuel Cahyawijaya , Emile Chapuis , Wanxiang Che , Mukund Choudhary , Christian Clauss , Pierre Colombo , Filip Cornell , Gautier Dagan , Mayukh Das , Tanay Dixit , Thomas Dopierre , Paul-Alexis Dray , Suchitra Dubey , Tatiana Ekeinhor , Marco Di Giovanni , Tanya Goyal , Rishabh Gupta , Rishabh Gupta , Louanes Hamla , Sang Han , Fabrice Harel-Canada , Antoine Honore , Ishan Jindal , Przemyslaw K. Joniak , Denis Kleyko , Venelin Kovatchev , Kalpesh Krishna , Ashutosh Kumar , Stefan Langer , Seungjae Ryan Lee , Corey James Levinson , Hualou Liang , Kaizhao Liang , Zhexiong Liu , Andrey Lukyanenko , Vukosi Marivate , Gerard de Melo , Simon Meoni , Maxime Meyer , Afnan Mir , Nafise Sadat Moosavi , Niklas Muennighoff , Timothy Sum Hon Mun , Kenton Murray , Marcin Namysl , Maria Obedkova , Priti Oli , Nivranshu Pasricha , Jan Pfister , Richard Plant , Vinay Prabhu , Vasile Pais , Libo Qin , Shahab Raji , Pawan Kumar Rajpoot , Vikas Raunak , Roy Rinberg , Nicolas Roberts , Juan Diego Rodriguez , Claude Roux , Vasconcellos P. H. S. , Ananya B. Sai , Robin M. Schmidt , Thomas Scialom , Tshephisho Sefara , Saqib N. Shamsi , Xudong Shen , Haoyue Shi , Yiwen Shi , Anna Shvets , Nick Siegel , Damien Sileo , Jamie Simon , Chandan Singh , Roman Sitelew , Priyank Soni , Taylor Sorensen , William Soto , Aman Srivastava , KV Aditya Srivatsa , Tony Sun , Mukund Varma T , A Tabassum , Fiona Anting Tan , Ryan Teehan , Mo Tiwari , Marie Tolkiehn , Athena Wang , Zijian Wang , Gloria Wang , Zijie J. Wang , Fuxuan Wei , Bryan Wilie , Genta Indra Winata , Xinyi Wu , Witold Wydmański , Tianbao Xie , Usama Yaseen , Michael A. Yee , Jing Zhang , Yue Zhang

Mixup generates augmented samples by linearly interpolating inputs and labels with a controllable ratio. However, since it operates in the latent embedding level, the resulting samples are not human-interpretable. In contrast, LLM-based…

Computation and Language · Computer Science 2026-02-09 Fanshuang Kong , Richong Zhang , Qiyu Sun , Zhijie Nie , Ting Deng , Chunming Hu

Text data augmentation is a complex problem due to the discrete nature of sentences. Although rule-based augmentation methods are widely adopted in real-world applications because of their simplicity, they suffer from potential semantic…

Computation and Language · Computer Science 2024-02-09 Juhwan Choi , Kyohoon Jin , Junho Lee , Sangmin Song , Youngbin Kim

Large language models (LLMs) still grapple with complex tasks like mathematical reasoning. Despite significant efforts invested in improving prefix prompts or reasoning process, the crucial role of problem context might have been neglected.…

Computation and Language · Computer Science 2024-03-28 Haoran Liao , Jidong Tian , Shaohua Hu , Hao He , Yaohui Jin

Retrieval-augmented language models (RALMs) hold promise to produce language understanding systems that are are factual, efficient, and up-to-date. An important desideratum of RALMs, is that retrieved information helps model performance…

Computation and Language · Computer Science 2024-05-07 Ori Yoran , Tomer Wolfson , Ori Ram , Jonathan Berant

Recently, utilizing large language models (LLMs) for metaphor detection has achieved promising results. However, these methods heavily rely on the capabilities of closed-source LLMs, which come with relatively high inference costs and…

Computation and Language · Computer Science 2025-03-04 Kaidi Jia , Yanxia Wu , Ming Liu , Rongsheng Li

The use of Large Language Models (LLMs) in mathematical reasoning has become a cornerstone of related research, demonstrating the intelligence of these models and enabling potential practical applications through their advanced performance,…

Computation and Language · Computer Science 2024-12-20 Kathrin Seßler , Yao Rong , Emek Gözlüklü , Enkelejda Kasneci