English
Related papers

Related papers: Teaching Autoregressive Language Models Complex Ta…

200 papers

We show that autoregressive language models can learn to infill text after we apply a straightforward transformation to the dataset, which simply moves a span of text from the middle of a document to its end. While this data augmentation…

Computation and Language · Computer Science 2022-07-29 Mohammad Bavarian , Heewoo Jun , Nikolas Tezak , John Schulman , Christine McLeavey , Jerry Tworek , Mark Chen

Non-autoregressive translation (NAT) models remove the dependence on previous target tokens and generate all target tokens in parallel, resulting in significant inference speedup but at the cost of inferior translation accuracy compared to…

Machine Learning · Computer Science 2019-11-25 Junliang Guo , Xu Tan , Linli Xu , Tao Qin , Enhong Chen , Tie-Yan Liu

Graph transformers have gained popularity in various graph-based tasks by addressing challenges faced by traditional Graph Neural Networks. However, the quadratic complexity of self-attention operations and the extensive layering in graph…

Machine Learning · Computer Science 2023-09-20 Reza Shirkavand , Heng Huang

Large language models (LLMs) can acquire strong code-generation capabilities through few-shot learning. In contrast, supervised fine-tuning is still needed for smaller models to achieve good performance. Such fine-tuning demands a large…

Computation and Language · Computer Science 2023-06-09 Zhangir Azerbayev , Ansong Ni , Hailey Schoelkopf , Dragomir Radev

Differentially Private (DP) learning has seen limited success for building large deep learning models of text, and straightforward attempts at applying Differentially Private Stochastic Gradient Descent (DP-SGD) to NLP tasks have resulted…

Machine Learning · Computer Science 2022-11-11 Xuechen Li , Florian Tramèr , Percy Liang , Tatsunori Hashimoto

Guiding large language models with a selected set of human-authored demonstrations is a common practice for improving LLM applications. However, human effort can be costly, especially in specialized domains (e.g., clinical diagnosis), and…

Artificial Intelligence · Computer Science 2024-08-23 Kai Tzu-iunn Ong , Taeyoon Kwon , Jinyoung Yeo

A promising paradigm for adapting instruction-tuned language models is to learn task-specific updates on a pretrained base model and subsequently merge them into the instruction-tuned model. However, existing approaches typically treat the…

Computation and Language · Computer Science 2026-05-05 Zhiwen Ruan , Yichao Du , Jianjie Zheng , Longyue Wang , Yun Chen , Peng Li , Jinsong Su , Yang Liu , Guanhua Chen

One of the big challenges in machine learning applications is that training data can be different from the real-world data faced by the algorithm. In language modeling, users' language (e.g. in private messaging) could change in a year and…

Computation and Language · Computer Science 2018-03-07 Vadim Popov , Mikhail Kudinov , Irina Piontkovskaya , Petr Vytovtov , Alex Nevidomsky

Deep neural networks have become a foundational tool for addressing imaging inverse problems. They are typically trained for a specific task, with a supervised loss to learn a mapping from the observations to the image to recover. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Matthieu Terris , Thomas Moreau

Deep pre-trained Transformer models have achieved state-of-the-art results over a variety of natural language processing (NLP) tasks. By learning rich language knowledge with millions of parameters, these models are usually…

Computation and Language · Computer Science 2020-11-10 Zhengyan Zhang , Fanchao Qi , Zhiyuan Liu , Qun Liu , Maosong Sun

Large pre-trained language models perform remarkably well on tasks that can be done "in one pass", such as generating realistic text or synthesizing computer programs. However, they struggle with tasks that require unbounded multi-step…

Recently, deep models have shown tremendous improvements in neural machine translation (NMT). However, systems of this kind are computationally expensive and memory intensive. In this paper, we take a natural step towards learning strong…

Computation and Language · Computer Science 2020-12-29 Bei Li , Ziyang Wang , Hui Liu , Quan Du , Tong Xiao , Chunliang Zhang , Jingbo Zhu

Incremental language learning with pseudo-data can alleviate catastrophic forgetting in neural networks. However, to obtain better performance, former methods have higher demands for pseudo-data of the previous tasks. The performance…

Computation and Language · Computer Science 2021-10-19 Han Wang , Ruiliu Fu , Chengzhang Li , Xuejun Zhang , Jun Zhou , Yonghong Yan

Prior work has shown that finetuning large language models (LLMs) using machine-generated instruction-following data enables such models to achieve remarkable zero-shot capabilities on new tasks, and no human-written instructions are…

Computation and Language · Computer Science 2023-04-07 Baolin Peng , Chunyuan Li , Pengcheng He , Michel Galley , Jianfeng Gao

The state of the art in machine translation (MT) is governed by neural approaches, which typically provide superior translation accuracy over statistical approaches. However, on the closely related task of word alignment, traditional…

Computation and Language · Computer Science 2019-09-06 Sarthak Garg , Stephan Peitz , Udhyakumar Nallasamy , Matthias Paulik

Fine-tuning language models (LMs) has yielded success on diverse downstream tasks, but as LMs grow in size, backpropagation requires a prohibitively large amount of memory. Zeroth-order (ZO) methods can in principle estimate gradients using…

Machine Learning · Computer Science 2024-01-12 Sadhika Malladi , Tianyu Gao , Eshaan Nichani , Alex Damian , Jason D. Lee , Danqi Chen , Sanjeev Arora

Large-scale training datasets lie at the core of the recent success of neural machine translation (NMT) models. However, the complex patterns and potential noises in the large-scale data make training NMT models difficult. In this work, we…

Computation and Language · Computer Science 2020-10-07 Wenxiang Jiao , Xing Wang , Shilin He , Irwin King , Michael R. Lyu , Zhaopeng Tu

Research suggests that tutors should adopt a strategic approach when addressing math errors made by low-efficacy students. Rather than drawing direct attention to the error, tutors should guide the students to identify and correct their…

Human-Computer Interaction · Computer Science 2024-01-09 Sanjit Kakarla , Danielle Thomas , Jionghao Lin , Shivang Gupta , Kenneth R. Koedinger

We explore the application of transformer-based language models to automated theorem proving. This work is motivated by the possibility that a major limitation of automated theorem provers compared to humans -- the generation of original…

Machine Learning · Computer Science 2020-09-09 Stanislas Polu , Ilya Sutskever

Deep neural language models have set new breakthroughs in many tasks of Natural Language Processing (NLP). Recent work has shown that deep transformer language models (pretrained on large amounts of texts) can achieve high levels of…

Computation and Language · Computer Science 2022-06-02 Milad Moradi , Kathrin Blagec , Florian Haberl , Matthias Samwald