English
Related papers

Related papers: Teaching Smaller Language Models To Generalise To …

200 papers

We introduce a large language model (LLM) based approach to answer complex questions requiring multi-hop numerical reasoning over financial reports. While LLMs have exhibited remarkable performance on various natural language and reasoning…

Computation and Language · Computer Science 2023-11-28 Karmvir Singh Phogat , Chetan Harsha , Sridhar Dasaratha , Shashishekar Ramakrishna , Sai Akhil Puranam

Humans are capable of abstracting various tasks as different combinations of multiple attributes. This perspective of compositionality is vital for human rapid learning and adaption since previous experiences from related tasks can be…

Large language models can solve new tasks without task-specific fine-tuning. This ability, also known as in-context learning (ICL), is considered an emergent ability and is primarily seen in large language models with billions of…

Computation and Language · Computer Science 2024-04-04 Sherin Muckatira , Vijeta Deshpande , Vladislav Lialin , Anna Rumshisky

Recent years have seen great success in the use of neural seq2seq models on the text-to-SQL task. However, little work has paid attention to how these models generalize to realistic unseen data, which naturally raises a question: does this…

Computation and Language · Computer Science 2019-08-30 Shuaichen Chang , Pengfei Liu , Yun Tang , Jing Huang , Xiaodong He , Bowen Zhou

We explore the use of large pretrained language models as few-shot semantic parsers. The goal in semantic parsing is to generate a structured meaning representation given a natural language input. However, language models are trained to…

While several benefits were realized for multilingual vision-language pretrained models, recent benchmarks across various tasks and languages showed poor cross-lingual generalisation when multilingually pre-trained vision-language models…

Computation and Language · Computer Science 2022-12-01 Farhad Nooralahzadeh , Rico Sennrich

Neural network models often generalize poorly to mismatched domains or distributions. In NLP, this issue arises in particular when models are expected to generalize compositionally, that is, to novel combinations of familiar words and…

Computation and Language · Computer Science 2021-11-10 Wang Zhu , Peter Shaw , Tal Linzen , Fei Sha

This paper addresses the gap between general-purpose text embeddings and the specific demands of item retrieval tasks. We demonstrate the shortcomings of existing models in capturing the nuances necessary for zero-shot performance on item…

Information Retrieval · Computer Science 2024-03-01 Yuxuan Lei , Jianxun Lian , Jing Yao , Mingqi Wu , Defu Lian , Xing Xie

Zero-shot intent classification is a vital and challenging task in dialogue systems, which aims to deal with numerous fast-emerging unacquainted intents without annotated training data. To obtain more satisfactory performance, the crucial…

Computation and Language · Computer Science 2022-06-07 Han Liu , Siyang Zhao , Xiaotong Zhang , Feng Zhang , Junjie Sun , Hong Yu , Xianchao Zhang

We propose a new strategy for applying large pre-trained language models to novel tasks when labeled training data is limited. Rather than apply the model in a typical zero-shot or few-shot fashion, we treat the model as the basis for…

Machine Learning · Computer Science 2022-05-06 Ryan Smith , Jason A. Fries , Braden Hancock , Stephen H. Bach

In many NLP applications that involve interpreting sentences within a rich context -- for instance, information retrieval systems or dialogue systems -- it is desirable to be able to preserve the sentence in a form that can be readily…

Computation and Language · Computer Science 2023-10-11 Benjamin Kane , Lenhart Schubert

Complex, multi-task problems have proven to be difficult to solve efficiently in a sparse-reward reinforcement learning setting. In order to be sample efficient, multi-task learning requires reuse and sharing of low-level policies. To…

Machine Learning · Computer Science 2021-09-28 Valerie Chen , Abhinav Gupta , Kenneth Marino

The recent proliferation of richly structured probabilistic models raises the question of how to automatically determine an appropriate model for a dataset. We investigate this question for a space of matrix decomposition models which can…

Machine Learning · Computer Science 2012-10-19 Roger Grosse , Ruslan R Salakhutdinov , William T. Freeman , Joshua B. Tenenbaum

The ability of language models to learn a task from a few examples in context has generated substantial interest. Here, we provide a perspective that situates this type of supervised few-shot learning within a much broader spectrum of…

Computation and Language · Computer Science 2025-06-06 Andrew Kyle Lampinen , Stephanie C. Y. Chan , Aaditya K. Singh , Murray Shanahan

Building robust and general dialogue models for spoken conversations is challenging due to the gap in distributions of spoken and written data. This paper presents our approach to build generalized models for the Knowledge-grounded…

Computation and Language · Computer Science 2022-03-09 Ruijie Yan , Shuang Peng , Haitao Mi , Liang Jiang , Shihui Yang , Yuchi Zhang , Jiajun Li , Liangrui Peng , Yongliang Wang , Zujie Wen

Language models exhibit an emergent ability to learn a new task from a small number of input-output demonstrations. However, recent work shows that in-context learners largely rely on their pre-trained knowledge, such as the sentiment of…

Computation and Language · Computer Science 2023-07-20 Michal Štefánik , Marek Kadlčík

There has been a growing interest in enhancing the mathematical problem-solving (MPS) capabilities of large language models. While the majority of research efforts concentrate on creating specialized models to solve mathematical problems,…

Computation and Language · Computer Science 2025-07-08 Ruochen Zhou , Minrui Xu , Shiqi Chen , Junteng Liu , Yunqi Li , Xinxin Lin , Zhengyu Chen , Junxian He

Large-scale pre-trained language models have contributed significantly to natural language processing by demonstrating remarkable abilities as few-shot learners. However, their effectiveness depends mainly on scaling the model parameters…

Computation and Language · Computer Science 2023-01-26 Ningyu Zhang , Luoqiu Li , Xiang Chen , Shumin Deng , Zhen Bi , Chuanqi Tan , Fei Huang , Huajun Chen

We explore a new language model inversion problem under strict black-box, zero-shot, and limited data conditions. We propose a novel training-free framework that reconstructs prompts using only a limited number of text outputs from a…

Computation and Language · Computer Science 2025-02-18 Hanqing Li , Diego Klabjan

Language models have demonstrated remarkable performance in solving reasoning tasks; however, even the strongest models still occasionally make reasoning mistakes. Recently, there has been active research aimed at improving reasoning…

Computation and Language · Computer Science 2024-08-30 Tian Ye , Zicheng Xu , Yuanzhi Li , Zeyuan Allen-Zhu