English
Related papers

Related papers: Model-Agnostic Meta-Learning for Natural Language …

200 papers

Meta-learning allows an intelligent agent to leverage prior learning episodes as a basis for quickly improving performance on a novel task. Bayesian hierarchical modeling provides a theoretical framework for formalizing meta-learning as…

Machine Learning · Computer Science 2018-01-29 Erin Grant , Chelsea Finn , Sergey Levine , Trevor Darrell , Thomas Griffiths

Meta-Learning (ML) has proven to be a useful tool for training Few-Shot Learning (FSL) algorithms by exposure to batches of tasks sampled from a meta-dataset. However, the standard training procedure overlooks the dynamic nature of the…

Machine Learning · Computer Science 2021-04-13 Mateusz Ochal , Massimiliano Patacchiola , Amos Storkey , Jose Vazquez , Sen Wang

Although large language models (LLMs) has shown great performance on natural language processing (NLP) in the financial domain, there are no publicly available financial tailtored LLMs, instruction tuning datasets, and evaluation…

Computation and Language · Computer Science 2023-06-12 Qianqian Xie , Weiguang Han , Xiao Zhang , Yanzhao Lai , Min Peng , Alejandro Lopez-Lira , Jimin Huang

To train neural machine translation models simultaneously on multiple tasks (languages), it is common to sample each task uniformly or in proportion to dataset sizes. As these methods offer little control over performance trade-offs, we…

Machine Learning · Computer Science 2019-09-17 Sébastien Jean , Orhan Firat , Melvin Johnson

In the realm of recommender systems, the ubiquitous adoption of deep neural networks has emerged as a dominant paradigm for modeling diverse business objectives. As user bases continue to expand, the necessity of personalization and…

Natural Language Processing (NLP) has transformed the financial industry, enabling advancements in areas such as textual analysis, risk management, and forecasting. Large language models (LLMs) like BloombergGPT and FinMA have set new…

Computation and Language · Computer Science 2025-12-08 Jawad Ibn Ahad , Muhammad Rafsan Kabir , Robin Krambroeckers , Sifat Momen , Nabeel Mohammed , Shafin Rahman

Model-Agnostic Meta-Learning (MAML) is a famous few-shot learning method that has inspired many follow-up efforts, such as ANIL and BOIL. However, as an inductive method, MAML is unable to fully utilize the information of query set,…

Machine Learning · Computer Science 2022-07-12 Guodong Liu , Tongling Wang , Shuoxi Zhang , Kun He

In this study, the performance of various predictive models, including probabilistic baseline, CNN, LSTM, and finetuned LLMs, in forecasting merchant categories from financial transaction data have been evaluated. Utilizing datasets from…

Information Retrieval · Computer Science 2025-02-25 Halil Ibrahim Ergul , Selim Balcisoy , Burcin Bozkaya

Large Language Models (LLMs) have demonstrated impressive capabilities across diverse Natural Language Processing (NLP) tasks, including language understanding, reasoning, and generation. However, general-domain LLMs often struggle with…

Computation and Language · Computer Science 2024-11-06 Sorouralsadat Fatemi , Yuheng Hu , Maryam Mousavi

Multi-Task Learning (MTL) is widely-accepted in Natural Language Processing as a standard technique for learning multiple related tasks in one model. Training an MTL model requires having the training data for all tasks available at the…

Computation and Language · Computer Science 2023-02-23 Sudipta Kar , Giuseppe Castellucci , Simone Filice , Shervin Malmasi , Oleg Rokhlenko

We consider Model-Agnostic Meta-Learning (MAML) methods for Reinforcement Learning (RL) problems, where the goal is to find a policy using data from several tasks represented by Markov Decision Processes (MDPs) that can be updated by one…

Machine Learning · Computer Science 2021-11-18 Alireza Fallah , Kristian Georgiev , Aryan Mokhtari , Asuman Ozdaglar

This study investigates the performance of robust anomaly detection models in industrial inspection, focusing particularly on their ability to handle noisy data. We propose to leverage the adaptation ability of meta learning approaches to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Muhammad Aqeel , Shakiba Sharifi , Marco Cristani , Francesco Setti

In this paper, we propose a learning algorithm that enables a model to quickly exploit commonalities among related tasks from an unseen task distribution, before quickly adapting to specific tasks from that same distribution. We investigate…

Machine Learning · Computer Science 2021-07-21 Arnout Devos , Yatin Dandi

The majority of work in targeted sentiment analysis has concentrated on finding better methods to improve the overall results. Within this paper we show that these models are not robust to linguistic phenomena, specifically negation and…

Computation and Language · Computer Science 2021-04-01 Andrew Moore , Jeremy Barnes

While monolingual data has been shown to be useful in improving bilingual neural machine translation (NMT), effectively and efficiently leveraging monolingual data for Multilingual NMT (MNMT) systems is a less explored area. In this work,…

Computation and Language · Computer Science 2020-10-07 Yiren Wang , ChengXiang Zhai , Hany Hassan Awadalla

Although recent Massively Multilingual Language Models (MMLMs) like mBERT and XLMR support around 100 languages, most existing multilingual NLP benchmarks provide evaluation data in only a handful of these languages with little linguistic…

Computation and Language · Computer Science 2022-11-15 Kabir Ahuja , Sandipan Dandapat , Sunayana Sitaram , Monojit Choudhury

Recent Active Learning (AL) approaches in Natural Language Processing (NLP) proposed using off-the-shelf pretrained language models (LMs). In this paper, we argue that these LMs are not adapted effectively to the downstream task during AL…

Computation and Language · Computer Science 2022-03-03 Katerina Margatina , Loïc Barrault , Nikolaos Aletras

Recent studies leverage large language models with multi-tasking capabilities, using natural language prompts to guide the model's behavior and surpassing performance of task-specific models. Motivated by this, we ask: can we build a single…

Computation and Language · Computer Science 2024-04-04 Siddhant Arora , Hayato Futami , Jee-weon Jung , Yifan Peng , Roshan Sharma , Yosuke Kashiwagi , Emiru Tsunoo , Karen Livescu , Shinji Watanabe

In this paper, we present a Multi-Task Deep Neural Network (MT-DNN) for learning representations across multiple natural language understanding (NLU) tasks. MT-DNN not only leverages large amounts of cross-task data, but also benefits from…

Computation and Language · Computer Science 2019-05-31 Xiaodong Liu , Pengcheng He , Weizhu Chen , Jianfeng Gao

Financial sentiment analysis refers to classifying financial text contents into sentiment categories (e.g. positive, negative, and neutral). In this paper, we focus on the classification of financial news title, which is a challenging task…

Computation and Language · Computer Science 2024-01-11 Wei Luo , Dihong Gong