中文
相关论文

相关论文: When More Data Doesn't Help: Limits of Adaptation …

200 篇论文

This paper studies the operation of multi-agent networks engaged in multi-task decision problems under the paradigm of simultaneous learning and adaptation. Two scenarios are considered: one in which a decision must be taken among multiple…

信号处理 · 电气工程与系统科学 2019-12-13 Stefano Marano , Ali H. Sayed

The benefit of multi-task learning over single-task learning relies on the ability to use relations across tasks to improve performance on any single task. While sharing representations is an important mechanism to share information across…

机器学习 · 计算机科学 2021-06-14 Shagun Sodhani , Amy Zhang , Joelle Pineau

We investigate whether and where multi-task learning (MTL) can improve performance on NLP problems related to argumentation mining (AM), in particular argument component identification. Our results show that MTL performs particularly well…

计算与语言 · 计算机科学 2018-05-07 Claudia Schulz , Steffen Eger , Johannes Daxenberger , Tobias Kahse , Iryna Gurevych

We present a new adaptive algorithm for learning discrete distributions under distribution drift. In this setting, we observe a sequence of independent samples from a discrete distribution that is changing over time, and the goal is to…

机器学习 · 计算机科学 2024-03-11 Alessio Mazzetto

This paper investigates, from information theoretic grounds, a learning problem based on the principle that any regularity in a given dataset can be exploited to extract compact features from data, i.e., using fewer bits than needed to…

机器学习 · 统计学 2018-11-14 Matías Vera , Leonardo Rey Vega , Pablo Piantanida

Optimization problems are ubiquitous in our societies and are present in almost every segment of the economy. Most of these optimization problems are NP-hard and computationally demanding, often requiring approximate solutions for…

最优化与控制 · 数学 2021-06-23 James Kotary , Ferdinando Fioretto , Pascal Van Hentenryck

When a number of similar tasks have to be learned simultaneously, multi-task learning (MTL) models can attain significantly higher accuracy than single-task learning (STL) models. However, the advantage of MTL depends on various factors,…

机器学习 · 计算机科学 2023-10-26 Afiya Ayman , Ayan Mukhopadhyay , Aron Laszka

Active learning aims to reduce annotation cost by predicting which samples are useful for a human expert to label. Although this field is quite old, several important challenges to using active learning in real-world settings still remain…

机器学习 · 计算机科学 2021-04-27 Louis Desreumaux , Vincent Lemaire

In meta reinforcement learning (meta RL), an agent learns from a set of training tasks how to quickly solve a new task, drawn from the same task distribution. The optimal meta RL policy, a.k.a. the Bayes-optimal behavior, is well defined,…

机器学习 · 计算机科学 2024-04-01 Zohar Rimon , Aviv Tamar , Gilad Adler

There is a growing interest in single-class modelling and out-of-distribution detection as fully supervised machine learning models cannot reliably identify classes not included in their training. The long tail of infinitely many…

计算机视觉与模式识别 · 计算机科学 2023-07-04 Matthew Baugh , Jeremy Tan , Johanna P. Müller , Mischa Dombrowski , James Batten , Bernhard Kainz

Learning theory has traditionally followed a model-centric approach, focusing on designing optimal algorithms for a fixed natural learning task (e.g., linear classification or regression). In this paper, we adopt a complementary…

机器学习 · 计算机科学 2025-04-29 Steve Hanneke , Shay Moran , Alexander Shlimovich , Amir Yehudayoff

Learning-based techniques are increasingly effective at controlling complex systems using data-driven models. However, most work done so far has focused on learning individual tasks or control laws. Hence, it is still a largely unaddressed…

系统与控制 · 电气工程与系统科学 2020-05-08 Alexandre Capone , Armin Lederer , Jonas Umlauft , Sandra Hirche

We consider the problem of hypothesis testing for discrete distributions. In the standard model, where we have sample access to an underlying distribution $p$, extensive research has established optimal bounds for uniformity testing,…

机器学习 · 计算机科学 2024-12-03 Maryam Aliakbarpour , Piotr Indyk , Ronitt Rubinfeld , Sandeep Silwal

Regardless of the particular task we want them to perform in an environment, there are often shared safety constraints we want our agents to respect. For example, regardless of whether it is making a sandwich or clearing the table, a…

机器学习 · 计算机科学 2023-09-06 Konwoo Kim , Gokul Swamy , Zuxin Liu , Ding Zhao , Sanjiban Choudhury , Zhiwei Steven Wu

This work proposes Multi-task Meta Learning (MTML), integrating two learning paradigms Multi-Task Learning (MTL) and meta learning, to bring together the best of both worlds. In particular, it focuses simultaneous learning of multiple…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Richa Upadhyay , Prakash Chandra Chhipa , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

Meta-learning algorithms are widely used for few-shot learning. For example, image recognition systems that readily adapt to unseen classes after seeing only a few labeled examples. Despite their success, we show that modern meta-learning…

机器学习 · 计算机科学 2021-10-28 Mayank Agarwal , Mikhail Yurochkin , Yuekai Sun

We consider the problem of multi-task learning in the high dimensional setting. In particular, we introduce an estimator and investigate its statistical and computational properties for the problem of multiple connected linear regressions…

机器学习 · 统计学 2023-07-03 Amir Asiaee , Samet Oymak , Kevin R. Coombes , Arindam Banerjee

In transfer learning, we wish to make inference about a target population when we have access to data both from the distribution itself, and from a different but related source distribution. We introduce a flexible framework for transfer…

机器学习 · 统计学 2021-09-03 Henry W. J. Reeve , Timothy I. Cannings , Richard J. Samworth

Meta-learning aims to learn a model that can handle multiple tasks generated from an unknown but shared distribution. However, typical meta-learning algorithms have assumed the tasks to be similar such that a single meta-learner is…

机器学习 · 计算机科学 2023-12-08 Kyeongryeol Go , Seyoung Yun

Recent advancements in reinforcement learning (RL) for large language models (LLMs), exemplified by DeepSeek R1, have shown that even a simple question-answering task can substantially improve an LLM's reasoning capabilities. In this work,…

计算与语言 · 计算机科学 2025-03-10 Stephen Chung , Wenyu Du , Jie Fu