中文
相关论文

相关论文: Future Gradient Descent for Adapting the Temporal …

200 篇论文

Time series forecasting is vital in many real-world applications, yet developing models that generalize well on unseen relevant domains -- such as forecasting web traffic data on new platforms/websites or estimating e-commerce demand in new…

机器学习 · 计算机科学 2024-12-17 Songgaojun Deng , Maarten de Rijke

This paper investigates distributed online convex optimization in the presence of an aggregative variable without any global/central coordinators over a multi-agent network, where each individual agent is only able to access partial…

最优化与控制 · 数学 2020-07-15 Xiuxian Li , Xinlei Yi , Lihua Xie

A fundamental assumption of most machine learning algorithms is that the training and test data are drawn from the same underlying distribution. However, this assumption is violated in almost all practical applications: machine learning…

机器学习 · 计算机科学 2021-12-02 Marvin Zhang , Henrik Marklund , Nikita Dhawan , Abhishek Gupta , Sergey Levine , Chelsea Finn

Meta-learning of shared initialization parameters has shown to be highly effective in solving few-shot learning tasks. However, extending the framework to many-shot scenarios, which may further enhance its practicality, has been relatively…

机器学习 · 计算机科学 2022-02-17 Jaewoong Shin , Hae Beom Lee , Boqing Gong , Sung Ju Hwang

This work considered an online distributed optimization problem, with a group of agents whose local objective functions vary with time. Moreover, the value of the objective function is revealed to the corresponding agent after the decision…

最优化与控制 · 数学 2021-08-16 Yipeng Pang , Guoqiang Hu

Domain generalization (DG) aims to learn predictive models that can generalize to unseen domains. Most existing DG approaches focus on learning domain-invariant representations under the assumption of conditional distribution shift (i.e.,…

机器学习 · 计算机科学 2026-02-03 Jewon Yeom , Kyubyung Chae , Hyunggyu Lim , Yoonna Oh , Dongyoon Yang , Taesup Kim

This paper proposes a prediction-based gradient compression method for distributed learning with event-triggered communication. Our goal is to reduce the amount of information transmitted from the distributed agents to the parameter server…

信息论 · 计算机科学 2024-10-04 Adrian Edin , Zheng Chen , Michel Kieffer , Mikael Johansson

We build a theoretical framework for designing and understanding practical meta-learning methods that integrates sophisticated formalizations of task-similarity with the extensive literature on online convex optimization and sequential…

机器学习 · 计算机科学 2019-12-10 Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar

In this work, we propose a method for training distributed GAN with sequential temporary discriminators. Our proposed method tackles the challenge of training GAN in the federated learning manner: How to update the generator with a flow of…

计算机视觉与模式识别 · 计算机科学 2020-07-21 Hui Qu , Yikai Zhang , Qi Chang , Zhennan Yan , Chao Chen , Dimitris Metaxas

Meta-learning stands for 'learning to learn' such that generalization to new tasks is achieved. Among these methods, Gradient-based meta-learning algorithms are a specific sub-class that excel at quick adaptation to new tasks with limited…

机器学习 · 计算机科学 2020-10-20 Jathushan Rajasegaran , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Mubarak Shah

We consider distributed online learning for joint regret with communication constraints. In this setting, there are multiple agents that are connected in a graph. Each round, an adversary first activates one of the agents to issue a…

机器学习 · 计算机科学 2021-10-26 Dirk van der Hoeven , Hédi Hadiji , Tim van Erven

We study the problem of predicting the future, though only in the probabilistic sense of estimating a future state of a time-varying probability distribution. This is not only an interesting academic problem, but solving this extrapolation…

机器学习 · 统计学 2014-11-21 Christoph H. Lampert

Domain generalization (DG) is proposed to deal with the issue of domain shift, which occurs when statistical differences exist between source and target domains. However, most current methods do not account for a common realistic scenario…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Xiran Wang , Jian Zhang , Lei Qi , Yinghuan Shi

Machine learning methods strive to acquire a robust model during the training process that can effectively generalize to test samples, even in the presence of distribution shifts. However, these methods often suffer from performance…

机器学习 · 计算机科学 2024-12-13 Jian Liang , Ran He , Tieniu Tan

Domain generalization aims to learn a model with good generalization ability, that is, the learned model should not only perform well on several seen domains but also on unseen domains with different data distributions. State-of-the-art…

机器学习 · 计算机科学 2023-04-04 Boyang Lyu , Thuan Nguyen , Matthias Scheutz , Prakash Ishwar , Shuchin Aeron

Summary: Errors in gradient trajectories introduce significant artifacts and distortions in magnetic resonance images, particularly in non-Cartesian imaging sequences, where imperfect gradient waveforms can greatly reduce image quality.…

医学物理 · 物理学 2025-06-19 Jonathan B. Martin , Hannah E. Alderson , John C. Gore , Mark D. Does , Kevin D. Harkins

The online meta-learning framework has arisen as a powerful tool for the continual lifelong learning setting. The goal for an agent is to quickly learn new tasks by drawing on prior experience, while it faces with tasks one after another.…

机器学习 · 计算机科学 2021-09-30 Parvin Nazari , Esmaile Khorram

It is a well-known fact that the performance of deep learning models deteriorates when they encounter a distribution shift at test time. Test-time adaptation (TTA) algorithms have been proposed to adapt the model online while inferring test…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Jayeon Yoo , Dongkwan Lee , Inseop Chung , Donghyun Kim , Nojun Kwak

In this paper, we propose Test-Time Training, a general approach for improving the performance of predictive models when training and test data come from different distributions. We turn a single unlabeled test sample into a self-supervised…

机器学习 · 计算机科学 2020-07-03 Yu Sun , Xiaolong Wang , Zhuang Liu , John Miller , Alexei A. Efros , Moritz Hardt

Safely deploying machine learning models to the real world is often a challenging process. Models trained with data obtained from a specific geographic location tend to fail when queried with data obtained elsewhere, agents trained in a…

机器学习 · 计算机科学 2021-11-02 Marco Federici , Ryota Tomioka , Patrick Forré