English
Related papers

Related papers: Online learning using multiple times weight updati…

200 papers

Data in modern economic and financial applications often arrive as a stream, requiring models and inference to be updated in real time -- yet most semiparametric methods remain batch-based and computationally impractical in large-scale…

Econometrics · Economics 2026-03-10 Xiaohong Chen , Elie Tamer , Qingsong Yao

In this paper, we introduce a new online scheduling framework for minimizing total weighted completion time in a general setting. The framework is inspired by the work of Hall et al. [Mathematics of Operations Research, Vol 22(3):513-544,…

Data Structures and Algorithms · Computer Science 2017-04-25 Samir Khuller , Jingling Li , Pascal Sturmfels , Kevin Sun , Prayaag Venkat

In online convex optimization it is well known that certain subclasses of objective functions are much easier than arbitrary convex functions. We are interested in designing adaptive methods that can automatically get fast rates in as many…

Machine Learning · Computer Science 2021-08-31 Tim van Erven , Wouter M. Koolen

Automated data augmentation has shown superior performance in image recognition. Existing works search for dataset-level augmentation policies without considering individual sample variations, which are likely to be sub-optimal. On the…

Machine Learning · Computer Science 2020-12-23 Fengwei Zhou , Jiawei Li , Chuanlong Xie , Fei Chen , Lanqing Hong , Rui Sun , Zhenguo Li

We consider a natural semi-online model for weighted paging, where at any time the algorithm is given predictions, possibly with errors, about the next arrival of each page. The model is inspired by Belady's classic optimal offline…

Data Structures and Algorithms · Computer Science 2021-11-10 Nikhil Bansal , Christian Coester , Ravi Kumar , Manish Purohit , Erik Vee

This work focuses on the setting of dynamic regret in the context of online learning with full information. In particular, we analyze regret bounds with respect to the temporal variability of the loss functions. By assuming that the…

Machine Learning · Computer Science 2021-02-16 Nicolò Campolongo , Francesco Orabona

This note explores probabilistic sampling weighted by uncertainty in active learning. This method has been previously used and authors have tangentially remarked on its efficacy. The scheme has several benefits: (1) it is computationally…

Machine Learning · Computer Science 2019-09-12 Vinay Jethava

We consider the problem of online adaptation of a neural network designed to represent vehicle dynamics. The neural network model is intended to be used by an MPC control law to autonomously control the vehicle. This problem is challenging…

Robotics · Computer Science 2019-05-14 Grady Williams , Brian Goldfain , James M. Rehg , Evangelos A. Theodorou

Online decision making aims to learn the optimal decision rule by making personalized decisions and updating the decision rule recursively. It has become easier than before with the help of big data, but new challenges also come along.…

Machine Learning · Statistics 2020-10-16 Haoyu Chen , Wenbin Lu , Rui Song

A significant challenge in maintaining real-world machine learning models is responding to the continuous and unpredictable evolution of data. Most practitioners are faced with the difficult question: when should I retrain or update my…

Machine Learning · Computer Science 2025-05-22 Regol Florence , Schwinn Leo , Sprague Kyle , Coates Mark , Markovich Thomas

Modern deep models are often pretrained on large-scale data with missing labels using composite objectives, where the relative weights of multiple loss terms act as hyperparameters. Tuning these weights with random search or Bayesian…

Machine Learning · Computer Science 2026-05-11 Ivan Karpukhin , Andrey Savchenko

In this paper, we demonstrate how to learn the objective function of a decision-maker while only observing the problem input data and the decision-maker's corresponding decisions over multiple rounds. We present exact algorithms for this…

Optimization and Control · Mathematics 2020-03-31 Andreas Bärmann , Alexander Martin , Sebastian Pokutta , Oskar Schneider

As massive medical data become available with an increasing number of scans, expanding classes, and varying sources, prevalent training paradigms -- where AI is trained with multiple passes over fixed, finite datasets -- face significant…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Yu-Cheng Chou , Zongwei Zhou , Alan Yuille

While both cost-sensitive learning and online learning have been studied extensively, the effort in simultaneously dealing with these two issues is limited. Aiming at this challenge task, a novel learning framework is proposed in this…

Machine Learning · Computer Science 2013-10-31 Boyu Wang , Joelle Pineau

Machine learning models (mainly neural networks) are used more and more in real life. Users feed their data to the model for training. But these processes are often one-way. Once trained, the model remembers the data. Even when data is…

Machine Learning · Computer Science 2022-10-03 Zihao Cao , Jianzong Wang , Shijing Si , Zhangcheng Huang , Jing Xiao

In online learning an algorithm plays against an environment with losses possibly picked by an adversary at each round. The generality of this framework includes problems that are not adversarial, for example offline optimization, or saddle…

Machine Learning · Computer Science 2021-02-04 Ryan D'Orazio , Ruitong Huang

This paper addresses the problem of online inverse reinforcement learning for systems with limited data and uncertain dynamics. In the developed approach, the state and control trajectories are recorded online by observing an agent perform…

Systems and Control · Electrical Eng. & Systems 2020-08-21 Ryan Self , S M Nahid Mahmud , Katrine Hareland , Rushikesh Kamalapurkar

This paper addresses the problem of online learning in a dynamic setting. We consider a social network in which each individual observes a private signal about the underlying state of the world and communicates with her neighbors at each…

Optimization and Control · Mathematics 2013-10-02 Shahin Shahrampour , Alexander Rakhlin , Ali Jadbabaie

In the problem of online load balancing on uniformly related machines with bounded migration, jobs arrive online one after another and have to be immediately placed on one of a given set of machines without knowledge about jobs that may…

Data Structures and Algorithms · Computer Science 2022-09-05 Marten Maack

Recent language models achieve impressive results in tasks involving complex multistep reasoning, but scaling these capabilities further traditionally requires expensive collection of more annotated data. In this work, we explore the…

Computation and Language · Computer Science 2024-10-25 Marek Kadlčík , Michal Štefánik