中文
相关论文

相关论文: Using dynamic loss weighting to boost improvements…

200 篇论文

Stably inverting a dynamic system model is the foundation of numerous servo designs. Existing inversion techniques have provided accurate model approximations that are often highly effective in feedforward controls. However, when the…

系统与控制 · 计算机科学 2019-11-19 Dan Wang , Xu Chen

Deep continual learning requires models to adapt to new tasks without retraining from scratch. However, neural networks can lose their ability to adapt to new tasks after training on previous ones, a phenomenon known as loss of plasticity.…

机器学习 · 计算机科学 2026-05-12 Jiuqi Wang , Jayanth Srinivasa , Claire Chen , Shuze Daniel Liu , Ali Payani , Shangtong Zhang

Regression discontinuity designs assess causal effects in settings where treatment is determined by whether an observed running variable crosses a pre-specified threshold. Here we propose a new approach to identification, estimation, and…

统计方法学 · 统计学 2025-04-01 Dean Eckles , Nikolaos Ignatiadis , Stefan Wager , Han Wu

The performance of learning models often deteriorates when deployed in out-of-sample environments. To ensure reliable deployment, we propose a stability evaluation criterion based on distributional perturbations. Conceptually, our stability…

机器学习 · 统计学 2024-05-07 Jose Blanchet , Peng Cui , Jiajin Li , Jiashuo Liu

Uncertainty estimation for unlabeled data is crucial to active learning. With a deep neural network employed as the backbone model, the data selection process is highly challenging due to the potential over-confidence of the model…

机器学习 · 计算机科学 2024-02-14 Xingjian Li , Pengkun Yang , Yangcheng Gu , Xueying Zhan , Tianyang Wang , Min Xu , Chengzhong Xu

Robustness of linear systems with constant coefficients is considered. There exist methods and tools for analyzing the stability of systems with random or deterministic uncertainties. At the same time, there are no approaches for the…

最优化与控制 · 数学 2020-12-08 Andrey Tremba

We propose a data-driven control method for systems with aleatoric uncertainty, for example, robot fleets with variations between agents. Our method leverages shared trajectory data to increase the robustness of the designed controller and…

机器人学 · 计算机科学 2024-03-25 Alexander von Rohr , Dmitrii Likhachev , Sebastian Trimpe

In recent years, there has been a growing interest in statistical methods that exhibit robust performance under distribution changes between training and test data. While most of the related research focuses on point predictions with the…

统计方法学 · 统计学 2024-06-18 Alexander Henzi , Xinwei Shen , Michael Law , Peter Bühlmann

Adversarial training augments the training set with perturbations to improve the robust error (over worst-case perturbations), but it often leads to an increase in the standard error (on unperturbed test inputs). Previous explanations for…

机器学习 · 计算机科学 2020-07-08 Aditi Raghunathan , Sang Michael Xie , Fanny Yang , John Duchi , Percy Liang

We study the problem of efficiently scaling ensemble-based deep neural networks for multi-step time series (TS) forecasting on a large set of time series. Current state-of-the-art deep ensemble models have high memory and computational…

机器学习 · 计算机科学 2022-01-31 Philippe Chatigny , Shengrui Wang , Jean-Marc Patenaude , Boris N. Oreshkin

While the traditional viewpoint in machine learning and statistics assumes training and testing samples come from the same population, practice belies this fiction. One strategy -- coming from robust statistics and optimization -- is thus…

机器学习 · 统计学 2024-07-08 Maxime Cauchois , Suyash Gupta , Alnur Ali , John C. Duchi

Learning dynamics from dissipative chaotic systems is notoriously difficult due to their inherent instability, as formalized by their positive Lyapunov exponents, which exponentially amplify errors in the learned dynamics. However, many of…

Efficient skill acquisition, representation, and on-line adaptation to different scenarios has become of fundamental importance for assistive robotic applications. In the past decade, dynamical systems (DS) have arisen as a flexible and…

机器人学 · 计算机科学 2020-03-27 Matteo Saveriano , Dongheui Lee

This paper introduces a novel stabilization control strategy for linear time-invariant systems affected by known time-varying measurement delays and matched unknown nonlinear disturbances, which may encompass actuator faults. It is…

最优化与控制 · 数学 2025-07-30 Hardy Pinto , Tiago Roux Oliveira , Liu Hsu

The reliability of machine learning systems critically assumes that the associations between features and labels remain similar between training and test distributions. However, unmeasured variables, such as confounders, break this…

机器学习 · 计算机科学 2020-08-17 Megha Srivastava , Tatsunori Hashimoto , Percy Liang

We propose a dynamical model for the estimation of Operational Risk in banking institutions. Operational Risk is the risk that a financial loss occurs as the result of failed processes. Examples of operational losses are the ones generated…

风险管理 · 定量金融 2012-02-14 Marco Bardoscia , Roberto Bellotti

Industrial machine learning systems face data challenges that are often under-explored in the academic literature. Common data challenges are data distribution shifts, missing values and anomalies. In this paper, we discuss data challenges…

机器学习 · 计算机科学 2022-03-17 Michael Bohlke-Schneider , Shubham Kapoor , Tim Januschowski

Modulation instability is a phenomenon of spontaneous pattern formation in nonlinear media, oftentimes leading to an unpredictable behaviour and a degradation of a signal of interest. We propose an approach based on reinforcement learning…

斑图形成与孤子 · 物理学 2024-07-24 Nikolay Kalmykov , Rishat Zagidullin , Oleg Rogov , Sergey Rykovanov , Dmitry V. Dylov

Robust controllers ensure stability in feedback loops designed under uncertainty but at the cost of performance. Model uncertainty in time-invariant systems can be reduced by recently proposed learning-based methods, which improve the…

系统与控制 · 电气工程与系统科学 2023-01-18 Alexander von Rohr , Friedrich Solowjow , Sebastian Trimpe

We introduce Dynamic Dropout, a novel regularization technique designed to enhance the training efficiency of Transformer models by dynamically adjusting the dropout rate based on training epochs or validation loss improvements. This…

机器学习 · 计算机科学 2024-11-06 Hanrui Yan , Dan Shao