English
Related papers

Related papers: Enabling user-driven Checkpointing strategies in R…

200 papers

In this paper, we study a sequential decision-making problem, called Adaptive Sampling for Discovery (ASD). Starting with a large unlabeled dataset, algorithms for ASD adaptively label the points with the goal to maximize the sum of…

Machine Learning · Statistics 2023-01-04 Ziping Xu , Eunjae Shim , Ambuj Tewari , Paul Zimmerman

While fine-tuning is a de facto standard method for training deep neural networks, it still suffers from overfitting when using small target datasets. Previous methods improve fine-tuning performance by maintaining knowledge of the source…

Machine Learning · Computer Science 2024-03-18 Shin'ya Yamaguchi , Sekitoshi Kanai , Kazuki Adachi , Daiki Chijiwa

Many modern computer vision and machine learning applications rely on solving difficult optimization problems that involve non-differentiable objective functions and constraints. The alternating direction method of multipliers (ADMM) is a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Zheng Xu , Mario A. T. Figueiredo , Xiaoming Yuan , Christoph Studer , Tom Goldstein

Constrained reinforcement learning has achieved promising progress in safety-critical fields where both rewards and constraints are considered. However, constrained reinforcement learning methods face challenges in striking the right…

Machine Learning · Computer Science 2024-10-29 Jianmina Ma , Jingtian Ji , Yue Gao

The review-based recommender systems are commonly utilized to measure users preferences towards different items. In this paper, we focus on addressing three main problems existing in the review-based methods. Firstly, these methods suffer…

Information Retrieval · Computer Science 2020-12-14 Yuexin Wu , Tianyu Gao , Sihao Wang , Zhongmin Xiong

This article aims to demonstrate and discuss the applications of automatic differentiation (AD) for finding derivatives in PDE-constrained optimization problems and Jacobians in non-linear finite element analysis. The main idea is to…

Numerical Analysis · Mathematics 2025-06-03 Julian Andrej , Tzanio Kolev , Boyan Lazarov

Machine unlearning, enabling a trained model to forget specific data, is crucial for addressing erroneous data and adhering to privacy regulations like the General Data Protection Regulation (GDPR)'s "right to be forgotten". Despite recent…

Machine Learning · Computer Science 2026-04-10 Zihao Zhao , Yuchen Yang , Anjalie Field , Yinzhi Cao

We show that Automatic Differentiation (AD) operators can be provided in a dynamic language without sacrificing numeric performance. To achieve this, general forward and reverse AD functions are added to a simple high-level dynamic…

Programming Languages · Computer Science 2016-11-11 Jeffrey Mark Siskind , Barak A. Pearlmutter

Autonomous vehicle (AV) systems rely on robust perception models as a cornerstone of safety assurance. However, objects encountered on the road exhibit a long-tailed distribution, with rare or unseen categories posing challenges to a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Mingfu Liang , Jong-Chyi Su , Samuel Schulter , Sparsh Garg , Shiyu Zhao , Ying Wu , Manmohan Chandraker

Meta-optics promises compact, high-performance imaging and color routing. However, designing high-performance structures is a high-dimensional optimization problem: mapping a desired optical output back to a physical 3D structure requires…

Machine Learning · Computer Science 2026-04-21 Chanik Kang , Hyewon Suk , Haejun Chung

The removal of carefully-selected examples from training data has recently emerged as an effective way of improving the robustness of machine learning models. However, the best way to select these examples remains an open question. In this…

Machine Learning · Computer Science 2024-09-19 Andrea Napoli , Paul White

With the growing use of machine learning algorithms and ubiquitous sensors, many `perception-to-control' systems are being developed and deployed. To ensure their trustworthiness, improving their robustness through adversarial training is…

Machine Learning · Computer Science 2024-11-05 Michael Villarreal , Bibek Poudel , Ryan Wickman , Yu Shen , Weizi Li

Temporal difference (TD) learning is a fundamental algorithm for estimating value functions in reinforcement learning. Recent finite-time analyses of TD with linear function approximation quantify its theoretical convergence rate. However,…

Machine Learning · Computer Science 2026-03-04 Yunxiang Li , Mark Schmidt , Reza Babanezhad , Sharan Vaswani

Test-time adaptation is a special setting of unsupervised domain adaptation where a trained model on the source domain has to adapt to the target domain without accessing source data. We propose a novel way to leverage self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Dian Chen , Dequan Wang , Trevor Darrell , Sayna Ebrahimi

This paper outlines the development and testing of a novel, feedback-enabled attention allocation aid (AAAD), which uses real-time physiological data to improve human performance in a realistic sequential visual search task. Indeed, by…

Human-Computer Interaction · Computer Science 2017-01-17 Arturo Deza , Jeffrey R. Peters , Grant S. Taylor , Amit Surana , Miguel P. Eckstein

We develop an Accelerated Back Pressure (ABP) algorithm using Accelerated Dual Descent (ADD), a distributed approximate Newton-like algorithm that only uses local information. Our construction is based on writing the backpressure algorithm…

Optimization and Control · Mathematics 2013-02-07 Michael Zargham , Alejandro Ribeiro , Ali Jadbabaie

Federated adversarial training can effectively complement adversarial robustness into the privacy-preserving federated learning systems. However, the high demand for memory capacity and computing power makes large-scale federated…

Machine Learning · Computer Science 2023-04-27 Minxue Tang , Jianyi Zhang , Mingyuan Ma , Louis DiValentin , Aolin Ding , Amin Hassanzadeh , Hai Li , Yiran Chen

Technology mapping involves mapping logical circuits to a library of cells. Traditionally, the full technology library is used, leading to a large search space and potential overhead. Motivated by randomly sampled technology mapping case…

Hardware Architecture · Computer Science 2024-07-26 Mingju Liu , Daniel Robinson , Yingjie Li , Cunxi Yu

Determining physical properties inside an object without access to direct measurements of target regions can be formulated as a specific type of \textit{inverse problem}. One of such problems is applied in \textit{Electrical Impedance…

Numerical Analysis · Mathematics 2023-01-30 Ivan Pombo , Luis Sarmento

We demonstrate that automatic differentiation (AD), which has become commonly available in machine learning frameworks, is an efficient way to explore ideas that lead to algorithmic improvement in multi-scale affine image registration and…

Optimization and Control · Mathematics 2025-08-05 Warin Watson , Cash Cherry , Rachelle Lang