English
Related papers

Related papers: A Scalable Finite Difference Method for Deep Reinf…

200 papers

The vulnerability of the high-performance machine learning models implies a security risk in applications with real-world consequences. Research on adversarial attacks is beneficial in guiding the development of machine learning models on…

Machine Learning · Computer Science 2022-11-16 Yiran Huang , Yexu Zhou , Michael Hefenbrock , Till Riedel , Likun Fang , Michael Beigl

A distribution inference attack aims to infer statistical properties of data used to train machine learning models. These attacks are sometimes surprisingly potent, but the factors that impact distribution inference risk are not well…

Machine Learning · Computer Science 2024-04-09 Anshuman Suri , Yifu Lu , Yanjin Chen , David Evans

Optimization is an important module of modern machine learning applications. Tremendous efforts have been made to accelerate optimization algorithms. A common formulation is achieving a lower loss at a given time. This enables a…

Machine Learning · Computer Science 2025-05-29 Zhonglin Xie , Yiman Fong , Haoran Yuan , Zaiwen Wen

Reinforcement learning (RL) algorithms involve the deep nesting of highly irregular computation patterns, each of which typically exhibits opportunities for distributed computation. We argue for distributing RL components in a composable…

Artificial Intelligence · Computer Science 2018-07-02 Eric Liang , Richard Liaw , Philipp Moritz , Robert Nishihara , Roy Fox , Ken Goldberg , Joseph E. Gonzalez , Michael I. Jordan , Ion Stoica

This paper presents an evolutionary algorithm with a new goal-sequence domination scheme for better decision support in multi-objective optimization. The approach allows the inclusion of advanced hard/soft priority and constraint…

Artificial Intelligence · Computer Science 2011-06-02 E. F. Khor , T. H. Lee , R. Sathikannan , K. C. Tan

Adaptive inference is a promising technique to improve the computational efficiency of deep models at test time. In contrast to static models which use the same computation graph for all instances, adaptive networks can dynamically adjust…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Hao Li , Hong Zhang , Xiaojuan Qi , Ruigang Yang , Gao Huang

There is a great need for improved statistical sampling in a range of physical, chemical and biological systems. Even simulations based on correct algorithms suffer from statistical error, which can be substantial or even dominant when slow…

Computational Physics · Physics 2007-11-09 F. Marty Ytreberg , Daniel M. Zuckerman

We present an approach for designing swarm-based optimizers for the global optimization of expensive black-box functions. In the proposed approach, the problem of finding efficient optimizers is framed as a reinforcement learning problem,…

Artificial Intelligence · Computer Science 2023-04-12 Eloghosa Ikponmwoba , Ope Owoyele

Current deep learning architectures suffer from catastrophic forgetting, a failure to retain knowledge of previously learned classes when incrementally trained on new classes. The fundamental roadblock faced by deep learning methods is that…

Machine Learning · Computer Science 2020-12-01 Ziyang Wu , Christina Baek , Chong You , Yi Ma

Serverless computing has gained a strong traction in the cloud computing community in recent years. Among the many benefits of this novel computing model, the rapid auto-scaling capability of user applications takes prominence. However, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-23 Anupama Mampage , Shanika Karunasekera , Rajkumar Buyya

Off-policy learning allows us to learn about possible policies of behavior from experience generated by a different behavior policy. Temporal difference (TD) learning algorithms can become unstable when combined with function approximation…

Machine Learning · Computer Science 2021-06-23 Ray Jiang , Tom Zahavy , Zhongwen Xu , Adam White , Matteo Hessel , Charles Blundell , Hado van Hasselt

A recent trend in deep learning algorithms has been towards training large scale models, having high parameter count and trained on big dataset. However, robustness of such large scale models towards real-world settings is still a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Nishant Jain , Harkirat Behl , Yogesh Singh Rawat , Vibhav Vineet

We propose a black-box variational inference method to approximate intractable distributions with an increasingly rich approximating class. Our method, termed variational boosting, iteratively refines an existing variational approximation…

Machine Learning · Statistics 2017-02-21 Andrew C. Miller , Nicholas Foti , Ryan P. Adams

Deep reinforcement learning (RL) algorithms can learn complex policies to optimize agent operation over time. RL algorithms have shown promising results in solving complicated problems in recent years. However, their application on…

Machine Learning · Computer Science 2021-09-29 Hamed Khorasgani , Haiyan Wang , Chetan Gupta , Susumu Serita

Evolutionary Algorithms and Deep Reinforcement Learning have both successfully solved control problems across a variety of domains. Recently, algorithms have been proposed which combine these two methods, aiming to leverage the strengths…

Neural and Evolutionary Computing · Computer Science 2023-06-21 Adam Callaghan , Karl Mason , Patrick Mannion

A cumbersome operation in numerical analysis and linear algebra, optimization, machine learning and engineering algorithms; is inverting large full-rank matrices which appears in various processes and applications. This has both numerical…

Numerical Analysis · Mathematics 2022-06-24 Neophytos Charalambides , Mert Pilanci , Alfred O. Hero

We present a new adaptive algorithm for learning discrete distributions under distribution drift. In this setting, we observe a sequence of independent samples from a discrete distribution that is changing over time, and the goal is to…

Machine Learning · Computer Science 2024-03-11 Alessio Mazzetto

With the breakthrough of AlphaGo, deep reinforcement learning becomes a recognized technique for solving sequential decision-making problems. Despite its reputation, data inefficiency caused by its trial and error learning mechanism makes…

Machine Learning · Computer Science 2024-04-01 Qiyue Yin , Tongtong Yu , Shengqi Shen , Jun Yang , Meijing Zhao , Kaiqi Huang , Bin Liang , Liang Wang

Gradient-based optimization is the foundation of deep learning and reinforcement learning. Even when the mechanism being optimized is unknown or not differentiable, optimization using high-variance or biased gradient estimates is still…

Machine Learning · Computer Science 2018-02-27 Will Grathwohl , Dami Choi , Yuhuai Wu , Geoffrey Roeder , David Duvenaud

Reinforcement learning algorithms are typically limited to learning a single solution for a specified task, even though diverse solutions often exist. Recent studies showed that learning a set of diverse solutions is beneficial because…

Machine Learning · Statistics 2022-04-14 Takayuki Osa , Voot Tangkaratt , Masashi Sugiyama