English
Related papers

Related papers: Beyond Augmented-Action Surrogates for Multi-Exper…

200 papers

Practical Imitation Learning (IL) systems rely on large human demonstration datasets for successful policy learning. However, challenges lie in maintaining the quality of collected data and addressing the suboptimal nature of some…

Robotics · Computer Science 2025-05-07 Sachit Kuhar , Shuo Cheng , Shivang Chopra , Matthew Bronars , Danfei Xu

Recently, a number of competitive methods have tackled unsupervised representation learning by maximising the mutual information between the representations produced from augmentations. The resulting representations are then invariant to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Luke Nicholas Darlow , Amos Storkey

Deep neural networks are widely used prediction algorithms whose performance often improves as the number of weights increases, leading to over-parametrization. We consider a two-layered neural network whose first layer is frozen while the…

Machine Learning · Computer Science 2023-04-10 Roman Worschech , Bernd Rosenow

Public dataset limitations have significantly hindered the development and benchmarking of learning to defer (L2D) algorithms, which aim to optimally combine human and AI capabilities in hybrid decision-making systems. In such systems,…

End-to-end learning has become a popular method for joint transmitter and receiver optimization in optical communication systems. Such approach may require a differentiable channel model, thus hindering the optimization of links based on…

Signal Processing · Electrical Eng. & Systems 2024-05-21 Sergio Hernandez , Ognjen Jovanovic , Christophe Peucheret , Francesco Da Ros , Darko Zibar

In offline Imitation Learning (IL), one of the main challenges is the \textit{covariate shift} between the expert observations and the actual distribution encountered by the agent, because it is difficult to determine what action an agent…

Machine Learning · Computer Science 2024-06-19 Jie-Jing Shao , Hao-Sen Shi , Lan-Zhe Guo , Yu-Feng Li

The vast majority of successful deep neural networks are trained using variants of stochastic gradient descent (SGD) algorithms. Recent attempts to improve SGD can be broadly categorized into two approaches: (1) adaptive learning rate…

Machine Learning · Computer Science 2019-12-04 Michael R. Zhang , James Lucas , Geoffrey Hinton , Jimmy Ba

Two novel deep hybrid architectures, the Deep Hybrid Boltzmann Machine and the Deep Hybrid Denoising Auto-encoder, are proposed for handling semi-supervised learning problems. The models combine experts that model relevant distributions at…

Machine Learning · Computer Science 2016-01-19 Alexander G. Ororbia , C. Lee Giles , David Reitter

Data augmentations are important in training high-performance 3D object detectors for point clouds. Despite recent efforts on designing new data augmentations, perhaps surprisingly, most state-of-the-art 3D detectors only use a few simple…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Zhaoqi Leng , Guowang Li , Chenxi Liu , Ekin Dogus Cubuk , Pei Sun , Tong He , Dragomir Anguelov , Mingxing Tan

In contrast to training traditional machine learning (ML) models in data centers, federated learning (FL) trains ML models over local datasets contained on resource-constrained heterogeneous edge devices. Existing FL algorithms aim to learn…

Machine Learning · Computer Science 2022-09-13 El Houcine Bergou , Konstantin Burlachenko , Aritra Dutta , Peter Richtárik

Most stochastic gradient descent algorithms can optimize neural networks that are sub-differentiable in their parameters; however, this implies that the neural network's activation function must exhibit a degree of continuity which limits…

Neural and Evolutionary Computing · Computer Science 2021-12-16 Anastasis Kratsios , Behnoosh Zamanlooy

We consider model-based reinforcement learning (MBRL) in 2-agent, high-fidelity continuous control problems -- an important domain for robots interacting with other agents in the same workspace. For non-trivial dynamical systems, MBRL…

Machine Learning · Computer Science 2019-11-04 Orr Krupnik , Igor Mordatch , Aviv Tamar

Contrastive learning enables learning useful audio and speech representations without ground-truth labels by maximizing the similarity between latent representations of similar signal segments. In this framework various data augmentation…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-11 Salah Zaiem , Titouan Parcollet , Slim Essid

We develop a learning-based algorithm for the distributed formation control of networked multi-agent systems governed by unknown, nonlinear dynamics. Most existing algorithms either assume certain parametric forms for the unknown dynamic…

Systems and Control · Electrical Eng. & Systems 2022-07-19 Christos K. Verginis , Zhe Xu , Ufuk Topcu

Federated learning has attracted considerable interest for collaborative machine learning in healthcare to leverage separate institutional datasets while maintaining patient privacy. However, additional challenges such as poor calibration…

Machine Learning · Computer Science 2022-01-19 Charles Lu , Jayasheree Kalpathy-Cramer

Applications abound in which optimization problems must be repeatedly solved, each time with new (but similar) data. Analytic optimization algorithms can be hand-designed to provably solve these problems in an iterative fashion. On one…

Optimization and Control · Mathematics 2022-09-28 Howard Heaton , Xiaohan Chen , Zhangyang Wang , Wotao Yin

With the growing demand for safeguarding sensitive user information in recommender systems, recommendation attribute unlearning is receiving increasing attention. Existing studies predominantly focus on single-attribute unlearning. However,…

Machine Learning · Computer Science 2025-10-24 Fengyuan Yu , Yuyuan Li , Xiaohua Feng , Junjie Fang , Tao Wang , Chaochao Chen

Federated Learning (FL) offers a paradigm for privacy-preserving collaborative AI, but its decentralized nature creates significant vulnerabilities to model poisoning attacks. While numerous static defenses exist, their effectiveness is…

Machine Learning · Computer Science 2025-07-30 Md Rafid Haque , Abu Raihan Mostofa Kamal , Md. Azam Hossain

We propose a multi-step training method for designing generalized linear classifiers. First, an initial multi-class linear classifier is found through regression. Then validation error is minimized by pruning of unnecessary inputs.…

Machine Learning · Computer Science 2023-12-15 Kanishka Tyagi , Chinmay Rane , Michael Manry

In this paper, further extensions of the result of the paper "A successive approximation method in functional spaces for hierarchical optimal control problems and its application to learning, arXiv:2410.20617 [math.OC], 2024" concerning a…

Optimization and Control · Mathematics 2024-11-26 Getachew K. Befekadu