English
Related papers

Related papers: SERNF: Sample-Efficient Real-World Dexterous Polic…

200 papers

Existing federated learning models that follow the standard risk minimization paradigm of machine learning often fail to generalize in the presence of spurious correlations in the training data. In many real-world distributed settings,…

Machine Learning · Computer Science 2023-05-31 Praveen Venkateswaran , Vatche Isahagian , Vinod Muthusamy , Nalini Venkatasubramanian

Spatial understanding is a critical aspect of most robotic tasks, particularly when generalization is important. Despite the impressive results of deep generative models in complex manipulation tasks, the absence of a representation that…

Robotics · Computer Science 2024-09-10 Niklas Funk , Julen Urain , Joao Carvalho , Vignesh Prasad , Georgia Chalvatzaki , Jan Peters

In many real-world settings, agents must learn from an offline dataset gathered by some prior behavior policy. Such a setting naturally leads to distribution shift between the behavior policy and the target policy being trained - requiring…

Machine Learning · Computer Science 2024-04-10 Matthew Thomas Jackson , Michael Tryfan Matthews , Cong Lu , Benjamin Ellis , Shimon Whiteson , Jakob Foerster

Sampling-based motion planning is the predominant paradigm in many real-world robotic applications, but its performance is immensely dependent on the quality of the samples. The majority of traditional planners are inefficient as they use…

Robotics · Computer Science 2020-10-23 Tin Lai , Fabio Ramos

As Diffusion Models have shown promising performance, a lot of efforts have been made to improve the controllability of Diffusion Models. However, how to train Diffusion Models to have the disentangled latent spaces and how to naturally…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Wonwoong Cho , Hareesh Ravi , Midhun Harikumar , Vinh Khuc , Krishna Kumar Singh , Jingwan Lu , David I. Inouye , Ajinkya Kale

Fine-tuning diffusion policies with reinforcement learning (RL) presents significant challenges. The long denoising sequence for each action prediction impedes effective reward propagation. Moreover, standard RL methods require millions of…

Variational inference with normalizing flows (NFs) is an increasingly popular alternative to MCMC methods. In particular, NFs based on coupling layers (Real NVPs) are frequently used due to their good empirical performance. In theory,…

Machine Learning · Statistics 2024-02-27 Daniel Andrade

A key problem in reinforcement learning for control with general function approximators (such as deep neural networks and other nonlinear functions) is that, for many algorithms employed in practice, updates to the policy or $Q$-function…

Machine Learning · Computer Science 2016-03-01 Joshua Achiam

An adaptive sampling approach for efficient detection of bifurcation boundaries in parametrized fluid flow problems is presented herein. The study extends the machine-learning approach of Silvester~(J. Comput. Phys., 553 (2026), 114743),…

Fluid Dynamics · Physics 2026-02-19 Anshima Singh , David J. Silvester

Normalizing Flows (NFs) describe a class of models that express a complex target distribution as the composition of a series of bijective transformations over a simpler base distribution. By limiting the space of candidate transformations…

Machine Learning · Computer Science 2023-09-11 Keegan Kelly , Lorena Piedras , Sukrit Rao , David Roth

We propose a new sample-efficient methodology, called Supervised Policy Update (SPU), for deep reinforcement learning. Starting with data generated by the current policy, SPU formulates and solves a constrained optimization problem in the…

Machine Learning · Computer Science 2018-12-27 Quan Vuong , Yiming Zhang , Keith W. Ross

Recent interactive segmentation methods iteratively take source image, user guidance and previously predicted mask as the input without considering the invariant nature of the source image. As a result, extracting features from the source…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Huimin Zeng , Weinong Wang , Xin Tao , Zhiwei Xiong , Yu-Wing Tai , Wenjie Pei

Dexterity is often seen as a cornerstone of complex manipulation. Humans are able to perform a host of skills with their hands, from making food to operating tools. In this paper, we investigate these challenges, especially in the case of…

Robotics · Computer Science 2023-12-13 Aditya Kannan , Kenneth Shaw , Shikhar Bahl , Pragna Mannam , Deepak Pathak

Learning from observations (LfO) replicates expert behavior without needing access to the expert's actions, making it more practical than learning from demonstrations (LfD) in many real-world scenarios. However, directly applying the…

Machine Learning · Statistics 2025-10-22 Yirui Zhou , Yunfei Jin , Xiaowei Liu , Xiaofeng Zhang , Yangchun Zhang

Neural Radiance Fields (NeRF) have achieved photorealistic novel view synthesis but suffer from computational inefficiency due to dense ray sampling during volume rendering. We propose SAC-NeRF, a reinforcement learning framework that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Chenyu Ge

Methods based on Deep Learning have recently been applied on astrophysical parameter recovery thanks to their ability to capture information from complex data. One of these methods is the approximate Bayesian Neural Networks (BNNs) which…

Instrumentation and Methods for Astrophysics · Physics 2023-06-21 Héctor J. Hortúa , Luz Ángela García , Leonardo Castañeda C

Medical vision foundation models remain limited in downstream tasks, particularly volumetric medical image segmentation. While fine-tuning on labeled target-domain data improves performance, existing approaches typically rely on randomly…

Image and Video Processing · Electrical Eng. & Systems 2026-05-07 Jin Yang , Daniel S. Marcus , Aristeidis Sotiras

We explore a generative machine learning-based approach for estimating multi-dimensional probability density functions (PDFs) in a target sample using a statistically independent but related control sample - a common challenge in particle…

Data Analysis, Statistics and Probability · Physics 2025-04-18 Eli Gendreau-Distler , Luc Le Pottier , Haichen Wang

Convolutional Neural Networks are the de facto models for image recognition. However 3D CNNs, the straight forward extension of 2D CNNs for video recognition, have not achieved the same success on standard action recognition benchmarks. One…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Swathikiran Sudhakaran , Sergio Escalera , Oswald Lanz

Two fundamental problems in unsupervised learning are efficient inference for latent-variable models and robust density estimation based on large amounts of unlabeled data. Algorithms for the two tasks, such as normalizing flows and…

Machine Learning · Statistics 2018-08-02 Changyou Chen , Chunyuan Li , Liqun Chen , Wenlin Wang , Yunchen Pu , Lawrence Carin