English
Related papers

Related papers: Goal-directed Generation of Discrete Structures wi…

200 papers

In recent years, diffusion models have gained popularity for their ability to generate higher-quality images in comparison to GAN models. However, like any other large generative models, these models require a huge amount of data,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Rajesh Shrestha , Bowen Xie

Reward design is a fundamental problem in reinforcement learning (RL). A misspecified or poorly designed reward can result in low sample efficiency and undesired behaviors. In this paper, we propose the idea of programmatic reward design,…

Machine Learning · Computer Science 2022-01-10 Weichao Zhou , Wenchao Li

A common objective in the analysis of tabular data is estimating the conditional distribution (in contrast to only producing predictions) of a set of "outcome" variables given a set of "covariates", which is sometimes referred to as the…

Machine Learning · Statistics 2024-10-08 Zhuoqun Wang , Naoki Awaya , Li Ma

When optimizing against the mean loss over a distribution of predictions in the context of a regression task, then even if there is a distribution of targets the optimal prediction distribution is always a delta function at a single value.…

Machine Learning · Computer Science 2019-02-11 Nicholas Guttenberg

Imitation learning in a high-dimensional environment is challenging. Most inverse reinforcement learning (IRL) methods fail to outperform the demonstrator in such a high-dimensional environment, e.g., Atari domain. To address this…

Machine Learning · Computer Science 2020-09-14 Xingrui Yu , Yueming Lyu , Ivor W. Tsang

Deep generative models like GAN and VAE have shown impressive results in generating unconstrained objects like images. However, many design settings arising in industrial design, material science, computer graphics and more require that the…

Machine Learning · Computer Science 2024-06-07 Aaron Ferber , Arman Zharmagambetov , Taoan Huang , Bistra Dilkina , Yuandong Tian

Drawing inspiration from the achievements of natural language processing, we adopt self-supervised learning and utilize an equivariant graph neural network to develop a unified platform designed for training generative models capable of…

Materials Science · Physics 2024-08-21 Fangze Liu , Zhantao Chen , Tianyi Liu , Ruyi Song , Yu Lin , Joshua J. Turner , Chunjing Jia

Conditional discrete generative models struggle to faithfully compose multiple input conditions. To address this, we derive a theoretically-grounded formulation for composing discrete probabilistic generative processes, with masked…

Machine Learning · Computer Science 2026-04-08 Jamie Stirling , Noura Al-Moubayed , Chris G. Willcocks , Hubert P. H. Shum

Conditional discrete generative models struggle to faithfully compose multiple input conditions. To address this, we derive a theoretically-grounded formulation for composing discrete probabilistic generative processes, with masked…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Jamie Stirling , Noura Al-Moubayed , Chris G. Willcocks , Hubert P. H. Shum

Real-world applications of computational fluid dynamics often involve the evaluation of quantities of interest for several distinct geometries that define the computational domain or are embedded inside it. For example, design optimization…

Numerical Analysis · Mathematics 2023-08-08 Guglielmo Padula , Francesco Romor , Giovanni Stabile , Gianluigi Rozza

A variety of real-world tasks involve the classification of images into pre-determined categories. Designing image classification algorithms that exhibit robustness to acquisition noise and image distortions, particularly when the available…

Machine Learning · Statistics 2016-03-10 Umamahesh Srinivas

We train deep generative models on datasets of reflexive polytopes. This enables us to compare how well the models have picked up on various global properties of generated samples. Our datasets are complete in the sense that every single…

Machine Learning · Computer Science 2021-05-31 Bernt Ivar Utstøl Nødland

Designing rewards for Reinforcement Learning (RL) is challenging because it needs to convey the desired task, be efficient to optimize, and be easy to compute. The latter is particularly problematic when applying RL to robotics, where…

Machine Learning · Computer Science 2020-05-28 Yiming Ding , Carlos Florensa , Mariano Phielipp , Pieter Abbeel

Designing and generating new data under targeted properties has been attracting various critical applications such as molecule design, image editing and speech synthesis. Traditional hand-crafted approaches heavily rely on expertise…

Machine Learning · Computer Science 2024-03-19 Shiyu Wang , Yuanqi Du , Xiaojie Guo , Bo Pan , Zhaohui Qin , Liang Zhao

Reinforcement learning (RL) often struggles to accomplish a sparse-reward long-horizon task in a complex environment. Goal-conditioned reinforcement learning (GCRL) has been employed to tackle this difficult problem via a curriculum of…

Machine Learning · Computer Science 2023-12-20 Lisheng Wu , Ke Chen

Conventional wisdom suggests that autoregressive models are used to process discrete data. When applied to continuous modalities such as visual data, Visual AutoRegressive modeling (VAR) typically resorts to quantization-based approaches to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Chenze Shao , Fandong Meng , Jie Zhou

Many applications in machine learning can be framed as minimization problems and solved efficiently using gradient-based techniques. However, recent applications of generative models, particularly GANs, have triggered interest in solving…

Machine Learning · Computer Science 2021-03-24 Paulina Grnarova , Yannic Kilcher , Kfir Y. Levy , Aurelien Lucchi , Thomas Hofmann

Deep metric learning aims to learn an embedding space where the distance between data reflects their class equivalence, even when their classes are unseen during training. However, the limited number of classes available in training…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Kyungmoon Lee , Sungyeon Kim , Seunghoon Hong , Suha Kwak

Deep generative models are proficient in generating realistic data but struggle with producing rare samples in low density regions due to their scarcity of training datasets and the mode collapse problem. While recent methods aim to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Subeen Lee , Jiyeon Han , Soyeon Kim , Jaesik Choi

When solving inverse problems in geophysical imaging, deep generative models (DGMs) may be used to enforce the solution to display highly structured spatial patterns which are supported by independent information (e.g. the geological…

Geophysics · Physics 2021-04-28 Jorge Lopez-Alvis , Eric Laloy , Frédéric Nguyen , Thomas Hermans