English
Related papers

Related papers: Fast Adaptation in Generative Models with Generati…

200 papers

Generative networks are opening new avenues in fast event generation for the LHC. We show how generative flow networks can reach percent-level precision for kinematic distributions, how they can be trained jointly with a discriminator, and…

High Energy Physics - Phenomenology · Physics 2023-04-26 Anja Butter , Theo Heimel , Sander Hummerich , Tobias Krebs , Tilman Plehn , Armand Rousselot , Sophia Vent

Adaptable models could greatly benefit robotic agents operating in the real world, allowing them to deal with novel and varying conditions. While approaches such as Bayesian inference are well-studied frameworks for adapting models to…

Machine Learning · Computer Science 2023-10-20 Orr Krupnik , Elisei Shafer , Tom Jurgenson , Aviv Tamar

Generative Flow Networks (GFlowNets) learn to sample diverse candidates in proportion to a reward function, making them well-suited for scientific discovery, where exploring multiple promising solutions is crucial. Further extending…

Machine Learning · Computer Science 2026-05-29 Seokwon Yoon , Youngbin Choi , Seunghyuk Cho , Seungbeom Lee , MoonJeong Park , Dongwoo Kim

The quality of data representation in deep learning methods is directly related to the prior model imposed on the representations; however, generally used fixed priors are not capable of adjusting to the context in the data. To address this…

Machine Learning · Computer Science 2013-03-18 Rakesh Chalasani , Jose C. Principe

Inspired by recent work in meta-learning and generative teaching networks, we propose a framework called Generative Conversational Networks, in which conversational agents learn to generate their own labelled training data (given some seed…

Computation and Language · Computer Science 2021-07-20 Alexandros Papangelis , Karthik Gopalakrishnan , Aishwarya Padmakumar , Seokhwan Kim , Gokhan Tur , Dilek Hakkani-Tur

While generative modeling has achieved remarkable success on tasks like natural language-conditioned image generation, enabling model adaptation from example data points remains a relatively underexplored and challenging problem. To this…

Machine Learning · Computer Science 2026-05-08 Tyler Ingebrand , Ruihan Zhao , Kushagra Gupta , David Fridovich-Keil , Sandeep P. Chinchali , Ufuk Topcu

Generative models have gained more and more attention in recent years for their remarkable success in tasks that required estimating and sampling data distribution to generate high-fidelity synthetic data. In speech, text-to-speech…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-27 Alexander H. Liu , Matt Le , Apoorv Vyas , Bowen Shi , Andros Tjandra , Wei-Ning Hsu

We introduce a new paradigm for generative modeling built on Continuous Normalizing Flows (CNFs), allowing us to train CNFs at unprecedented scale. Specifically, we present the notion of Flow Matching (FM), a simulation-free approach for…

Machine Learning · Computer Science 2023-02-09 Yaron Lipman , Ricky T. Q. Chen , Heli Ben-Hamu , Maximilian Nickel , Matt Le

Multilingual generative models obtain remarkable cross-lingual in-context learning capabilities through pre-training on large-scale corpora. However, they still exhibit a performance bias toward high-resource languages and learn isolated…

Computation and Language · Computer Science 2024-06-13 Chong Li , Shaonan Wang , Jiajun Zhang , Chengqing Zong

This paper introduces a deep learning enabled generative sensing framework which integrates low-end sensors with computational intelligence to attain a high recognition accuracy on par with that attained with high-end sensors. The proposed…

Computer Vision and Pattern Recognition · Computer Science 2018-01-10 Lina Karam , Tejas Borkar , Yu Cao , Junseok Chae

Foundation models contain a wealth of information from their vast number of training samples. However, most prior arts fail to extract this information in a precise and efficient way for small sample sizes. In this work, we propose a…

Machine Learning · Computer Science 2024-04-26 Nico Schiavone , Xingyu Li

Heralded by the initial success in speech recognition and image classification, learning-based approaches with neural networks, commonly referred to as deep learning, have spread across various fields. A primitive form of a neural network…

Robotics · Computer Science 2024-09-02 Takuma Yoneda

Correctly capturing the symmetry transformations of data can lead to efficient models with strong generalization capabilities, though methods incorporating symmetries often require prior knowledge. While recent advancements have been made…

Generative Flow Networks (GFlowNets) are amortized samplers that learn stochastic policies to sequentially generate compositional objects from a given unnormalized reward distribution. They can generate diverse sets of high-reward objects,…

Machine Learning · Computer Science 2023-10-06 Ling Pan , Moksh Jain , Kanika Madan , Yoshua Bengio

Generative models defining joint distributions over parse trees and sentences are useful for parsing and language modeling, but impose restrictions on the scope of features and are often outperformed by discriminative models. We propose a…

Computation and Language · Computer Science 2017-08-18 Jianpeng Cheng , Adam Lopez , Mirella Lapata

As deep learning models and datasets rapidly scale up, network training is extremely time-consuming and resource-costly. Instead of training on the entire dataset, learning with a small synthetic dataset becomes an efficient solution.…

Machine Learning · Computer Science 2022-08-02 Zixuan Jiang , Jiaqi Gu , Mingjie Liu , David Z. Pan

Traffic forecasting is a challenging problem due to complex road networks and sudden speed changes caused by various events on roads. A number of models have been proposed to solve this challenging problem with a focus on learning…

Machine Learning · Computer Science 2022-03-09 Hyunwook Lee , Seungmin Jin , Hyeshin Chu , Hongkyu Lim , Sungahn Ko

Humans have an impressive ability to reason about new concepts and experiences from just a single example. In particular, humans have an ability for one-shot generalization: an ability to encounter a new concept, understand its structure,…

Machine Learning · Statistics 2016-05-26 Danilo Jimenez Rezende , Shakir Mohamed , Ivo Danihelka , Karol Gregor , Daan Wierstra

Generative modeling has recently shown great promise in computer vision, but it has mostly focused on synthesizing visually realistic images. In this paper, motivated by multi-task learning of shareable feature representations, we consider…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Zhipeng Bao , Martial Hebert , Yu-Xiong Wang

Multimodal learning for generative models often refers to the learning of abstract concepts from the commonality of information in multiple modalities, such as vision and language. While it has proven effective for learning generalisable…

Machine Learning · Computer Science 2021-04-22 Yuge Shi , Brooks Paige , Philip H. S. Torr , N. Siddharth