English
Related papers

Related papers: Multi-Modal and Multi-Attribute Generation of Sing…

200 papers

Granular flows govern many natural and industrial processes, yet their interior kinematics and mechanics remain largely unobservable, as experiments access only boundaries or free surfaces. Conventional numerical simulations are…

Computational Engineering, Finance, and Science · Computer Science 2026-05-26 Xuyang Li , Rui Li , Teng Man , Yimin Lu

Generative modeling of time series is a central challenge in time series analysis, particularly under data-scarce conditions. Despite recent advances in generative modeling, a comprehensive understanding of how state-of-the-art generative…

Machine Learning · Computer Science 2025-05-28 Tal Gonen , Itai Pemper , Ilan Naiman , Nimrod Berman , Omri Azencot

Generating molecular graphs is crucial in drug design and discovery but remains challenging due to the complex interdependencies between nodes and edges. While diffusion models have demonstrated their potentiality in molecular graph design,…

Machine Learning · Computer Science 2024-11-11 Xiaoyang Hou , Tian Zhu , Milong Ren , Dongbo Bu , Xin Gao , Chunming Zhang , Shiwei Sun

Developing generative models to create or conditionally create symbolic music presents unique challenges due to the combination of limited data availability and the need for high precision in note pitch. To address these challenges, we…

Sound · Computer Science 2025-06-09 Tingyu Zhu , Haoyu Liu , Ziyu Wang , Zhimin Jiang , Zeyu Zheng

Most existing cross-modal generative methods based on diffusion models use guidance to provide control over the latent space to enable conditional generation across different modalities. Such methods focus on providing guidance through…

Machine Learning · Computer Science 2023-05-31 Zizhao Hu , Mohammad Rostami

Motivation: Innovative microfluidic systems carry the promise to greatly facilitate spatio-temporal analysis of single cells under well-defined environmental conditions, allowing novel insights into population heterogeneity and opening new…

Machine Learning · Computer Science 2021-05-18 Dominik Stallmann , Jan P. Göpfert , Julian Schmitz , Alexander Grünberger , Barbara Hammer

Multimodal single-cell technologies enable the simultaneous collection of diverse data types from individual cells, enhancing our understanding of cellular states. However, the integration of these datatypes and modeling the…

Machine Learning · Computer Science 2023-11-22 Bhavya Mehta , Nirmit Deliwala , Madhav Chandane

Unconditional generation -- the problem of modeling data distribution without relying on human-annotated labels -- is a long-standing and fundamental challenge in generative models, creating a potential of learning from large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Tianhong Li , Dina Katabi , Kaiming He

Deep generative models, such as diffusion models, have shown promising progress in image generation and audio generation via simplified continuity assumptions. However, the development of generative modeling techniques for generating…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Wenhao Zheng , Chenwei Sun , Wenbo Zhang , Jiancheng Lv , Xianggen Liu

In the medical field, the limited availability of large-scale datasets and labor-intensive annotation processes hinder the performance of deep models. Diffusion-based generative augmentation approaches present a promising solution to this…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Xinrui Zhou , Yuhao Huang , Haoran Dou , Shijing Chen , Ao Chang , Jia Liu , Weiran Long , Jian Zheng , Erjiao Xu , Jie Ren , Alejandro F. Frangi , Ruobing Huang , Jun Cheng , Xiaomeng Li , Wufeng Xue , Dong Ni

Text-to-song generation, the task of creating vocals and accompaniment from textual inputs, poses significant challenges due to domain complexity and data scarcity. Existing approaches often employ multi-stage generation procedures, leading…

The availability of large datasets is crucial for the development of new power system applications and tools; unfortunately, very few are publicly and freely available. We designed an end-to-end generative framework for the creation of…

Systems and Control · Electrical Eng. & Systems 2022-07-26 Andrea Pinceti , Lalitha Sankar , Oliver Kosut

Flow based generative models have charted an impressive path across multiple visual generation tasks by adhering to a simple principle: learning velocity representations of a linear interpolant. However, we observe that training velocity…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Inkyu Shin , Chenglin Yang , Liang-Chieh Chen

We propose a principled and effective framework for one-step generative modeling. We introduce the notion of average velocity to characterize flow fields, in contrast to instantaneous velocity modeled by Flow Matching methods. A…

Machine Learning · Computer Science 2025-05-20 Zhengyang Geng , Mingyang Deng , Xingjian Bai , J. Zico Kolter , Kaiming He

Conditional flow matching (CFM) stands out as an efficient, simulation-free approach for training flow-based generative models, achieving remarkable performance for data generation. However, CFM is insufficient to ensure accuracy in…

Machine Learning · Computer Science 2026-02-03 Yuhao Huang , Taos Transue , Shih-Hsin Wang , William Feldman , Hong Zhang , Bao Wang

The ability of Flow Matching (FM) to model complex conditional distributions has established it as the state-of-the-art for prediction tasks (e.g., robotics, weather forecasting). However, deployment in safety-critical settings is hindered…

Machine Learning · Computer Science 2026-02-16 Constantinos Tsakonas , Serena Ivaldi , Jean-Baptiste Mouret

Molecular generation and molecular property prediction are both crucial for drug discovery, but they are often developed independently. Inspired by recent studies, which demonstrate that diffusion model, a prominent generative approach, can…

Machine Learning · Computer Science 2025-04-07 Shikun Feng , Yuyan Ni , Yan Lu , Zhi-Ming Ma , Wei-Ying Ma , Yanyan Lan

Accurate prediction with multimodal data-encompassing tabular, textual, and visual inputs or outputs-is fundamental to advancing analytics in diverse application domains. Traditional approaches often struggle to integrate heterogeneous data…

Machine Learning · Statistics 2025-03-11 Xinyu Tian , Xiaotong Shen

Single-cell gene expression measurements encode variability spanning molecular noise, cell-to-cell heterogeneity, and technical artifacts. Mechanistic stochastic models provide powerful approaches to disentangle these sources, yet inferring…

Quantitative Methods · Quantitative Biology 2025-09-19 Christopher E. Miles

A common objective in the analysis of tabular data is estimating the conditional distribution (in contrast to only producing predictions) of a set of "outcome" variables given a set of "covariates", which is sometimes referred to as the…

Machine Learning · Statistics 2024-10-08 Zhuoqun Wang , Naoki Awaya , Li Ma