English
Related papers

Related papers: Mamba-Diffusion Model with Learnable Wavelet for C…

200 papers

Traditional molecule generation methods often rely on sequence- or graph-based representations, which can limit their expressive power or require complex permutation-equivariant architectures. This paper introduces a novel paradigm for…

Machine Learning · Computer Science 2025-02-18 Van Khoa Nguyen , Maciej Falkiewicz , Giangiacomo Mercatali , Alexandros Kalousis

Cross-modal alignment is crucial for multimodal representation fusion due to the inherent heterogeneity between modalities. While Transformer-based methods have shown promising results in modeling inter-modal relationships, their quadratic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yan Li , Yifei Xing , Xiangyuan Lan , Xin Li , Haifeng Chen , Dongmei Jiang

While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which addresses both families of tasks simultaneously. We…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Soumik Mukhopadhyay , Matthew Gwilliam , Yosuke Yamaguchi , Vatsal Agarwal , Namitha Padmanabhan , Archana Swaminathan , Tianyi Zhou , Jun Ohya , Abhinav Shrivastava

Diffusion models have made significant advances in text-guided synthesis tasks. However, editing user-provided images remains challenging, as the high dimensional noise input space of diffusion models is not naturally suited for image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Jiteng Mu , Michaël Gharbi , Richard Zhang , Eli Shechtman , Nuno Vasconcelos , Xiaolong Wang , Taesung Park

Recent advances in diffusion models have significantly improved the synthesis of materials, textures, and 3D shapes. By conditioning these models via text or images, users can guide the generation, reducing the time required to create…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Marzia Riso , Giuseppe Vecchio , Fabio Pellacini

Deep generative models produce data according to a learned representation, e.g. diffusion models, through a process of approximation computing possible samples. Approximation can be understood as reconstruction and the large datasets used…

Human-Computer Interaction · Computer Science 2023-09-25 Luís Arandas , Mick Grierson , Miguel Carvalhais

Foundation models learn transferable representations, motivating growing interest in their application to wireless systems. Existing wireless foundation models are predominantly based on transformer architectures, whose quadratic…

Signal Processing · Electrical Eng. & Systems 2026-03-30 Tomer Raviv , Nir Shlezinger

Perceptual image compression focuses on preserving high visual quality under low-bitrate constraints. Most existing approaches to perceptual compression leverage the strong generative capabilities of generative adversarial networks or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jiaqian Zhang , Hao Wei , Chenyang Ge , Yanhui Zhou

In this work, we take the first exploration of the recently popular foundation model, i.e., State Space Model/Mamba, in image quality assessment (IQA), aiming at observing and excavating the perception potential in vision Mamba. A series of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Fengbin Guan , Xin Li , Zihao Yu , Yiting Lu , Zhibo Chen

Diffusion models have demonstrated impressive capabilities in synthesizing diverse content. However, despite their high-quality outputs, these models often perpetuate social biases, including those related to gender and race. These biases…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yingdong Shi , Changming Li , Yifan Wang , Yongxiang Zhao , Anqi Pang , Sibei Yang , Jingyi Yu , Kan Ren

In recent years, deep learning has significantly advanced the MIDI domain, solidifying music generation as a key application of artificial intelligence. However, existing research primarily focuses on Western music and encounters challenges…

Sound · Computer Science 2025-03-07 Jiatao Chen , Tianming Xie , Xing Tang , Jing Wang , Wenjing Dong , Bing Shi

Generative modeling of non-negative, discrete data, such as symbolic music, remains challenging due to two persistent limitations in existing methods. Firstly, many approaches rely on modeling continuous embeddings, which is suboptimal for…

Machine Learning · Computer Science 2026-02-12 Sagnik Bhattacharya , Abhiram Gorle , Ahsan Bilal , Connor Ding , Amit Kumar Singh Yadav , Tsachy Weissman

Despite the significant progress in controllable music generation and editing, challenges remain in the quality and length of generated music due to the use of Mel-spectrogram representations and UNet-based model structures. To address…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-17 Siyuan Hou , Shansong Liu , Ruibin Yuan , Wei Xue , Ying Shan , Mangsuo Zhao , Chao Zhang

In this work, we introduce the demonstration of symbolic music generation, focusing on providing short musical motifs that serve as the central theme of the narrative. For the generation, we adopt an autoregressive model which takes musical…

Accurate traffic prediction plays a vital role in intelligent transportation systems by enabling efficient routing, congestion mitigation, and proactive traffic control. However, forecasting is challenging due to the combined effects of…

Machine Learning · Computer Science 2025-07-08 Mohamed Hamad , Mohamed Mabrok , Nizar Zorba

In this paper, we propose a diffusion probabilistic model for handwriting generation. Diffusion models are a class of generative models where samples start from Gaussian noise and are gradually denoised to produce output. Our method of…

Machine Learning · Computer Science 2020-11-16 Troy Luhman , Eric Luhman

Denoising diffusion models, a class of generative models, have garnered immense interest lately in various deep-learning problems. A diffusion probabilistic model defines a forward diffusion stage where the input data is gradually perturbed…

Image and Video Processing · Electrical Eng. & Systems 2023-06-06 Amirhossein Kazerouni , Ehsan Khodapanah Aghdam , Moein Heidari , Reza Azad , Mohsen Fayyaz , Ilker Hacihaliloglu , Dorit Merhof

Learning musical structures and composition patterns is necessary for both music generation and understanding, but current methods do not make uniform use of learned features to generate and comprehend music simultaneously. In this paper,…

Sound · Computer Science 2024-12-10 Xiao Liang , Zijian Zhao , Weichao Zeng , Yutong He , Fupeng He , Yiyi Wang , Chengying Gao

While modern diffusion models excel at generating high-quality and diverse images, they still struggle with high-fidelity compositional and multimodal control, particularly when users simultaneously specify text prompts, subject references,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yusuf Dalva , Guocheng Gordon Qian , Maya Goldenberg , Tsai-Shien Chen , Kfir Aberman , Sergey Tulyakov , Pinar Yanardag , Kuan-Chieh Jackson Wang

Modern successes of diffusion models in learning complex, high-dimensional data distributions are attributed, in part, to their capability to construct diffusion processes with analytic transition kernels and score functions. The…

Machine Learning · Statistics 2024-03-01 Guan-Horng Liu , Tianrong Chen , Evangelos A. Theodorou , Molei Tao