English
Related papers

Related papers: Optimally Bridging Semantics and Data: Generative …

200 papers

Joint source-channel coding (JSCC) is a promising paradigm for next-generation communication systems, particularly in challenging transmission environments. In this paper, we propose a novel standard-compatible JSCC framework for the…

Information Theory · Computer Science 2025-01-07 Xue Han , Yongpeng Wu , Zhen Gao , Biqian Feng , Yuxuan Shi , Deniz Gündüz , Wenjun Zhang

Predicting the intermediate trajectories between an initial and target distribution is a central problem in generative modeling. Existing approaches, such as flow matching and Schr\"odinger bridge matching, effectively learn mappings…

Machine Learning · Computer Science 2026-03-03 Sophia Tang , Yinuo Zhang , Alexander Tong , Pranam Chatterjee

Multi-node communication, which refers to the interaction among multiple devices, has attracted lots of attention in many Internet-of-Things (IoT) scenarios. However, its huge amounts of data flows and inflexibility for task extension have…

Machine Learning · Computer Science 2023-08-09 Bingyan Xie , Yongpeng Wu , Yuxuan Shi , Derrick Wing Kwan Ng , Wenjun Zhang

Diffusion models break down the challenging task of generating data from high-dimensional distributions into a series of easier denoising steps. Inspired by this paradigm, we propose a novel approach that extends the diffusion framework…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Eslam Abdelrahman , Liangbing Zhao , Vincent Tao Hu , Matthieu Cord , Patrick Perez , Mohamed Elhoseiny

Recent advancements in optimization-based text-to-3D generation heavily rely on distilling knowledge from pre-trained text-to-image diffusion models using techniques like Score Distillation Sampling (SDS), which often introduce artifacts…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ziying Li , Xuequan Lu , Xinkui Zhao , Guanjie Cheng , Shuiguang Deng , Jianwei Yin

Speech enhancement (SE) utilizing diffusion models is a promising technology that improves speech quality in noisy speech data. Furthermore, the Schr\"odinger bridge (SB) has recently been used in diffusion-based SE to improve speech…

Generating samples from a probability distribution is a fundamental task in machine learning and statistics. This article proposes a novel scheme for sampling from a distribution for which the probability density $\mu({\bf x})$ for ${\bf…

Computation · Statistics 2024-05-22 Hanwen Huang

Diffusion-based models have demonstrated remarkable effectiveness in image restoration tasks; however, their iterative denoising process, which starts from Gaussian noise, often leads to slow inference speeds. The Image-to-Image…

Image and Video Processing · Electrical Eng. & Systems 2025-03-25 Yuang Wang , Siyeop Yoon , Pengfei Jin , Matthew Tivnan , Sifan Song , Zhennong Chen , Rui Hu , Li Zhang , Quanzheng Li , Zhiqiang Chen , Dufan Wu

Generative speech enhancement has recently shown promising advancements in improving speech quality in noisy environments. Multiple diffusion-based frameworks exist, each employing distinct training objectives and learning techniques. This…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Julius Richter , Danilo de Oliveira , Timo Gerkmann

Compared to the existing function-based models in deep generative modeling, the recently proposed diffusion models have achieved outstanding performance with a stochastic-process-based approach. But a long sampling time is required for this…

Machine Learning · Computer Science 2022-08-16 Ki-Ung Song

The dynamic Schr\"odinger bridge problem seeks a stochastic process that defines a transport between two target probability measures, while optimally satisfying the criteria of being closest, in terms of Kullback-Leibler divergence, to a…

Machine Learning · Statistics 2023-12-25 Stefano Peluchetti

The static optimal transport $(\mathrm{OT})$ problem between Gaussians seeks to recover an optimal map, or more generally a coupling, to morph a Gaussian into another. It has been well studied and applied to a wide variety of tasks. Here we…

Machine Learning · Computer Science 2023-04-03 Charlotte Bunne , Ya-Ping Hsieh , Marco Cuturi , Andreas Krause

Mobile Artificial Intelligence-Generated Content (AIGC) networks enable massive users to obtain customized content generation services. However, users still need to download a large number of AIGC outputs from mobile AIGC service providers,…

Networking and Internet Architecture · Computer Science 2024-09-27 Jian Liu , Ming Xiao , Jinbo Wen , Jiawen Kang , Ruichen Zhang , Tao Zhang , Dusit Niyato , Weiting Zhang , Ying Liu

The momentum Schr\"odinger Bridge (mSB) has emerged as a leading method for accelerating generative diffusion processes and reducing transport costs. However, the lack of simulation-free properties inevitably results in high training costs…

Machine Learning · Statistics 2025-01-29 Kevin Rojas , Yixin Tan , Molei Tao , Yuriy Nevmyvaka , Wei Deng

Advancements in text-to-image generative AI with large multimodal models are spreading into the field of image compression, creating high-quality representation of images at extremely low bit rates. This work introduces novel components to…

Image and Video Processing · Electrical Eng. & Systems 2025-06-02 Cheng-Lin Wu , Hyomin Choi , Ivan V. Bajić

Recently, diffusion-based generative models have demonstrated remarkable performance in speech enhancement tasks. However, these methods still encounter challenges, including the lack of structural information and poor performance in low…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-16 Siyi Wang , Siyi Liu , Andrew Harper , Paul Kendrick , Mathieu Salzmann , Milos Cernak

Semantic scene completion (SSC) aims to predict the semantic occupancy of each voxel in the entire 3D scene from limited observations, which is an emerging and critical task for autonomous driving. Recently, many studies have turned to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Jianbiao Mei , Yu Yang , Mengmeng Wang , Junyu Zhu , Jongwon Ra , Yukai Ma , Laijian Li , Yong Liu

The importance of Radio Access Network (RAN) in support Artificial Intelligence (AI) application services has grown significantly, underscoring the need for an integrated approach that considers not only network efficiency but also AI…

Systems and Control · Electrical Eng. & Systems 2025-08-19 Jinhyuk Choi , Jihong Park , Seungeun Oh , Seong-Lyun Kim

Diffusion Model (DM) based Semantic Image Communication (SIC) systems face significant challenges, such as slow inference speed and generation randomness, that limit their reliability and practicality. To overcome these issues, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2025-07-24 Bilal Khalid , Pedro Freire , Sergei K. Turitsyn , Jaroslaw E. Prilepsky

Semantic communications offer promising prospects for enhancing data transmission efficiency. However, existing schemes have predominantly concentrated on point-to-point transmissions. In this paper, we aim to investigate the validity of…

Signal Processing · Electrical Eng. & Systems 2024-06-26 Yanhu Wang , Shuaishuai Guo , Anming Dong , Hui Zhao