English
Related papers

Related papers: Diffusion Transformers with Hybrid Conditioning fo…

200 papers

Data imputation and data generation have important applications for many domains, like healthcare and finance, where incomplete or missing data can hinder accurate analysis and decision-making. Diffusion models have emerged as powerful…

Machine Learning · Computer Science 2025-06-10 Mario Villaizán-Vallelado , Matteo Salvatori , Carlos Segura , Ioannis Arapakis

Topology optimization techniques have been applied in integrated optics and nanophotonics for the inverse design of devices with shapes that cannot be conceived by human intuition. At optical frequencies, these techniques have only been…

Optics · Physics 2022-04-15 Emadeldeen Hassan , Antonio Calà Lesina

Transformer requires a fixed number of layers and heads which makes them inflexible to the complexity of individual samples and expensive in training and inference. To address this, we propose a sample-based Dynamic Hierarchical Transformer…

Machine Learning · Computer Science 2024-01-11 Fanfei Meng , Lele Zhang , Yu Chen , Yuxin Wang

Multi-object tracking (MOT) is a fundamental task in computer vision with critical applications in autonomous driving and robotics. Multimodal MOT that integrates visible light and thermal infrared information is particularly essential for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Weiran Li , Yeqiang Liu , Yijie Wei , Mina Han , Qiannan Guo , Zhenbo Li

Generative modeling has recently undergone remarkable advancements, primarily propelled by the transformative implications of Diffusion Probabilistic Models (DPMs). The impressive capability of these models, however, often entails…

Machine Learning · Computer Science 2023-10-03 Gongfan Fang , Xinyin Ma , Xinchao Wang

Despite the rapid advancement of Virtual Try-On (VTON) and Try-Off (VTOFF) technologies, existing VTON methods face challenges with fine-grained detail preservation, generalization to complex scenes, complicated pipeline, and efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Weixuan Zeng , Pengcheng Wei , Huaiqing Wang , Boheng Zhang , Jia Sun , Dewen Fan , Lin HE , Long Chen , Qianqian Gan , Fan Yang , Tingting Gao

We present a latent diffusion-based differentiable inversion method (LD-DIM) for PDE-constrained inverse problems involving high-dimensional spatially distributed coefficients. LD-DIM couples a pretrained latent diffusion prior with an…

Numerical Analysis · Mathematics 2025-12-30 Zihan Lin , QiZhi He

Density-based topology optimization methods such as SIMP enable efficient topological exploration but produce diffuse material boundaries that require interpretation before manufacturing. Level-set methods maintain sharp interfaces but are…

Computational Engineering, Finance, and Science · Computer Science 2026-05-07 Ondřej Ježek , Ján Kopačka , Martin Isoz , Dušan Gabriel

Topology optimization (TO) in two dimensions often presents a trade-off between structural performance and manufacturability, with unpenalized (variable-thickness) methods yielding superior but complex designs, and penalized (SIMP) methods…

Computational Engineering, Finance, and Science · Computer Science 2025-07-28 Gabriel Stankiewicz , Chaitanya Dev , Paul Steinmann

Deep learning (DL) methods have been extensively applied to various image recovery problems, including magnetic resonance imaging (MRI) and computed tomography (CT) reconstruction. Beyond supervised models, other approaches have been…

Image and Video Processing · Electrical Eng. & Systems 2024-12-24 Shijun Liang , Ismail Alkhouri , Qing Qu , Rongrong Wang , Saiprasad Ravishankar

The rapid growth of e-commerce has intensified the demand for Virtual Try-On (VTO) technologies, enabling customers to realistically visualize products overlaid on their own images. Despite recent advances, existing VTO models face…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Qi Li , Shuwen Qiu , Julien Han , Xingzi Xu , Mehmet Saygin Seyfioglu , Kee Kiat Koo , Karim Bouyarmane

Diffusion models have emerged as powerful generative frameworks by progressively adding noise to data through a forward process and then reversing this process to generate realistic samples. While these models have achieved strong…

Machine Learning · Computer Science 2025-03-04 Xingzhuo Guo , Yu Zhang , Baixu Chen , Haoran Xu , Jianmin Wang , Mingsheng Long

The search for refining 3D LiDAR data has attracted growing interest motivated by recent techniques such as supervised learning or generative model-based methods. Existing approaches have shown the possibilities for using diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Sander Elias Magnussen Helgesen , Kazuto Nakashima , Jim Tørresen , Ryo Kurazume

Recent advancements in neural network-based optical flow estimation often come with prohibitively high computational and memory requirements, presenting challenges in their model adaptation for mobile and low-power use cases. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Risheek Garrepalli , Jisoo Jeong , Rajeswaran C Ravindran , Jamie Menjay Lin , Fatih Porikli

Nature is infinitely resolution-free. In the context of this reality, existing diffusion models, such as Diffusion Transformers, often face challenges when processing image resolutions outside of their trained domain. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Zeyu Lu , Zidong Wang , Di Huang , Chengyue Wu , Xihui Liu , Wanli Ouyang , Lei Bai

Seismic full-waveform inversion is a core technology for obtaining high-resolution subsurface model parameters. However, its highly nonlinear characteristics and strong dependence on the initial model often lead to the inversion process…

Machine Learning · Computer Science 2026-03-25 Caiyun Liu , Siyang Pei , Qingfeng Yu , Jie Xiong

Diffusion Models (DMs) utilize an iterative denoising process to transform random noise into synthetic data. Initally proposed with a UNet structure, DMs excel at producing images that are virtually indistinguishable with or without…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yuewei Yang , Jialiang Wang , Xiaoliang Dai , Peizhao Zhang , Hongbo Zhang

Controllable music generation methods are critical for human-centered AI-based music creation, but are currently limited by speed, quality, and control design trade-offs. Diffusion Inference-Time T-optimization (DITTO), in particular,…

Sound · Computer Science 2024-05-31 Zachary Novack , Julian McAuley , Taylor Berg-Kirkpatrick , Nicholas Bryan

Recently, the tokens of images share the same static data flow in many dense networks. However, challenges arise from the variance among the objects in images, such as large variations in the spatial scale and difficulties of recognition…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yuchen Ma , Zhengcong Fei , Junshi Huang

Diffusion-based generative methods have shown promising potential for modeling trajectories from offline reinforcement learning (RL) datasets, and hierarchical diffusion has been introduced to mitigate variance accumulation and…

Machine Learning · Computer Science 2025-09-29 Xianghua Zeng , Hao Peng , Angsheng Li , Yicheng Pan