English
Related papers

Related papers: IKDiffuser: a Diffusion-based Generative Inverse K…

200 papers

We extend to multi-dimensions the work of [1], where new fully explicit kinetic methods were built for the approximation of linear and non-linear convection-diffusion problems. The fundamental principles from the earlier work are retained:…

Numerical Analysis · Mathematics 2023-12-29 Gauthier Wissocq , Rémi Abgrall

This work introduces TrajDiffuser, a compositional diffusion-based flexible and concurrent trajectory generator for 6 degrees of freedom powered descent guidance. TrajDiffuser is a statistical model that learns the multi-modal distributions…

Robotics · Computer Science 2024-10-08 Julia Briden , Yilun Du , Enrico M. Zucchelli , Richard Linares

As deep generative models proliferate across the AI landscape, industrial practitioners still face critical yet unanswered questions about which deep generative models best suit complex manufacturing design tasks. This work addresses this…

Machine Learning · Computer Science 2025-08-27 Fouad Oubari , Raphael Meunier , Rodrigue Décatoire , Mathilde Mougeot

Prompt learning has demonstrated promising results in fine-tuning pre-trained multimodal models. However, the performance improvement is limited when applied to more complex and fine-grained tasks. The reason is that most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Weicai Yan , Wang Lin , Zirun Guo , Ye Wang , Fangming Feng , Xiaoda Yang , Zehan Wang , Tao Jin

We introduce OneDiffusion, a versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. It enables conditional generation from inputs such as text, depth, pose,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Duong H. Le , Tuan Pham , Sangho Lee , Christopher Clark , Aniruddha Kembhavi , Stephan Mandt , Ranjay Krishna , Jiasen Lu

Recent advancements in image synthesis are fueled by the advent of large-scale diffusion models. Yet, integrating realistic object visualizations seamlessly into new or existing backgrounds without extensive training remains a challenge.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Phillip Mueller , Jannik Wiese , Ioan Craciun , Lars Mikelsons

While deep learning-based methods for blind face restoration have achieved unprecedented success, they still suffer from two major limitations. First, most of them deteriorate when facing complex degradations out of their training data.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zongsheng Yue , Chen Change Loy

We present a unified framework for solving partial differential equations (PDEs) using video-inpainting diffusion transformer models. Unlike existing methods that devise specialized strategies for either forward or inverse problems under…

Machine Learning · Computer Science 2025-06-18 Edward Li , Zichen Wang , Jiahe Huang , Jeong Joon Park

Score-based diffusion models (SBDM) have recently emerged as state-of-the-art approaches for image generation. Existing SBDMs are typically formulated in a finite-dimensional setting, where images are considered as tensors of finite size.…

Machine Learning · Computer Science 2024-10-22 Paul Hagemann , Sophie Mildenberger , Lars Ruthotto , Gabriele Steidl , Nicole Tianjiao Yang

This work presents a diffusion transformer framework for data-driven structural topology optimization that combines the accuracy of physics-based methods with the efficiency of generative deep learning. Conventional approaches such as the…

Computational Engineering, Finance, and Science · Computer Science 2026-05-05 Aaron Lutheran , Srijan Das , Alireza Tabarraei

Understanding and modeling lighting effects are fundamental tasks in computer vision and graphics. Classic physically-based rendering (PBR) accurately simulates the light transport, but relies on precise scene representations--explicit 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ruofan Liang , Zan Gojcic , Huan Ling , Jacob Munkberg , Jon Hasselgren , Zhi-Hao Lin , Jun Gao , Alexander Keller , Nandita Vijaykumar , Sanja Fidler , Zian Wang

Recent progress in multimodal generation has increasingly combined autoregressive (AR) and diffusion-based approaches, leveraging their complementary strengths: AR models capture long-range dependencies and produce fluent, context-aware…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Junhao Chen , Yulia Tsvetkov , Xiaochuang Han

Generative AI has redefined artificial intelligence, enabling the creation of innovative content and customized solutions that drive business practices into a new era of efficiency and creativity. In this paper, we focus on diffusion…

Machine Learning · Computer Science 2024-03-21 Zihao Li , Hui Yuan , Kaixuan Huang , Chengzhuo Ni , Yinyu Ye , Minshuo Chen , Mengdi Wang

Diffusion-based inverse algorithms have shown remarkable performance across various inverse problems, yet their reliance on numerous denoising steps incurs high computational costs. While recent developments of fast diffusion ODE solvers…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Jiawei Zhang , Ziyuan Liu , Leon Yan , Gen Li , Yuantao Gu

Diffusion models have shown great success in generating high-quality co-speech gestures for interactive humanoid robots or digital avatars from noisy input with the speech audio or text as conditions. However, they rarely focus on providing…

Human-Computer Interaction · Computer Science 2024-04-04 Zeyu Zhao , Nan Gao , Zhi Zeng , Guixuan Zhang , Jie Liu , Shuwu Zhang

Diffusion models have shown an impressive ability to model complex data distributions, with several key advantages over GANs, such as stable training, better coverage of the training distribution's modes, and the ability to solve inverse…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Yinbo Chen , Oliver Wang , Richard Zhang , Eli Shechtman , Xiaolong Wang , Michael Gharbi

Hybrid neural-physics modeling frameworks through differentiable programming have emerged as powerful tools in scientific machine learning, enabling the integration of known physics with data-driven learning to improve prediction accuracy…

Machine Learning · Computer Science 2025-04-04 Deepak Akhare , Pan Du , Tengfei Luo , Jian-Xun Wang

Recent video generation models have achieved remarkable progress and are now deployed in film, social media production, and advertising. Beyond their creative potential, such models also hold promise as world simulators for robotics and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 David Romero , Ariana Bermudez , Viacheslav Iablochnikov , Hao Li , Fabio Pizzati , Ivan Laptev

The small size, high dexterity, and intrinsic compliance of continuum robots (CRs) make them well suited for constrained environments. Solving the inverse kinematics (IK), that is finding robot joint configurations that satisfy desired…

Robotics · Computer Science 2023-06-26 Hanna Jiamei Zhang , Matthew Giamou , Filip Marić , Jonathan Kelly , Jessica Burgner-Kahrs

This paper introduces TopoDiffuser, a diffusion-based framework for multimodal trajectory prediction that incorporates topometric maps to generate accurate, diverse, and road-compliant future motion forecasts. By embedding structural cues…

Robotics · Computer Science 2025-08-04 Zehui Xu , Junhui Wang , Yongliang Shi , Chao Gao , Guyue Zhou