English
Related papers

Related papers: Trust-Region Noise Search for Black-Box Alignment …

200 papers

Diffusion models have been successfully adapted to text generation tasks by mapping the discrete text into the continuous space. However, there exist nonnegligible gaps between training and inference, owing to the absence of the forward…

Computation and Language · Computer Science 2023-05-09 Zecheng Tang , Pinzheng Wang , Keyan Zhou , Juntao Li , Ziqiang Cao , Min Zhang

The recent success of inference-time scaling in large language models has inspired similar explorations in video diffusion. In particular, motivated by the existence of "golden noise" that enhances video quality, prior work has attempted to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zengqun Zhao , Ziquan Liu , Yu Cao , Shaogang Gong , Zhensong Zhang , Jifei Song , Jiankang Deng , Ioannis Patras

Optimizing industrial processes often involves gray-box models that couple algebraic glass-box equations with black-box components lacking analytic derivatives. Such systems challenge derivative-based solvers. The classical trust-region…

Optimization and Control · Mathematics 2026-04-15 Gul Hameed , Tao Chen , Antonio del Rio Chanona , Lorenz T. Biegler , Michael Short

Diffusion and flow-based generative models have achieved remarkable success in domains such as image synthesis, video generation, and natural language modeling. In this work, we extend these advances to weight space learning by leveraging…

Machine Learning · Computer Science 2025-10-17 Daniel Saragih , Deyu Cao , Tejas Balaji

Network optimization remains fundamental in wireless communications, with Artificial Intelligence (AI)-based solutions gaining widespread adoption. As Sixth-Generation (6G) communication networks pursue full-scenario coverage, optimization…

Networking and Internet Architecture · Computer Science 2025-04-23 Feiran You , Hongyang Du , Xiangwang Hou , Yong Ren , Kaibin Huang

Dynamical generative models that produce samples through an iterative process, such as Flow Matching and denoising diffusion models, have seen widespread use, but there have not been many theoretically-sound methods for improving these…

Machine Learning · Computer Science 2025-01-08 Carles Domingo-Enrich , Michal Drozdzal , Brian Karrer , Ricky T. Q. Chen

Diffusion models have demonstrated powerful performance in generating high-quality images. A typical example is text-to-image generator like Stable Diffusion. However, their widespread use also poses potential privacy risks. A key concern…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Guo Li , Weihong Chen , Yongfu Fan

Training robots in simulation requires diverse 3D scenes that reflect the specific challenges of downstream tasks. However, scenes that satisfy strict task requirements, such as high-clutter environments with plausible spatial arrangement,…

Robotics · Computer Science 2025-08-27 Nicholas Pfaff , Hongkai Dai , Sergey Zakharov , Shun Iwase , Russ Tedrake

Diffusion models have emerged as powerful generative tools across various domains, yet tailoring pre-trained models to exhibit specific desirable properties remains challenging. While reinforcement learning (RL) offers a promising…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Fengyuan Dai , Zifeng Zhuang , Yufei Huang , Siteng Huang , Bangyan Liao , Donglin Wang , Fajie Yuan

Advances in diffusion models for generative artificial intelligence have recently propagated to the time series (TS) domain, demonstrating state-of-the-art performance on various tasks. However, prior works on TS diffusion models often…

Machine Learning · Computer Science 2024-10-21 Seunghan Lee , Kibok Lee , Taeyoung Park

Diffusion models are the mainstream approach for time series generation tasks. However, existing diffusion models for time series generation require retraining the entire framework to introduce specific conditional guidance. There also…

Machine Learning · Computer Science 2025-09-25 Mingchun Sun , Rongqiang Zhao , Hengrui Hu , Songyu Ding , Jie Liu

The remarkable progress in text-to-video diffusion models enables the generation of photorealistic videos, although the content of these generated videos often includes unnatural movement or deformation, reverse playback, and motionless…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Yuta Oshima , Masahiro Suzuki , Yutaka Matsuo , Hiroki Furuta

Reward models are central to both reinforcement learning (RL) with language models and inference-time verification. However, existing reward models often lack temporal consistency, leading to ineffective policy updates and unstable RL…

Machine Learning · Computer Science 2025-09-30 Dan Zhang , Min Cai , Jonathan Light , Ziniu Hu , Yisong Yue , Jie Tang

As the marginal cost of scaling computation (data and parameters) during model pre-training continues to increase substantially, test-time scaling (TTS) has emerged as a promising direction for improving generative model performance by…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Haoran He , Jiajun Liang , Xintao Wang , Pengfei Wan , Di Zhang , Kun Gai , Ling Pan

A common recipe to improve diffusion models at test-time so that samples score highly against a user-specified reward is to introduce the gradient of the reward into the dynamics of the diffusion itself. This procedure is often ill posed,…

Diffusion models have become a central paradigm for image and multimodal generation, yet their deployment raises persistent questions about alignment, safety, preference satisfaction, and robustness to misuse. This survey reviews recent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Preeti Lamba , Kiran Ravish , Ankita Kushwaha , Pawan Kumar

Inference-time scaling offers a versatile paradigm for aligning visual generative models with downstream objectives without parameter updates. However, existing approaches that optimize the high-dimensional initial noise suffer from severe…

Machine Learning · Computer Science 2026-02-04 Jinyan Ye , Zhongjie Duan , Zhiwen Li , Cen Chen , Daoyuan Chen , Yaliang Li , Yingda Chen

Learning to rank (LTR) is one of the core tasks in Machine Learning. Traditional LTR models have made great progress, but nearly all of them are implemented from discriminative perspective. In this paper, we aim at addressing LTR from a…

Information Retrieval · Computer Science 2026-04-24 Ying Wang , Preslav Nakov , Shangsong Liang

Adapting pretrained diffusion models to downstream objectives such as inverse problems often requires expensive test-time guidance or optimization. We propose a principled framework for generating high-quality reward-aligned samples at…

Machine Learning · Computer Science 2026-05-22 Kushagra Pandey , Farrin Marouf Sofian , Jan Niklas Groeneveld , Felix Draxler , Stephan Mandt

The goal of this paper is to enhance Text-to-Audio generation at inference, focusing on generating realistic audio that precisely aligns with text prompts. Despite the rapid advancements, existing models often fail to achieve a reliable…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-25 Jaemin Jung , Jaehun Kim , Inkyu Shin , Joon Son Chung