English
Related papers

Related papers: Merging automatic differentiation and the adjoint …

200 papers

Classifier guidance -- using the gradients of an image classifier to steer the generations of a diffusion model -- has the potential to dramatically expand the creative control over image generation and editing. However, currently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Bram Wallace , Akash Gokul , Stefano Ermon , Nikhil Naik

Subwavelength photonic structures and metamaterials provide revolutionary approaches for controlling light. The inverse design methods proposed for these subwavelength structures are vital to the development of new photonic devices.…

High dimensional and/or nonconvex optimization remains a challenging and important problem across a wide range of fields, such as machine learning, data assimilation, and partial differential equation (PDE) constrained optimization. Here we…

Optimization and Control · Mathematics 2025-08-29 Brian K. Tran , Ben S. Southworth , David B. Cavender , Sam Olivier , Syed A. Shah , Tommaso Buvoli

Designing heterogeneous, self-assembling systems is a central challenge in soft matter and biology. We present a framework that uses gradient-based optimization to invert an analytical yield calculation, tuning systems toward target…

Soft Condensed Matter · Physics 2025-10-21 Livia A. J. Guttieres , Ryan K. Krueger , Remi Drolet , Michael P. Brenner

In the last decades nanostructures have unlocked myriads of functionalities in nanophotonics by engineering light-matter interaction beyond what is possible with conventional bulk optics. The space of parameters available for design is…

Optics · Physics 2023-10-31 Johannes Gedeon , Emadeldeen Hassan , Antonio Calà Lesina

Derivative-based algorithms are ubiquitous in statistics, machine learning, and applied mathematics. Automatic differentiation offers an algorithmic way to efficiently evaluate these derivatives from computer programs that execute relevant…

Computation · Statistics 2022-03-01 Charles C. Margossian , Michael Betancourt

When dealing with difficult inverse problems such as inverse rendering, using Monte Carlo estimated gradients to optimise parameters can slow down convergence due to variance. Averaging many gradient samples in each iteration reduces this…

Graphics · Computer Science 2023-09-28 Martin Balint , Karol Myszkowski , Hans-Peter Seidel , Gurprit Singh

An end-to-end trainable ConvNet architecture, that learns to harness the power of shape representation for matching disparate image pairs, is proposed. Disparate image pairs are deemed those that exhibit strong affine variations in scale,…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Shefali Srivastava , Abhimanyu Chopra , Arun CS Kumar , Suchendra M. Bhandarkar , Deepak Sharma

Existing customization methods require access to multiple reference examples to align pre-trained diffusion probabilistic models (DPMs) with user-provided concepts. This paper aims to address the challenge of DPM customization when the only…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Jiachun Pan , Jun Hao Liew , Vincent Y. F. Tan , Jiashi Feng , Hanshu Yan

The optimization of physical parameters serves various purposes, such as system identification and efficiency in developing devices. Spin-torque oscillators have been applied to neuromorphic computing experimentally and theoretically, but…

Mesoscale and Nanoscale Physics · Physics 2024-09-17 Yusuke Imai , Shuhong Liu , Nozomi Akashi , Kohei Nakajima

Infrared and visible image fusion aims to integrate complementary information from co-registered source images to produce a single, informative result. Most learning-based approaches train with a combination of structural similarity loss,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Kaixuan Yang , Wei Xiang , Zhenshuai Chen , Tong Jin , Yunpeng Liu

The inverse design of optical metasurfaces is a rapidly emerging field that has already shown great promise in miniaturizing conventional optics as well as developing completely new optical functionalities. Such a design process relies on…

Optics · Physics 2020-08-26 Maksym V. Zhelyeznyakov , Steven L. Brunton , Arka Majumdar

This work presents a partitioned solution procedure to compute shape gradients in fluid-structure interaction (FSI) using black-box adjoint solvers. Special attention is paid to project the gradients onto the undeformed configuration. This…

Numerical Analysis · Mathematics 2019-12-09 Reza Najian Asl , Ihar Antonau , Aditya Ghantasala , Wulf G. Dettmer , Roland Wuchner , Kai-Uwe Bletzinger

We propose a first-order method for solving inequality constrained optimization problems. The method is derived from our previous work [12], a modified search direction method (MSDM) that applies the singular-value decomposition of…

Optimization and Control · Mathematics 2020-03-12 Long Chen , Wenyi Chen , Kai-Uwe Bletzinger

In this paper, we study a general optimization model, which covers a large class of existing models for many applications in imaging sciences. To solve the resulting possibly nonconvex, nonsmooth and non-Lipschitz optimization problem, we…

Optimization and Control · Mathematics 2016-09-30 Lei Yang , Ting Kei Pong , Xiaojun Chen

Designing complex physical systems, including photonic structures, is typically a tedious trial-and-error process that requires extensive simulations with iterative sweeps in multi-dimensional parameter space. To circumvent this…

Optics · Physics 2019-02-08 Zhaocheng Liu , Lakshmi Raju , Dayu Zhu , Wenshan Cai

This work is concerned with the micro-architecture of multi-layer material that globally exhibits desired mechanical properties, for instance a negative apparent Poisson ratio. We use inverse homogenization, the level set method, and the…

Optimization and Control · Mathematics 2019-01-30 Grigor Nika , Andrei Constantinescu

Many modern computer vision and machine learning applications rely on solving difficult optimization problems that involve non-differentiable objective functions and constraints. The alternating direction method of multipliers (ADMM) is a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Zheng Xu , Mario A. T. Figueiredo , Xiaoming Yuan , Christoph Studer , Tom Goldstein

Class-agnostic image segmentation is a crucial component in automating image editing workflows, especially in contexts where object selection traditionally involves interactive tools. Existing methods in the literature often adhere to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Sebastian Dille , Ari Blondal , Sylvain Paris , Yağız Aksoy

To increase the predictive power of a model, one needs to estimate its unknown parameters. Almost all parameter estimation techniques in ordinary differential equation models suffer from either a small convergence region or enormous…

Optimization and Control · Mathematics 2020-06-30 Ozgur Aydogmus , Ali Hakan Tor