English
Related papers

Related papers: Intermediate Layer Optimization for Inverse Proble…

200 papers

Inverting a Generative Adversarial Network (GAN) facilitates a wide range of image editing tasks using pre-trained generators. Existing methods typically employ the latent space of GANs as the inversion space yet observe the insufficient…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Qingyan Bai , Yinghao Xu , Jiapeng Zhu , Weihao Xia , Yujiu Yang , Yujun Shen

We propose a novel method for compressed sensing recovery using untrained deep generative models. Our method is based on the recently proposed Deep Image Prior (DIP), wherein the convolutional weights of the network are optimized to match…

The ability to compare two degenerate probability distributions (i.e. two probability distributions supported on two distinct low-dimensional manifolds living in a much higher-dimensional space) is a crucial problem arising in the…

Machine Learning · Statistics 2017-10-23 Aude Genevay , Gabriel Peyré , Marco Cuturi

Inverse Optimal Control (IOC) seeks to recover an unknown cost from expert demonstrations, and it provides a systematic way of modeling experts' decision mechanisms while considering the prior information of the cost functions.…

Optimization and Control · Mathematics 2025-12-01 Ziliang Wang , Han Zhang , Axel Ringh

"Innovization" is a task of learning common relationships among some or all of the Pareto-optimal (PO) solutions in multi- and many-objective optimization problems. Recent studies have shown that a chronological sequence of non-dominated…

Neural and Evolutionary Computing · Computer Science 2026-05-07 Sukrit Mittal , Dhish Kumar Saxena , Kalyanmoy Deb , Erik Goodman

Existing approaches to diffusion-based inverse problem solvers frame the signal recovery task as a probabilistic sampling episode, where the solution is drawn from the desired posterior distribution. This framework suffers from several…

Machine Learning · Computer Science 2024-12-24 Henry Li , Marcus Pereira

We propose a new technique that boosts the convergence of training generative adversarial networks. Generally, the rate of training deep models reduces severely after multiple iterations. A key reason for this phenomenon is that a deep…

Machine Learning · Statistics 2018-06-15 Atsushi Nitanda , Taiji Suzuki

Recently, diffusion models have been used to solve various inverse problems in an unsupervised manner with appropriate modifications to the sampling process. However, the current solvers, which recursively apply a reverse diffusion step…

Machine Learning · Computer Science 2024-05-21 Hyungjin Chung , Byeongsu Sim , Dohoon Ryu , Jong Chul Ye

We develop Latent Exploration Score (LES) to mitigate over-exploration in Latent Space Optimization (LSO), a popular method for solving black-box discrete optimization problems. LSO utilizes continuous optimization within the latent space…

Machine Learning · Computer Science 2025-02-25 Omer Ronen , Ahmed Imtiaz Humayun , Richard Baraniuk , Randall Balestriero , Bin Yu

In this paper, we introduce Dynamic Layer Operations (DLO), a novel approach for vertically scaling transformer-based Large Language Models (LLMs) by dynamically expanding, activating, or skipping layers using a sophisticated routing policy…

Machine Learning · Computer Science 2024-07-17 Zhen Tan , Daize Dong , Xinyu Zhao , Jie Peng , Yu Cheng , Tianlong Chen

Terahertz communication networks and intelligent reflecting surfaces exhibit significant potential in advancing wireless networks, particularly within the domain of aerial-based multi-access edge computing systems. These technologies enable…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-20 Jianqiu Wu , Zhongyi Yu , Jianxiong Guo , Zhiqing Tang , Tian Wang , Weijia Jia

Large Language Models (LLMs) have demonstrated remarkable in-context learning capabilities, enabling flexible utilization of limited historical information to play pivotal roles in reasoning, problem-solving, and complex pattern recognition…

Machine Learning · Computer Science 2025-03-31 Zhonglin Jiang , Qian Tang , Zequn Wang

Despite the success of Generative Adversarial Networks (GANs) in image synthesis, applying trained GAN models to real image processing remains challenging. Previous methods typically invert a target image back to the latent space either by…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Jinjin Gu , Yujun Shen , Bolei Zhou

Traditional image processing methods employing partial differential equations (PDEs) offer a multitude of meaningful regularizers, along with valuable theoretical foundations for a wide range of image-related tasks. This makes their…

Machine Learning · Computer Science 2024-07-02 Chaoyu Liu , Zhonghua Qiao , Chao Li , Carola-Bibiane Schönlieb

There is an increasing interest in using image-generating diffusion models for deep data augmentation and image morphing. In this context, it is useful to interpolate between latents produced by inverting a set of input images, in order to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Erik Landolsi , Fredrik Kahl

We address the problem of learning observation models end-to-end for estimation. Robots operating in partially observable environments must infer latent states from multiple sensory inputs using observation models that capture the joint…

Robotics · Computer Science 2022-04-12 Paloma Sodhi , Eric Dexheimer , Mustafa Mukadam , Stuart Anderson , Michael Kaess

Bridging generative foundation models with non-equilibrium thin-film synthesis remains a central challenge, limiting the practical impact of AI-driven materials discovery on semiconductor dielectrics. Here, we introduce IDEAL (Inverse…

Materials Science · Physics 2026-03-11 Bonwook Gu , Trinh Ngoc Le , Wonjoong Kim , Zunair Masroor , Han-Bo-Ram Lee

We present Hidden-State Optimization (HSO), a gradient-based method for improving the performance of transformer language models at inference time. Similar to dynamic evaluation (Krause et al., 2018), HSO computes the gradient of the…

Computation and Language · Computer Science 2021-12-17 Davis Yoshida , Kevin Gimpel

There is an urgent need to build models to tackle Indoor Air Quality issue. Since the model should be accurate and fast, Reduced Order Modelling technique is used to reduce the dimensionality of the problem. The accuracy of the model, that…

Bayesian optimization (BO) has been broadly applied to computational expensive problems, but it is still challenging to extend BO to high dimensions. Existing works are usually under strict assumption of an additive or a linear embedding…

Machine Learning · Computer Science 2019-07-23 Miao Zhang , Huiqi Li , Steven Su