English
Related papers

Related papers: Inverting the Feature Visualization Process for Fe…

200 papers

Given a set of human's decisions that are observed, inverse optimization has been developed and utilized to infer the underlying decision making problem. The majority of existing studies assumes that the decision making problem is with a…

Machine Learning · Statistics 2018-08-03 Chaosheng Dong , Bo Zeng

We present a simple and intuitive Focus-and-eXpand (\fax) method to guide the training process of a neural network towards a specific solution. Optimizing a neural network is a highly non-convex problem. Typically, the space of solutions is…

Machine Learning · Computer Science 2020-07-16 Moab Arar , Noa Fish , Dani Daniel , Evgeny Tenetov , Ariel Shamir , Amit Bermano

Reversibility in artificial neural networks allows us to retrieve the input given an output. We present feature alignment, a method for approximating reversibility in arbitrary neural networks. We train a network by minimizing the distance…

Machine Learning · Computer Science 2023-01-31 Tiago de Souza Farias , Jonas Maziero

Neural networks are a convenient way to automatically fit functions that are too complex to be described by hand. The downside of this approach is that it leads to build a black-box without understanding what happened inside. Finding the…

Machine Learning · Computer Science 2022-08-29 Théo Nancy , Vassili Maillet , Johann Barbier

The brain uses positive signals as a means of signaling. Forward interactions in the early visual cortex are also positive, realized by excitatory synapses. Only local interactions also include inhibition. Non-negative matrix factorization…

Machine Learning · Computer Science 2025-03-27 Mahbod Nouri , David Rotermund , Alberto Garcia-Ortiz , Klaus R. Pawelzik

A neuroscience method to understanding the brain is to find and study the preferred stimuli that highly activate an individual cell or groups of cells. Recent advances in machine learning enable a family of methods to synthesize preferred…

Machine Learning · Computer Science 2019-04-22 Anh Nguyen , Jason Yosinski , Jeff Clune

In this paper, we demonstrate how to learn the objective function of a decision-maker while only observing the problem input data and the decision-maker's corresponding decisions over multiple rounds. We present exact algorithms for this…

Optimization and Control · Mathematics 2020-03-31 Andreas Bärmann , Alexander Martin , Sebastian Pokutta , Oskar Schneider

Nonnegative matrix factorization (NMF) is a powerful class of feature extraction techniques that has been successfully applied in many fields, namely in signal and image processing. Current NMF techniques have been limited to a…

Machine Learning · Statistics 2015-01-26 Paul Honeine , Fei Zhu

Recently vision transformers (ViT) have been applied successfully for various tasks in computer vision. However, important questions such as why they work or how they behave still remain largely unknown. In this paper, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Van-Anh Nguyen , Khanh Pham Dinh , Long Tung Vuong , Thanh-Toan Do , Quan Hung Tran , Dinh Phung , Trung Le

The problem of Learning from Demonstration is targeted at learning to perform tasks based on observed examples. One approach to Learning from Demonstration is Inverse Reinforcement Learning, in which actions are observed to infer rewards.…

Neural and Evolutionary Computing · Computer Science 2016-08-11 Karan K. Budhraja , Tim Oates

Neural networks can be trained to solve regression problems by using gradient-based methods to minimize the square loss. However, practitioners often prefer to reformulate regression as a classification problem, observing that training on…

Machine Learning · Computer Science 2023-03-02 Lawrence Stewart , Francis Bach , Quentin Berthet , Jean-Philippe Vert

Neural network systems describe complex mappings that can be very difficult to understand. In this paper, we study the inverse problem of determining the input images that get mapped to specific neural network classes. Ultimately, we expect…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Rebecca Pattichis , Sebastian Janampa , Constantinos S. Pattichis , Marios S. Pattichis

Many image processing tasks involve image-to-image mapping, which can be addressed well by fully convolutional networks (FCN) without any heavy preprocessing. Although empirically designing and training FCNs can achieve satisfactory…

Machine Learning · Computer Science 2019-01-25 Jianjie Lu , Kai-yu Tong

As deep neural networks are increasingly used in solving high-stake problems, there is a pressing need to understand their internal decision mechanisms. Visualization has helped address this problem by assisting with interpreting complex…

Machine Learning · Computer Science 2019-06-04 Haekyu Park , Fred Hohman , Duen Horng Chau

Deep neural networks (DNNs) trained on visual tasks develop feature representations that resemble those in the human visual system. Although DNN-based encoding models can accurately predict brain responses to visual stimuli, they offer…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Matthew W. Shinkle , Mark D. Lescroart

We consider a statistical inverse learning problem, where we observe the image of a function $f$ through a linear operator $A$ at i.i.d. random design points $X_i$, superposed with an additive noise. The distribution of the design points is…

Machine Learning · Statistics 2016-04-15 Gilles Blanchard , Nicole Mücke

We present a method for visualising the response of a deep neural network to a specific input. For image data for instance our method will highlight areas that provide evidence in favor of, and against choosing a certain class. The method…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Luisa M. Zintgraf , Taco S. Cohen , Max Welling

Inverse rendering aims to reconstruct the scene properties of objects solely from multiview images. However, it is an ill-posed problem prone to producing ambiguous estimations deviating from physically accurate representations. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Georgios Kouros , Minye Wu , Sushruth Nagesh , Xianling Zhang , Tinne Tuytelaars

In this paper, we perform sensitivity analysis for the maximal value function which is the optimal value function for a parametric maximization problem. Our aim is to study various subdifferentials for the maximal value function. We obtain…

Optimization and Control · Mathematics 2023-03-03 L. Guo , J. J. Ye , J. Zhang

Flat minima are strongly associated with improved generalisation in deep neural networks. However, this connection has proven nuanced in recent studies, with both theoretical counterexamples and empirical exceptions emerging in the…

Machine Learning · Computer Science 2026-04-16 Israel Mason-Williams , Gabryel Mason-Williams , Helen Yannakoudakis