English
Related papers

Related papers: Resource-Efficient Invariant Networks: Exponential…

200 papers

Subset selection-based methods are widely used to explain deep vision models: they attribute predictions by highlighting the most influential image regions and support object-level explanations. While these methods perform well in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Madhav Gupta , Vishak Prasad C , Ganesh Ramakrishnan

The integration of constrained optimization models as components in deep networks has led to promising advances on many specialized learning tasks. A central challenge in this setting is backpropagation through the solution of an…

Machine Learning · Computer Science 2024-01-01 James Kotary , Jacob Christopher , My H Dinh , Ferdinando Fioretto

Representations of data that are invariant to changes in specified factors are useful for a wide range of problems: removing potential biases in prediction problems, controlling the effects of covariates, and disentangling meaningful…

Machine Learning · Computer Science 2019-12-03 Daniel Moyer , Shuyang Gao , Rob Brekelmans , Greg Ver Steeg , Aram Galstyan

We introduce a new method for speeding up the inference of deep neural networks. It is somewhat inspired by the reduced-order modeling techniques for dynamical systems.The cornerstone of the proposed method is the maximum volume algorithm.…

Machine Learning · Computer Science 2020-11-26 Julia Gusak , Talgat Daulbaev , Evgeny Ponomarev , Andrzej Cichocki , Ivan Oseledets

As machine learning systems get widely adopted for high-stake decisions, quantifying uncertainty over predictions becomes crucial. While modern neural networks are making remarkable gains in terms of predictive accuracy, characterizing…

Machine Learning · Computer Science 2019-06-14 Melanie F. Pradier , Weiwei Pan , Jiayu Yao , Soumya Ghosh , Finale Doshi-velez

Despite their impressive performance, deep neural networks exhibit striking failures on out-of-distribution inputs. One core idea of adversarial example research is to reveal neural network errors under such distribution shifts. We…

Machine Learning · Computer Science 2020-07-14 Jörn-Henrik Jacobsen , Jens Behrmann , Richard Zemel , Matthias Bethge

Generalising well in supervised learning tasks relies on correctly extrapolating the training data to a large region of the input space. One way to achieve this is to constrain the predictions to be invariant to transformations on the input…

Machine Learning · Computer Science 2018-08-17 Mark van der Wilk , Matthias Bauer , ST John , James Hensman

How can prior knowledge on the transformation invariances of a domain be incorporated into the architecture of a neural network? We propose Equivariant Transformers (ETs), a family of differentiable image-to-image mappings that improve the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Kai Sheng Tai , Peter Bailis , Gregory Valiant

Modulo-Imaging (MI) offers a promising alternative for expanding the dynamic range of images by resetting the signal intensity when it reaches the saturation level. Subsequently, high-dynamic range (HDR) modulo imaging requires a recovery…

Image and Video Processing · Electrical Eng. & Systems 2026-02-02 Brayan Monroy , Jorge Bacca

Despite the performance advantages of modern sampling-based motion planners, solving high dimensional planning problems in near real-time remains a challenge. Applications include hyper-redundant manipulators, snake-like and humanoid…

Robotics · Computer Science 2018-02-02 Marios P. Xanthidis , Joel M. Esposito , Ioannis Rekleitis , Jason M. O'Kane

The ability to detect and track objects in the visual world is a crucial skill for any intelligent agent, as it is a necessary precursor to any object-level reasoning process. Moreover, it is important that agents learn to track objects…

Machine Learning · Computer Science 2019-11-21 Eric Crawford , Joelle Pineau

In reinforcement learning (RL), exploiting environmental symmetries can significantly enhance efficiency, robustness, and performance. However, ensuring that the deep RL policy and value networks are respectively equivariant and invariant…

Machine Learning · Computer Science 2024-12-31 Mirco Theile , Hongpeng Cao , Marco Caccamo , Alberto L. Sangiovanni-Vincentelli

Invariances to translations have imbued convolutional neural networks with powerful generalization properties. However, we often do not know a priori what invariances are present in the data, or to what extent a model should be invariant to…

Machine Learning · Computer Science 2020-12-02 Gregory Benton , Marc Finzi , Pavel Izmailov , Andrew Gordon Wilson

Spatial Transformer Networks (STNs) estimate image transformations that can improve downstream tasks by `zooming in' on relevant regions in an image. However, STNs are hard to train and sensitive to mis-predictions of transformations. To…

Machine Learning · Computer Science 2022-06-16 Pola Schwöbel , Frederik Warburg , Martin Jørgensen , Kristoffer H. Madsen , Søren Hauberg

Traversability estimation in rugged, unstructured environments remains a challenging problem in field robotics. Often, the need for precise, accurate traversability estimation is in direct opposition to the limited sensing and compute…

Robotics · Computer Science 2024-07-12 Samuel Triest , David D. Fan , Sebastian Scherer , Ali-Akbar Agha-Mohammadi

The ability to learn disentangled representations that split underlying sources of variation in high dimensional, unstructured data is important for data efficient and robust use of neural networks. While various approaches aiming towards…

Machine Learning · Statistics 2019-05-15 Raphael Suter , Đorđe Miladinović , Bernhard Schölkopf , Stefan Bauer

Algorithm unrolling methods have proven powerful for solving the regularized least squares problem in computational magnetic resonance imaging (MRI). These approaches unfold an iterative algorithm with a fixed number of iterations,…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Junno Yun , Yaşar Utku Alçalar , Mehmet Akçakaya

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

Three dimensional (3D) object recognition is becoming a key desired capability for many computer vision systems such as autonomous vehicles, service robots and surveillance drones to operate more effectively in unstructured environments.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Chenxi Xiao , Juan Wachs

While scale-invariant modeling has substantially boosted the performance of visual recognition tasks, it remains largely under-explored in deep networks based image restoration. Naively applying those scale-invariant techniques (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Yuchen Fan , Jiahui Yu , Ding Liu , Thomas S. Huang