English
Related papers

Related papers: Learning to Discover Iterative Spectral Algorithms

200 papers

Deep neural networks have usually to be compressed and accelerated for their usage in low-power, e.g. mobile, devices. Recently, massively-parallel hardware accelerators were developed that offer high throughput and low latency at low power…

Machine Learning · Computer Science 2021-08-04 Thomas Pfeil

We present a framework for efficient inference in structured image models that explicitly reason about objects. We achieve this by performing probabilistic inference using a recurrent neural network that attends to scene elements and…

Computer Vision and Pattern Recognition · Computer Science 2016-08-15 S. M. Ali Eslami , Nicolas Heess , Theophane Weber , Yuval Tassa , David Szepesvari , Koray Kavukcuoglu , Geoffrey E. Hinton

Learning neural subset selection tasks, such as compound selection in AI-aided drug discovery, have become increasingly pivotal across diverse applications. The existing methodologies in the field primarily concentrate on constructing…

Machine Learning · Computer Science 2024-06-11 Binghui Xie , Yatao Bian , Kaiwen zhou , Yongqiang Chen , Peilin Zhao , Bo Han , Wei Meng , James Cheng

We introduce an automatic machine learning (AutoML) modeling architecture called Autostacker, which combines an innovative hierarchical stacking architecture and an Evolutionary Algorithm (EA) to perform efficient parameter search. Neither…

Machine Learning · Computer Science 2018-03-05 Boyuan Chen , Harvey Wu , Warren Mo , Ishanu Chattopadhyay , Hod Lipson

This work proposes an autoencoder neural network as a non-linear generalization of projection-based methods for solving Partial Differential Equations (PDEs). The proposed deep learning architecture presented is capable of generating the…

Computational Physics · Physics 2020-06-25 Jaime Lopez Garcia , Angel Rivero Jimenez

A framework is introduced for actively and adaptively solving a sequence of machine learning problems, which are changing in bounded manner from one time step to the next. An algorithm is developed that actively queries the labels of the…

Machine Learning · Computer Science 2018-05-31 Yuheng Bu , Jiaxun Lu , Venugopal V. Veeravalli

Data mixing augmentation have proved to be effective in improving the generalization ability of deep neural networks. While early methods mix samples by hand-crafted policies (e.g., linear interpolation), recent methods utilize saliency…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Zicheng Liu , Siyuan Li , Di Wu , Zihan Liu , Zhiyuan Chen , Lirong Wu , Stan Z. Li

Autoencoders are popular among neural-network-based matrix completion models due to their ability to retrieve potential latent factors from the partially observed matrices. Nevertheless, when training data is scarce their performance is…

Machine Learning · Computer Science 2018-07-06 Duc Minh Nguyen , Evaggelia Tsiligianni , Robert Calderbank , Nikos Deligiannis

Deep learning based approaches have achieved significant progresses in different tasks like classification, detection, segmentation, and so on. Ensemble learning is widely known to further improve performance by combining multiple…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Danlu Chen , Xu-Yao Zhang , Wei Zhang , Yao Lu , Xiuli Li , Tao Mei

Answer Set Programming (ASP) is a truly-declarative programming paradigm proposed in the area of non-monotonic reasoning and logic programming, that has been recently employed in many applications. The development of efficient ASP systems…

Artificial Intelligence · Computer Science 2020-02-19 Marco Maratea , Luca Pulina , Francesco Ricca

Graph self-supervised learning has gained increasing attention due to its capacity to learn expressive node representations. Many pretext tasks, or loss functions have been designed from distinct perspectives. However, we observe that…

Machine Learning · Computer Science 2022-03-23 Wei Jin , Xiaorui Liu , Xiangyu Zhao , Yao Ma , Neil Shah , Jiliang Tang

In this paper, we tackle the question of discovering an effective set of spatial filters to solve hyperspectral classification problems. Instead of fixing a priori the filters and their parameters using expert knowledge, we let the model…

Machine Learning · Statistics 2016-07-19 Devis Tuia , Rémi Flamary , Nicolas Courty

Deep linear networks trained with gradient descent yield low rank solutions, as is typically studied in matrix factorization. In this paper, we take a step further and analyze implicit rank regularization in autoencoders. We show greedy…

Machine Learning · Computer Science 2021-07-06 Shih-Yu Sun , Vimal Thilak , Etai Littwin , Omid Saremi , Joshua M. Susskind

In most real-world applications of artificial intelligence, the distributions of the data and the goals of the learners tend to change over time. The Probably Approximately Correct (PAC) learning framework, which underpins most machine…

Machine Learning · Computer Science 2025-11-13 Yuxin Bai , Cecelia Shuai , Ashwin De Silva , Siyu Yu , Pratik Chaudhari , Joshua T. Vogelstein

We show that utilizing attribution maps for training neural networks can improve regularization of models and thus increase performance. Regularization is key in deep learning, especially when training complex models on relatively small…

Machine Learning · Computer Science 2022-05-31 Christian Tomani , Daniel Cremers

Autodock is a widely used molecular modeling tool which predicts how small molecules bind to a receptor of known 3D structure. The current version of AutoDock uses meta-heuristic algorithms in combination with local search methods for doing…

Machine Learning · Statistics 2018-12-07 Hojjat Rakhshani , Lhassane Idoumghar , Julien Lepagnot , Mathieu Brevilliers , Edward Keedwell

This paper introduces a structured, adaptive-length deep representation called Neural Eigenmap. Unlike prior spectral methods such as Laplacian Eigenmap that operate in a nonparametric manner, Neural Eigenmap leverages NeuralEF to…

Machine Learning · Computer Science 2023-12-11 Zhijie Deng , Jiaxin Shi , Hao Zhang , Peng Cui , Cewu Lu , Jun Zhu

We propose a multi-step training method for designing generalized linear classifiers. First, an initial multi-class linear classifier is found through regression. Then validation error is minimized by pruning of unnecessary inputs.…

Machine Learning · Computer Science 2023-12-15 Kanishka Tyagi , Chinmay Rane , Michael Manry

Conventionally, autoencoders are unsupervised representation learning tools. In this work, we propose a novel discriminative autoencoder. Use of supervised discriminative learning ensures that the learned representation is robust to…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Anupriya Gogna , Angshul Majumdar

Automated decision-making is becoming key for automated characterization including electron and scanning probe microscopies and nano indentation. Most machine learning driven workflows optimize a single predefined objective and tend to…

Materials Science · Physics 2026-04-07 Kamyar Barakati , Boris N. Slautin , Utkarsh Pratiush , Hiroshi Funakubo , Sergei V. Kalinin