English
Related papers

Related papers: Autonomously and Simultaneously Refining Deep Neur…

200 papers

Research on generalization bounds for deep networks seeks to give ways to predict test error using just the training dataset and the network parameters. While generalization bounds can give many insights about architecture design, training…

Machine Learning · Computer Science 2022-03-21 Yi Zhang , Arushi Gupta , Nikunj Saunshi , Sanjeev Arora

Machine learning algorithms are used in diverse domains, many of which face significant challenges due to data imbalance. Studies have explored various approaches to address the issue, like data preprocessing, cost-sensitive learning, and…

Artificial Intelligence · Computer Science 2025-02-25 Pankaj Yadav , Gulshan Sihag , Vivek Vijay

In recent years, generative adversarial networks (GANs) have made significant progress in generating audio sequences. However, these models typically rely on bandwidth-limited mel-spectrograms, which constrain the resolution of generated…

Sound · Computer Science 2025-05-15 Zeeshan Ahmad , Shudi Bao , Meng Chen

Learning agents can make use of Reinforcement Learning (RL) to decide their actions by using a reward function. However, the learning process is greatly influenced by the elect of values of the hyperparameters used in the learning…

Robotics · Computer Science 2022-11-03 Adarsh Sehgal , Nicholas Ward , Hung La , Sushil Louis

Generative Adversarial Networks (GANs) are proficient at generating synthetic data but continue to suffer from mode collapse, where the generator produces a narrow range of outputs that fool the discriminator but fail to capture the full…

Machine Learning · Computer Science 2025-11-03 Mahsa Valizadeh , Rui Tuo , James Caverlee

Graph representation learning aims to encode all nodes of a graph into low-dimensional vectors that will serve as input of many compute vision tasks. However, most existing algorithms ignore the existence of inherent data distribution and…

Machine Learning · Computer Science 2020-08-04 Shuai Zheng , Zhenfeng Zhu , Xingxing Zhang , Zhizhe Liu , Jian Cheng , Yao Zhao

Tuning curves characterizing the response selectivities of biological neurons often exhibit large degrees of irregularity and diversity across neurons. Theoretical network models that feature heterogeneous cell populations or random…

Quantitative Methods · Quantitative Biology 2017-07-20 Takafumi Arakaki , G. Barello , Yashar Ahmadian

Hashing has been a widely-adopted technique for nearest neighbor search in large-scale image retrieval tasks. Recent research has shown that leveraging supervised information can lead to high quality hashing. However, the cost of annotating…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Zhaofan Qiu , Yingwei Pan , Ting Yao , Tao Mei

The ability to design complex neural network architectures which enable effective training by stochastic gradient descent has been the key for many achievements in the field of deep learning. However, developing such architectures remains a…

Neural and Evolutionary Computing · Computer Science 2019-07-04 Marcus Märtens , Dario Izzo

Generative adversarial networks (GAN) have recently been shown to be efficient for speech enhancement. However, most, if not all, existing speech enhancement GANs (SEGAN) make use of a single generator to perform one-stage enhancement…

Machine Learning · Computer Science 2020-10-28 Huy Phan , Ian V. McLoughlin , Lam Pham , Oliver Y. Chén , Philipp Koch , Maarten De Vos , Alfred Mertins

This paper proposes a novel meta-learning based hyper-parameter optimization framework for wireless network traffic prediction (NTP) models. The primary objective is to accumulate and leverage the acquired hyper-parameter optimization…

Networking and Internet Architecture · Computer Science 2025-05-06 Liangzhi Wang , Jie Zhang , Yuan Gao , Jiliang Zhang , Guiyi Wei , Haibo Zhou , Bin Zhuge , Zitian Zhang

Deep neural network-based architectures give promising results in various domains including pattern recognition. Finding the optimal combination of the hyper-parameters of such a large-sized architecture is tedious and requires a large…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Animesh Singh , Sandip Saha , Ritesh Sarkhel , Mahantapas Kundu , Mita Nasipuri , Nibaran Das

In this paper, we introduce a novel method for merging the weights of multiple pre-trained neural networks using a genetic algorithm called MeGA. Traditional techniques, such as weight averaging and ensemble methods, often fail to fully…

Neural and Evolutionary Computing · Computer Science 2024-07-01 Daniel Yun

While a multitude of studies have been conducted on graph drawing, many existing methods only focus on optimizing a single aesthetic aspect of graph layouts, which can lead to sub-optimal results. There are a few existing methods that have…

Machine Learning · Computer Science 2023-08-15 Xiaoqi Wang , Kevin Yen , Yifan Hu , Han-Wei Shen

Deep neural networks (DNNs) are vulnerable to adversarial examples, which are crafted by adding imperceptible perturbations to inputs. Recently different attacks and strategies have been proposed, but how to generate adversarial examples…

Machine Learning · Computer Science 2021-01-13 Tao Bai , Jun Zhao , Jinlin Zhu , Shoudong Han , Jiefeng Chen , Bo Li , Alex Kot

We propose a new approach to train the Generative Adversarial Nets (GANs) with a mixture of generators to overcome the mode collapsing problem. The main intuition is to employ multiple generators, instead of using a single one as in the…

Machine Learning · Computer Science 2017-10-31 Quan Hoang , Tu Dinh Nguyen , Trung Le , Dinh Phung

Generative Adversarial Networks (GANs) is a novel class of deep generative models which has recently gained significant attention. GANs learns complex and high-dimensional distributions implicitly over images, audio, and data. However,…

Machine Learning · Computer Science 2023-04-06 Divya Saxena , Jiannong Cao

Estimation of Distribution Algorithms (EDAs) require flexible probability models that can be efficiently learned and sampled. Generative Adversarial Networks (GAN) are generative neural networks which can be trained to implicitly model the…

Neural and Evolutionary Computing · Computer Science 2016-08-09 Malte Probst

Dual discriminator generative adversarial networks (D2 GANs) were introduced to mitigate the problem of mode collapse in generative adversarial networks. In D2 GANs, two discriminators are employed alongside a generator: one discriminator…

Machine Learning · Computer Science 2025-07-24 Penukonda Naga Chandana , Tejas Srivastava , Gowtham R. Kurri , V. Lalitha

Deep learning techniques play an increasingly important role in industrial and research environments due to their outstanding results. However, the large number of hyper-parameters to be set may lead to errors if they are set manually. The…

Machine Learning · Computer Science 2020-06-04 Michele Fraccaroli , Evelina Lamma , Fabrizio Riguzzi