English
Related papers

Related papers: Concurrent Neural Tree and Data Preprocessing Auto…

200 papers

Automated machine learning (AutoML) and deep learning (DL) are two cutting-edge paradigms used to solve a myriad of inductive learning tasks. In spite of their successes, little guidance exists for when to choose one approach over the other…

Machine Learning · Computer Science 2021-10-25 Joseph D. Romano , Trang T. Le , Weixuan Fu , Jason H. Moore

Early advancements in convolutional neural networks (CNNs) architectures are primarily driven by human expertise and by elaborate design processes. Recently, neural architecture search was proposed with the aim of automating the network…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Zhichao Lu , Ian Whalen , Yashesh Dhebar , Kalyanmoy Deb , Erik Goodman , Wolfgang Banzhaf , Vishnu Naresh Boddeti

Deep neural networks achieve remarkable performance in many computer vision tasks. Most state-of-the-art (SOTA) semantic segmentation and object detection approaches reuse neural network architectures designed for image classification as…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Jiemin Fang , Yuzhu Sun , Qian Zhang , Kangjian Peng , Yuan Li , Wenyu Liu , Xinggang Wang

A classical approach to designing binary image operators is Mathematical Morphology (MM). We propose the Discrete Morphological Neural Networks (DMNN) for binary image analysis to represent W-operators and estimate them via machine…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Diego Marcondes , Junior Barrera

Machine learning research has advanced in multiple aspects, including model structures and learning methods. The effort to automate such research, known as AutoML, has also made significant progress. However, this progress has largely…

Machine Learning · Computer Science 2020-07-01 Esteban Real , Chen Liang , David R. So , Quoc V. Le

Neural networks and deep learning are changing the way that artificial intelligence is being done. Efficiently choosing a suitable network architecture and fine-tune its hyper-parameters for a specific dataset is a time-consuming task given…

Machine Learning · Computer Science 2019-05-16 David Laredo , Yulin Qin , Oliver Schütze , Jian-Qiao Sun

Diffractive neural networks leverage the high-dimensional characteristics of electromagnetic (EM) fields for high-throughput computing. However, the existing architectures face challenges in integrating large-scale multidimensional…

Optics · Physics 2025-09-09 Songtao Yang , Sheng Gao , Chu Wu , Zejia Zhao , Haiou Zhang , Xing Lin

Parameterizable machine learning (ML) accelerators are the product of recent breakthroughs in ML. To fully enable their design space exploration (DSE), we propose a physical-design-driven, learning-based prediction framework for…

The common pipeline of training deep neural networks consists of several building blocks such as data augmentation and network architecture selection. AutoML is a research field that aims at automatically designing those parts, but most…

Machine Learning · Computer Science 2021-01-13 Taiga Kashima , Yoshihiro Yamada , Shunta Saito

An important goal of AutoML is to automate-away the design of neural networks on new tasks in under-explored domains. Motivated by this goal, we study the problem of enabling users to discover the right neural operations given data from…

Machine Learning · Computer Science 2021-11-05 Nicholas Roberts , Mikhail Khodak , Tri Dao , Liam Li , Christopher Ré , Ameet Talwalkar

Deep neural networks (DNNs) have been shown to outperform conventional machine learning algorithms across a wide range of applications, e.g., image recognition, object detection, robotics, and natural language processing. However, the high…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-23 Ye Yu , Yingmin Li , Shuai Che , Niraj K. Jha , Weifeng Zhang

There have been attempts to insert mathematical morphology (MM) operators into convolutional neural networks (CNN), and the most successful endeavor to date has been the morphological neural networks (MNN). Although MNN have performed…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Diego Marcondes , Mariana Feldman , Junior Barrera

The exponential growth in the number of complex datasets every year requires more enhancement in machine learning methods to provide robust and accurate data classification. Lately, deep learning approaches have achieved surpassing results…

Machine Learning · Computer Science 2018-10-22 Mojtaba Heidarysafa , Kamran Kowsari , Donald E. Brown , Kiana Jafari Meimandi , Laura E. Barnes

Automated machine learning (AutoML) methods improve upon existing models by optimizing various aspects of their design. While present methods focus on hyperparameters and neural network topologies, other aspects of neural network design can…

Machine Learning · Computer Science 2023-04-10 Garrett Bingham

The automation of neural architecture design has been a coveted alternative to human experts. Recent works have small search space, which is easier to optimize but has a limited upper bound of the optimal solution. Extra human design is…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Yuanzheng Ci , Chen Lin , Ming Sun , Boyu Chen , Hongwen Zhang , Wanli Ouyang

Utilizing machine learning techniques has always required choosing hyperparameters. This is true whether one uses a classical technique such as a KNN or very modern neural networks such as Deep Learning. Though in many applications,…

Machine Learning · Computer Science 2024-12-12 Edward Ratner , Elliot Farmer , Brandon Warner , Christopher Douglas , Amaury Lendasse

Much research work in computer vision is being spent on optimizing existing network architectures to obtain a few more percentage points on benchmarks. Recent AutoML approaches promise to relieve us from this effort. However, they are…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Tonmoy Saikia , Yassine Marrakchi , Arber Zela , Frank Hutter , Thomas Brox

Recently, deep neural networks (DNNs) have shown advantages in accelerating optimization algorithms. One approach is to unfold finite number of iterations of conventional optimization algorithms and to learn parameters in the algorithms.…

Machine Learning · Computer Science 2021-04-23 Byung Hyun Lee , Se Young Chun

Deep neural networks have gained great success due to the increasing amounts of data, and diverse effective neural network designs. However, it also brings a heavy computing burden as the amount of training data is proportional to the…

Machine Learning · Computer Science 2023-10-19 Peng Yao , Chao Liao , Jiyuan Jia , Jianchao Tan , Bin Chen , Chengru Song , Di Zhang

Recent years have witnessed tremendously improved efficiency of Automated Machine Learning (AutoML), especially Automated Deep Learning (AutoDL) systems, but recent work focuses on tabular, image, or NLP tasks. So far, little attention has…

Machine Learning · Computer Science 2022-07-25 Difan Deng , Florian Karl , Frank Hutter , Bernd Bischl , Marius Lindauer