English
Related papers

Related papers: Learning Versatile Neural Architectures by Propaga…

200 papers

Convolutional neural networks (CNNs) are vulnerable to adversarial examples, and studies show that increasing the model capacity of an architecture topology (e.g., width expansion) can bring consistent robustness improvements. This reveals…

Artificial Intelligence · Computer Science 2021-03-30 Xuefei Ning , Junbo Zhao , Wenshuo Li , Tianchen Zhao , Yin Zheng , Huazhong Yang , Yu Wang

In this paper, we propose a new neural architecture search (NAS) problem of Symmetric Positive Definite (SPD) manifold networks, aiming to automate the design of SPD neural architectures. To address this problem, we first introduce a…

Machine Learning · Computer Science 2021-06-15 Rhea Sanjay Sukthanker , Zhiwu Huang , Suryansh Kumar , Erik Goron Endsjo , Yan Wu , Luc Van Gool

The recent progress of deep convolutional neural networks has enabled great success in single image super-resolution (SISR) and many other vision tasks. Their performances are also being increased by deepening the networks and developing…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Joon Young Ahn , Nam Ik Cho

We present a neural architecture search (NAS) technique to enhance the performance of unsupervised image de-noising, in-painting and super-resolution under the recently proposed Deep Image Prior (DIP). We show that evolutionary search can…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Kary Ho , Andrew Gilbert , Hailin Jin , John Collomosse

In this work, we employ neural architecture search (NAS) to enhance the efficiency of deploying diverse machine learning (ML) tasks on in-memory computing (IMC) architectures. Initially, we design three fundamental components inspired by…

Machine Learning · Computer Science 2024-06-12 Md Hasibul Amin , Mohammadreza Mohammadi , Ramtin Zand

Neural Architecture Search (NAS) aims to optimize deep neural networks' architecture for better accuracy or smaller computational cost and has recently gained more research interests. Despite various successful approaches proposed to solve…

Machine Learning · Computer Science 2020-11-03 Bas van Stein , Hao Wang , Thomas Bäck

In the field of complex action recognition in videos, the quality of the designed model plays a crucial role in the final performance. However, artificially designed network structures often rely heavily on the researchers' knowledge and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Pengzhen Ren , Gang Xiao , Xiaojun Chang , Yun Xiao , Zhihui Li , Xiaojiang Chen

In recent years, Convolutional Neural Networks (CNNs), MLP-mixers, and Vision Transformers have risen to prominence as leading neural architectures in image classification. Prior research has underscored the distinct advantages of each…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Mk Bashar , Ocean Monjur , Samia Islam , Mohammad Galib Shams , Niamul Quader

Similarity-preserving hashing is a widely-used method for nearest neighbour search in large-scale image retrieval tasks. For most existing hashing methods, an image is first encoded as a vector of hand-engineering visual features, followed…

Computer Vision and Pattern Recognition · Computer Science 2019-08-17 Hanjiang Lai , Yan Pan , Ye Liu , Shuicheng Yan

Despite the success of recent Neural Architecture Search (NAS) methods on various tasks which have shown to output networks that largely outperform human-designed networks, conventional NAS methods have mostly tackled the optimization of…

Machine Learning · Computer Science 2021-07-05 Hayeon Lee , Eunyoung Hyung , Sung Ju Hwang

Architecture search is the process of automatically learning the neural model or cell structure that best suits the given task. Recently, this approach has shown promising performance improvements (on language modeling and image…

Computation and Language · Computer Science 2019-06-13 Ramakanth Pasunuru , Mohit Bansal

Deep learning based decoding networks have shown significant improvement in decoding LDPC codes, but the neural decoders are limited by rate-matching operations such as puncturing or extending, thus needing to train multiple decoders with…

Signal Processing · Electrical Eng. & Systems 2023-10-11 Yukun Cheng , Wei Chen , Lun Li , Bo Ai

Neural Architecture Search (NAS) enabled the discovery of state-of-the-art architectures in many domains. However, the success of NAS depends on the definition of the search space. Current search spaces are defined as a static sequence of…

Machine Learning · Computer Science 2019-08-01 Stanisław Jastrzębski , Quentin de Laroussilhe , Mingxing Tan , Xiao Ma , Neil Houlsby , Andrea Gesmundo

Early neural network architectures were designed by so-called "grad student descent". Since then, the field of Neural Architecture Search (NAS) has developed with the goal of algorithmically designing architectures tailored for a dataset of…

Machine Learning · Computer Science 2019-11-14 Sam Green , Craig M. Vineyard , Ryan Helinski , Çetin Kaya Koç

Neural Architecture Search (NAS) yields state-of-the-art neural networks that outperform their best manually-designed counterparts. However, previous NAS methods search for architectures under one set of training hyper-parameters (i.e., a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Xiaoliang Dai , Alvin Wan , Peizhao Zhang , Bichen Wu , Zijian He , Zhen Wei , Kan Chen , Yuandong Tian , Matthew Yu , Peter Vajda , Joseph E. Gonzalez

Panoptic segmentation is posed as a new popular test-bed for the state-of-the-art holistic scene understanding methods with the requirement of simultaneously segmenting both foreground things and background stuff. The state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Yangxin Wu , Gengwei Zhang , Hang Xu , Xiaodan Liang , Liang Lin

Neural architecture search automates neural network design and has achieved state-of-the-art results in many deep learning applications. While recent literature has focused on designing networks to maximize accuracy, little work has been…

Machine Learning · Computer Science 2021-09-28 Keith G. Mills , Fred X. Han , Jialin Zhang , Seyed Saeed Changiz Rezaei , Fabian Chudak , Wei Lu , Shuo Lian , Shangling Jui , Di Niu

Neural Architecture Search (NAS) is an open and challenging problem in machine learning. While NAS offers great promise, the prohibitive computational demand of most of the existing NAS methods makes it difficult to directly search the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-15 Rameswar Panda , Michele Merler , Mayoore Jaiswal , Hui Wu , Kandan Ramakrishnan , Ulrich Finkler , Chun-Fu Chen , Minsik Cho , David Kung , Rogerio Feris , Bishwaranjan Bhattacharjee

A myriad of recent breakthroughs in hand-crafted neural architectures for visual recognition have highlighted the urgent need to explore hybrid architectures consisting of diversified building blocks. Meanwhile, neural architecture search…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Changlin Li , Tao Tang , Guangrun Wang , Jiefeng Peng , Bing Wang , Xiaodan Liang , Xiaojun Chang

Neural architecture search (NAS) proves to be among the effective approaches for many tasks by generating an application-adaptive neural architecture, which is still challenged by high computational cost and memory consumption. At the same…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Yanjing Li , Sheng Xu , Xianbin Cao , Li'an Zhuo , Baochang Zhang , Tian Wang , Guodong Guo