中文
相关论文

相关论文: NASiam: Efficient Representation Learning using Ne…

200 篇论文

We present neural activation coding (NAC) as a novel approach for learning deep representations from unlabeled data for downstream applications. We argue that the deep encoder should maximize its nonlinear expressivity on the data for…

机器学习 · 计算机科学 2021-12-09 Yookoon Park , Sangho Lee , Gunhee Kim , David M. Blei

To preserve user privacy while enabling mobile intelligence, techniques have been proposed to train deep neural networks on decentralized data. However, training over decentralized data makes the design of neural architecture quite…

机器学习 · 计算机科学 2022-07-07 Jinliang Yuan , Mengwei Xu , Yuxin Zhao , Kaigui Bian , Gang Huang , Xuanzhe Liu , Shangguang Wang

Deep learning-based super-resolution (SR) has gained tremendous popularity in recent years because of its high image quality performance and wide application scenarios. However, prior methods typically suffer from large amounts of…

计算机视觉与模式识别 · 计算机科学 2022-07-27 Yushu Wu , Yifan Gong , Pu Zhao , Yanyu Li , Zheng Zhan , Wei Niu , Hao Tang , Minghai Qin , Bin Ren , Yanzhi Wang

Neural Architecture Search (NAS) methods have been shown to outperform hand-designed models and help to democratize AI. However, NAS methods often start from scratch with each new task, making them computationally expensive and limiting…

机器学习 · 计算机科学 2025-07-15 Prabhant Singh , Joaquin Vanschoren

Typically, deep learning architectures are handcrafted for their respective learning problem. As an alternative, neural architecture search (NAS) has been proposed where the architecture's structure is learned in an additional optimization…

图像与视频处理 · 电气工程与系统科学 2019-07-29 Nils Gessert , Alexander Schlaefer

A myriad of recent breakthroughs in hand-crafted neural architectures for visual recognition have highlighted the urgent need to explore hybrid architectures consisting of diversified building blocks. Meanwhile, neural architecture search…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Changlin Li , Tao Tang , Guangrun Wang , Jiefeng Peng , Bing Wang , Xiaodan Liang , Xiaojun Chang

Recently, predictor-based algorithms emerged as a promising approach for neural architecture search (NAS). For NAS, we typically have to calculate the validation accuracy of a large number of Deep Neural Networks (DNNs), what is…

The significant computational cost of multiplications hinders the deployment of deep neural networks (DNNs) on edge devices. While multiplication-free models offer enhanced hardware efficiency, they typically sacrifice accuracy. As a…

机器学习 · 计算机科学 2024-09-10 Yang Xu , Huihong Shi , Zhongfeng Wang

The state-of-the-art object detection method is complicated with various modules such as backbone, feature fusion neck, RPN and RCNN head, where each module may have different designs and structures. How to leverage the computational cost…

计算机视觉与模式识别 · 计算机科学 2019-12-03 Lewei Yao , Hang Xu , Wei Zhang , Xiaodan Liang , Zhenguo Li

Convolutional Neural Networks (CNNs) continue to achieve great success in classification tasks as innovative techniques and complex multi-path architecture topologies are introduced. Neural Architecture Search (NAS) aims to automate the…

神经与进化计算 · 计算机科学 2023-12-14 Trevor Londt , Xiaoying Gao , Peter Andreae , Yi Mei

The architectural advancements in deep neural networks have led to remarkable leap-forwards across a broad array of computer vision tasks. Instead of relying on human expertise, neural architecture search (NAS) has emerged as a promising…

计算机视觉与模式识别 · 计算机科学 2022-08-16 Zhichao Lu , Ran Cheng , Shihua Huang , Haoming Zhang , Changxiao Qiu , Fan Yang

Hyperspectral images involve abundant spectral and spatial information, playing an irreplaceable role in land-cover classification. Recently, based on deep learning technologies, an increasing number of HSI classification approaches have…

计算机视觉与模式识别 · 计算机科学 2022-02-16 Haokui Zhang , Chengrong Gong , Yunpeng Bai , Zongwen Bai , Ying Li

Recently, Neural Architecture Search (NAS) methods are introduced and show impressive performance on many benchmarks. Among those NAS studies, Neural Architecture Transformer (NAT) aims to improve the given neural architecture to have…

机器学习 · 计算机科学 2021-10-20 Do-Guk Kim , Heung-Chang Lee

Neural architecture search (NAS) has recently reshaped our understanding on various vision tasks. Similar to the success of NAS in high-level vision tasks, it is possible to find a memory and computationally efficient solution via NAS with…

图像与视频处理 · 电气工程与系统科学 2021-04-07 Qian Ning , Weisheng Dong , Xin Li , Jinjian Wu , Leida Li , Guangming Shi

Neural Architecture Search (NAS) is an important yet challenging task in network design due to its high computational consumption. To address this issue, we propose the Reinforced Evolutionary Neural Architecture Search (RE- NAS), which is…

神经与进化计算 · 计算机科学 2019-04-11 Yukang Chen , Gaofeng Meng , Qian Zhang , Shiming Xiang , Chang Huang , Lisen Mu , Xinggang Wang

Neural Architectures Search (NAS) becomes more and more popular over these years. However, NAS-generated models tends to suffer greater vulnerability to various malicious attacks. Lots of robust NAS methods leverage adversarial training to…

机器学习 · 计算机科学 2023-04-11 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang

Recent works in single-image perceptual super-resolution (SR) have demonstrated unprecedented performance in generating realistic textures by means of deep convolutional networks. However, these convolutional models are excessively large…

图像与视频处理 · 电气工程与系统科学 2020-07-10 Royson Lee , Łukasz Dudziak , Mohamed Abdelfattah , Stylianos I. Venieris , Hyeji Kim , Hongkai Wen , Nicholas D. Lane

Neural Architecture Search (NAS) is a collection of methods to craft the way neural networks are built. We apply this idea to Federated Learning (FL), wherein predefined neural network models are trained on the client/device data. This…

机器学习 · 计算机科学 2020-10-21 Anubhav Garg , Amit Kumar Saha , Debo Dutta

Recent works show that convolutional neural network (CNN) architectures have a spectral bias towards lower frequencies, which has been leveraged for various image restoration tasks in the Deep Image Prior (DIP) framework. The benefit of the…

计算机视觉与模式识别 · 计算机科学 2022-03-31 Metin Ersin Arican , Ozgur Kara , Gustav Bredell , Ender Konukoglu

Evolutionary Neural Architecture Search (ENAS) has gained attention for automatically designing neural network architectures. Recent studies use a neural predictor to guide the process, but the high computational costs of gathering training…

神经与进化计算 · 计算机科学 2026-02-05 Xian-Rong Zhang , Yue-Jiao Gong , Wei-Neng Chen , Jun Zhang