English
Related papers

Related papers: JANUS: Parallel Tempered Genetic Algorithm Guided …

200 papers

Practical use of neural networks often involves requirements on latency, energy and memory among others. A popular approach to find networks under such requirements is through constrained Neural Architecture Search (NAS). However, previous…

Machine Learning · Computer Science 2022-04-28 Niv Nayman , Yonathan Aflalo , Asaf Noy , Rong Jin , Lihi Zelnik-Manor

Conventional meta-atom designs rely heavily on researchers' prior knowledge and trial-and-error searches using full-wave simulations, resulting in time-consuming and inefficient processes. Inverse design methods based on optimization…

Machine Learning · Computer Science 2023-12-11 Zezhou Zhang , Chuanchuan Yang , Yifeng Qin , Hao Feng , Jiqiang Feng , Hongbin Li

The performance of a deep neural network is heavily dependent on its architecture and various neural architecture search strategies have been developed for automated network architecture design. Recently, evolutionary neural architecture…

Neural and Evolutionary Computing · Computer Science 2020-03-27 Haoyu Zhang , Yaochu Jin , Ran Cheng , Kuangrong Hao

Foundation models and their checkpoints have significantly advanced deep learning, boosting performance across various applications. However, fine-tuned models often struggle outside their specific domains and exhibit considerable…

This paper introduces Evolutionary Multi-Objective Network Architecture Search (EMNAS) for the first time to optimize neural network architectures in large-scale Reinforcement Learning (RL) for Autonomous Driving (AD). EMNAS uses genetic…

Machine Learning · Computer Science 2025-06-11 Nihal Acharya Adde , Alexandra Gianzina , Hanno Gottschalk , Andreas Ebert

This project explores adversarial training techniques to develop fairer Deep Neural Networks (DNNs) to mitigate the inherent bias they are known to exhibit. DNNs are susceptible to inheriting bias with respect to sensitive attributes such…

Machine Learning · Computer Science 2024-01-05 Allen Minch , Hung Anh Vu , Anne Marie Warren

Deep neural networks are getting larger. Their implementation on edge and IoT devices becomes more challenging and moved the community to design lighter versions with similar performance. Standard automatic design tools such as…

Machine Learning · Statistics 2023-01-18 Dounia Lakhmiri , Mahdi Zolnouri , Vahid Partovi Nia , Christophe Tribes , Sébastien Le Digabel

With the development of fast and massively parallel evaluations in many domains, Quality-Diversity (QD) algorithms, that already proved promising in a large range of applications, have seen their potential multiplied. However, we have yet…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Manon Flageat , Bryan Lim , Antoine Cully

Evolutionary neural architecture search (ENAS) employs evolutionary algorithms to find high-performing neural architectures automatically, and has achieved great success. However, compared to the empirical success, its rigorous theoretical…

Neural and Evolutionary Computing · Computer Science 2024-04-09 Zeqiong Lv , Chao Qian , Yanan Sun

Recent advances in adversarial attacks show the vulnerability of deep neural networks searched by Neural Architecture Search (NAS). Although NAS methods can find network architectures with the state-of-the-art performance, the adversarial…

Machine Learning · Computer Science 2020-11-20 Zhixiong Yue , Baijiong Lin , Xiaonan Huang , Yu Zhang

Recently, increasing works have proposed to drive evolutionary algorithms using machine learning models. Usually, the performance of such model based evolutionary algorithms is highly dependent on the training qualities of the adopted…

Neural and Evolutionary Computing · Computer Science 2020-05-12 Cheng He , Shihua Huang , Ran Cheng , Kay Chen Tan , Yaochu Jin

Business research practice is witnessing a surge in the integration of predictive modeling and prescriptive analysis. We describe a modeling framework JANOS that seamlessly integrates the two streams of analytics, for the first time…

Machine Learning · Computer Science 2019-11-22 David Bergman , Teng Huang , Philip Brooks , Andrea Lodi , Arvind U. Raghunathan

Computer-aided molecular design (CAMD) studies quantitative structure-property relationships and discovers desired molecules using optimization algorithms. With the emergence of machine learning models, CAMD score functions may be replaced…

Computational Engineering, Finance, and Science · Computer Science 2023-12-07 Shiqiang Zhang , Juan S. Campos , Christian Feldmann , Frederik Sandfort , Miriam Mathea , Ruth Misener

Gene selection plays a pivotal role in oncology research for improving outcome prediction accuracy and facilitating cost-effective genomic profiling for cancer patients. This paper introduces two gene selection strategies for deep…

Genomics · Quantitative Biology 2024-03-05 Akhila Krishna , Ravi Kant Gupta , Pranav Jeevan , Amit Sethi

Neural Architecture Search (NAS) that aims to automate the procedure of architecture design has achieved promising results in many computer vision fields. In this paper, we propose an AdversarialNAS method specially tailored for Generative…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Chen Gao , Yunpeng Chen , Si Liu , Zhenxiong Tan , Shuicheng Yan

Despite the empirical success of neural architecture search (NAS) in deep learning applications, the optimality, reproducibility and cost of NAS schemes remain hard to assess. In this paper, we propose Generative Adversarial NAS (GA-NAS)…

Machine Learning · Computer Science 2021-06-24 Seyed Saeed Changiz Rezaei , Fred X. Han , Di Niu , Mohammad Salameh , Keith Mills , Shuo Lian , Wei Lu , Shangling Jui

Latent factor models are the driving forces of the state-of-the-art recommender systems, with an important insight of vectorizing raw input features into dense embeddings. The dimensions of different feature embeddings are often set to a…

Machine Learning · Computer Science 2020-09-11 Weiyu Cheng , Yanyan Shen , Linpeng Huang

Efficient Natural Evolution Strategies (eNES) is a novel alternative to conventional evolutionary algorithms, using the natural gradient to adapt the mutation distribution. Unlike previous methods based on natural gradients, eNES uses a…

Artificial Intelligence · Computer Science 2012-09-27 Yi Sun , Daan Wierstra , Tom Schaul , Juergen Schmidhuber

There has been a surge in optimizing edge Deep Neural Networks (DNNs) for accuracy and efficiency using traditional optimization techniques such as pruning, and more recently, employing automatic design methodologies. However, the focus of…

Machine Learning · Computer Science 2025-02-12 Lotfi Abdelkrim Mecharbat , Alberto Marchisio , Muhammad Shafique , Mohammad M. Ghassemi , Tuka Alhanai

The effectiveness of a new algorithm, parallel tempering, is studied for numerical simulations of biological molecules. These molecules suffer from a rough energy landscape. The resulting slowing down in numerical simulations is overcome by…

Chemical Physics · Physics 2009-10-30 Ulrich H. E. Hansmann