AutoML.org

Freiburg-Hannover

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


1497 entries « 28 of 30 »

2019

147.

Kokiopoulou, Efi; Hauth, Anja; Sbaiz, Luciano; Gesmundo, Andrea; Bartók, Gábor; Berent, Jesse

Fast Task-Aware Architecture Inference Technical Report

, 2019.

Links | BibTeX

146.

Ororbia, Alexander; ElSaid, AbdElRahman A; Desell, Travis

Investigating recurrent neural network memory structures using neuro-evolution Inproceedings

In: pp. 446-455, 2019.

Links | BibTeX

145.

Jiang, Weiwen; Zhang, Xinyi; Sha, Edwin Hsing-Mean; Yang, Lei; Zhuge, Qingfeng; Shi, Yiyu; Hu, Jingtong

Accuracy vs Efficiency - Achieving Both through FPGA-Implementation Aware Neural Architecture Search Inproceedings

In: pp. 5, 2019.

Links | BibTeX

144.

So, David R; Le, Quoc V; Liang, Chen

The Evolved Transformer Inproceedings

In: pp. 5877-5886, 2019.

Links | BibTeX

143.

Zhang, Tian; Wang, Jia; Dan, Yihang; Lanqiu, Yuxiang; Dai, Jian; Han, Xu; Sun, Xiaojuan; Xu, Kun

Efficient training and design of photonic neural network through neuroevolution Technical Report

2019.

Links | BibTeX

142.

Sood, Atin; Elder, Benjamin; Herta, Benjamin; Xue, Chao; Bekas, Costas; Malossi, Cristiano A I; Saha, Debashish; Scheidegger, Florian; Venkataraman, Ganesh; Thomas, Gegi; Mariani, Giovanni; Strobelt, Hendrik; Samulowitz, Horst; Wistuba, Martin; Manica, Matteo; Choudhury, Mihir R; Yan, Rong; Istrate, Roxana; Puri, Ruchir; Pedapati, Tejaswini

NeuNetS - An Automated Synthesis Engine for Neural Network Design Technical Report

, 2019.

Links | BibTeX

141.

Chu, Xiangxiang; Zhang, Bo; Ma, Hailong; Xu, Ruijun; Li, Jixiang; Li, Qingyuan

Fast, Accurate and Lightweight Super-Resolution with Neural Architecture Search Technical Report

, 2019.

Links | BibTeX

140.

Fang, Jiemin; Chen, Yukang; Zhang, Xinbang; Zhang, Qian; Huang, Chang; Meng, Gaofeng; Liu, Wenyu; Wang, Xinggang

EAT-NAS - Elastic Architecture Transfer for Accelerating Large-scale Neural Architecture Search Technical Report

, 2019.

Links | BibTeX

139.

Dikov, Georgi; Bayer, Justin

Bayesian Learning of Neural Network Architectures Inproceedings

In: pp. 730-738, 2019.

Links | BibTeX

138.

Liu, Chenxi; Chen, Liang-Chieh; Schroff, Florian; Adam, Hartwig; Hua, Wei; Yuille, Alan L; Li, Fei-Fei

Auto-DeepLab - Hierarchical Neural Architecture Search for Semantic Image Segmentation Inproceedings

In: pp. 82-92, 2019.

Links | BibTeX

137.

Mammadli, Rahim; Wolf, Felix; Jannesari, Ali

The Art of Getting Deep Neural Networks in Shape Journal Article

In: 15 (4), pp. 62:1-62:21, 2019.

Links | BibTeX

136.

Xie, Sirui; Zheng, Hehui; Liu, Chunxiao; Lin, Liang

SNAS - stochastic neural architecture search Inproceedings

In: 2019.

Links | BibTeX

135.

Zhang, Chris; Ren, Mengye; Urtasun, Raquel

Graph HyperNetworks for Neural Architecture Search Inproceedings

In: 2019.

Links | BibTeX

134.

Elsken, Thomas; Metzen, Jan Hendrik; Hutter, Frank

Efficient Multi-Objective Neural Architecture Search via Lamarckian Evolution Inproceedings

In: 2019.

Links | BibTeX

133.

Yang, Sen; Yang, Wankou; Cui, Zhen

Pose Neural Fabrics Search Technical Report

2019.

Links | BibTeX

132.

Dai, Xiaoliang; Zhang, Peizhao; Wu, Bichen; Yin, Hongxu; Sun, Fei; Wang, Yanghan; Dukhan, Marat; Hu, Yunqing; Wu, Yiming; Jia, Yangqing; Vajda, Peter; Uyttendaele, Matt; Jha, Niraj K

ChamNet - Towards Efficient Network Design Through Platform-Aware Model Adaptation Inproceedings

In: pp. 11398-11407, 2019.

Links | BibTeX

131.

van Wyk, Gerard Jacques; Bosman, Anna Sergeevna

Evolutionary Neural Architecture Search for Image Restoration Inproceedings

In: pp. 1-8, 2019.

Links | BibTeX

130.

Guo, Minghao; Zhong, Zhao; Wu, Wei; Lin, Dahua; Yan, Junjie

IRLAS - Inverse Reinforcement Learning for Architecture Search Inproceedings

In: pp. 9021-9029, 2019.

Links | BibTeX

129.

Wu, Bichen; Dai, Xiaoliang; Zhang, Peizhao; Wang, Yanghan; Sun, Fei; Wu, Yiming; Tian, Yuandong; Vajda, Peter; Jia, Yangqing; Keutzer, Kurt

FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search Technical Report

2019.

Links | BibTeX

128.

Cai, Han; Zhu, Ligeng; Han, Song

ProxylessNAS - Direct Neural Architecture Search on Target Task and Hardware Inproceedings

In: 2019.

Links | BibTeX

127.

Cai, Lile; Barneche, Anne-Maelle; Herbout, Arthur; Foo, Chuan Sheng; Lin, Jie; Chandrasekhar, Vijay Ramaseshan; Aly, Mohamed Sabry M

TEA-DNN - the Quest for Time-Energy-Accuracy Co-optimized Deep Neural Networks Inproceedings

In: pp. 1-6, 2019.

Links | BibTeX

126.

Piergiovanni, A J; Angelova, Anelia; Toshev, Alexander; Ryoo, Michael S

Evolving Space-Time Neural Architectures for Videos Inproceedings

In: pp. 1793-1802, 2019.

Links | BibTeX

125.

Geifman, Yonatan; El-Yaniv, Ran

Deep Active Learning with a Neural Architecture Search Inproceedings

In: pp. 5974-5984, 2019.

Links | BibTeX

124.

Véniat, Tom; Schwander, Olivier; Denoyer, Ludovic

Stochastic Adaptive Neural Architecture Search for Keyword Spotting Inproceedings

In: pp. 2842-2846, 2019.

Links | BibTeX

123.

Hundt, Andrew; Jain, Varun; Lin, Chia-Hung; Paxton, Chris; Hager, Gregory D

The CoSTAR Block Stacking Dataset - Learning with Workspace Constraints Inproceedings

In: pp. 1797-1804, 2019.

Links | BibTeX

122.

Nekrasov, Vladimir; Chen, Hao; Shen, Chunhua; Reid, Ian D

Fast Neural Architecture Search of Compact Semantic Segmentation Models via Auxiliary Cells Inproceedings

In: pp. 9126-9135, 2019.

Links | BibTeX

121.

van Stein, Bas; Wang, Hao; Bäck, Thomas

Automatic Configuration of Deep Neural Networks with Parallel Efficient Global Optimization Inproceedings

In: pp. 1-7, 2019.

Links | BibTeX

120.

White, Colin; Neiswanger, Willie; Savani, Yash

BANANAS - Bayesian Optimization with Neural Architectures for Neural Architecture Search Technical Report

, 2019.

Links | BibTeX

119.

Wistuba, Martin; Rawat, Ambrish; Pedapati, Tejaswini

A Survey on Neural Architecture Search Technical Report

, 2019.

Links | BibTeX

118.

Chen, Yukang; Meng, Gaofeng; Zhang, Qian; Xiang, Shiming; Huang, Chang; Mu, Lisen; Wang, Xinggang

RENAS - Reinforced Evolutionary Neural Architecture Search Inproceedings

In: pp. 4787-4796, 2019.

Links | BibTeX

117.

Bashivan, Pouya; Tensen, Mark; DiCarlo, James J

Teacher Guided Architecture Search Inproceedings

In: pp. 5319-5328, 2019.

Links | BibTeX

116.

Tan, Mingxing; Chen, Bo; Pang, Ruoming; Vasudevan, Vijay; Sandler, Mark; Howard, Andrew; Le, Quoc V

MnasNet - Platform-Aware Neural Architecture Search for Mobile Inproceedings

In: pp. 2820-2828, 2019.

Links | BibTeX

115.

Istrate, Roxana; Scheidegger, Florian; Mariani, Giovanni; Nikolopoulos, Dimitrios S; Bekas, Constantine; Malossi, Adelmo Cristiano Innocenza

TAPAS - Train-Less Accuracy Predictor for Architecture Search Inproceedings

In: pp. 3927-3934, 2019.

Links | BibTeX

114.

Real, Esteban; Aggarwal, Alok; Huang, Yanping; Le, Quoc V

Regularized Evolution for Image Classifier Architecture Search Inproceedings

In: pp. 4780-4789, 2019.

Links | BibTeX

113.

Märtens, Marcus; Izzo, Dario

Neural network architecture search with differentiable cartesian genetic programming for regression Inproceedings

In: pp. 181-182, 2019.

Links | BibTeX

112.

Cao, Shengcao; Wang, Xiaofang; Kitani, Kris M

Learnable Embedding Space for Efficient Neural Architecture Compression Technical Report

2019.

Links | BibTeX

111.

Mendoza, Hector; Klein, Aaron; Feurer, Matthias; Springenberg, Jost Tobias; Urban, Matthias; Burkart, Michael; Dippel, Maximilian; Lindauer, Marius; Hutter, Frank

Towards Automatically-Tuned Deep Neural Networks Technical Report

2019.

Links | BibTeX

110.

Kwasigroch, Arkadiusz; Grochowski, Michal; Mikolajczyk, Mateusz

Deep neural network architecture search using network morphism Inproceedings

In: pp. 30-35, 2019.

Links | BibTeX

2018

109.

Lindqvist, Blerta; Sugrim, Shridatt; Izmailov, Rauf

AutoGAN: Robust Classifier Against Adversarial Attacks Technical Report

2018.

Links | BibTeX

108.

Sun, Man-Chin; Hsu, Shih-Huan; Yang, Min-Chun; Chien, Jen-Hsien

Context-aware Cascade Attention-based RNN for Video Emotion Recognition Technical Report

2018.

Links | BibTeX

107.

Ritter, Hippolyt; Botev, Aleksandar; Barber, David

Online Structured Laplace Approximations For Overcoming Catastrophic Forgetting Technical Report

2018.

Links | BibTeX

106.

Zhang, Honglei; Kiranyaz, Serkan; Gabbouj, Moncef

Finding Better Topologies for Deep Convolutional Neural Networks by Evolution Technical Report

2018.

Links | BibTeX

105.

Kandasamy, Kirthevasan; Neiswanger, Willie; Schneider, Jeff; Poczos, Barnabas; Xing, Eric

Neural Architecture Search with Bayesian Optimisation and Optimal Transport Technical Report

2018.

Links | BibTeX

104.

Hamraz, Hamid; Jacobs, Nathan B; Contreras, Marco A; Clark, Chase H

Deep learning for conifer/deciduous classification of airborne LiDAR 3D point clouds representing individual trees Technical Report

2018.

Links | BibTeX

103.

Perez-Rua, Juan-Manuel; Baccouche, Moez; Pateux, Stephane

Efficient Progressive Neural Architecture Search Technical Report

2018.

Links | BibTeX

102.

Deglint, Jason L; Jin, Chao; Chao, Angela; Wong, Alexander

The feasibility of automated identification of six algae types using neural networks and fluorescence-based spectral-morphological features Technical Report

2018.

Links | BibTeX

101.

Kamath, Purushotham; Singh, Abhishek; Dutta, Debo

AMLA: an AutoML frAmework for Neural Network Design Technical Report

2018.

Links | BibTeX

100.

de Laroussilhe, Quentin; Jastrzebski, Stanislaw; Houlsby, Neil; Gesmundo, Andrea

Neural Architecture Search Over a Graph Search Space Technical Report

, 2018.

Links | BibTeX

99.

Jaâfra, Yesmina; Laurent, Jean Luc; Deruyver, Aline; Naceur, Mohamed Saber

A Review of Meta-Reinforcement Learning for Deep Neural Networks Architecture Search Technical Report

, 2018.

Links | BibTeX

98.

Wu, Bichen; Wang, Yanghan; Zhang, Peizhao; Tian, Yuandong; Vajda, Peter; Keutzer, Kurt

Mixed Precision Quantization of ConvNets via Differentiable Neural Architecture Search Technical Report

, 2018.

Links | BibTeX

1497 entries « 28 of 30 »