Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2019
Improving Neural Architecture Search Image Classifiers via Ensemble Learning Technical Report
2019.
Software-Defined Design Space Exploration for an Efficient AI Accelerator Architecture Technical Report
2019.
MFAS - Multimodal Fusion Architecture Search Proceedings Article
In: pp. 6966-6975, 2019.
A Hybrid GA-PSO Method for Evolving Architecture and Short Connections of Deep Convolutional Neural Networks Proceedings Article
In: pp. 650-663, 2019.
Partial Order Pruning - For Best Speed/Accuracy Trade-Off in Neural Architecture Search Proceedings Article
In: pp. 9145-9153, 2019.
Inductive Transfer for Neural Architecture Optimization Technical Report
2019.
Evolutionary Cell Aided Design for Neural Network Architectures Technical Report
2019.
Automated Architecture-Modeling for Convolutional Neural Networks Proceedings Article
In: pp. 163-172, 2019.
Learning Implicitly Recurrent CNNs Through Parameter Sharing Proceedings Article
In: 2019.
Random Search and Reproducibility for Neural Architecture Search Proceedings Article
In: pp. 367-377, 2019.
Evolutionary neural AutoML for deep learning Proceedings Article
In: pp. 401-409, 2019.
Fast Task-Aware Architecture Inference Technical Report
2019.
Investigating recurrent neural network memory structures using neuro-evolution Proceedings Article
In: pp. 446-455, 2019.
Accuracy vs Efficiency - Achieving Both through FPGA-Implementation Aware Neural Architecture Search Proceedings Article
In: pp. 5, 2019.
The Evolved Transformer Proceedings Article
In: pp. 5877-5886, 2019.
Efficient training and design of photonic neural network through neuroevolution Technical Report
2019.
NeuNetS - An Automated Synthesis Engine for Neural Network Design Technical Report
2019.
Fast, Accurate and Lightweight Super-Resolution with Neural Architecture Search Technical Report
2019.
Bayesian Learning of Neural Network Architectures Proceedings Article
In: pp. 730-738, 2019.
Auto-DeepLab - Hierarchical Neural Architecture Search for Semantic Image Segmentation Proceedings Article
In: pp. 82-92, 2019.
The Art of Getting Deep Neural Networks in Shape Journal Article
In: vol. 15, no. 4, pp. 62:1-62:21, 2019.
SNAS - stochastic neural architecture search Proceedings Article
In: 2019.
Graph HyperNetworks for Neural Architecture Search Proceedings Article
In: 2019.
Efficient Multi-Objective Neural Architecture Search via Lamarckian Evolution Proceedings Article
In: 2019.
Pose Neural Fabrics Search Technical Report
2019.
ChamNet - Towards Efficient Network Design Through Platform-Aware Model Adaptation Proceedings Article
In: pp. 11398-11407, 2019.
Evolutionary Neural Architecture Search for Image Restoration Proceedings Article
In: pp. 1-8, 2019.
IRLAS - Inverse Reinforcement Learning for Architecture Search Proceedings Article
In: pp. 9021-9029, 2019.
FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search Technical Report
2019.
ProxylessNAS - Direct Neural Architecture Search on Target Task and Hardware Proceedings Article
In: 2019.
TEA-DNN - the Quest for Time-Energy-Accuracy Co-optimized Deep Neural Networks Proceedings Article
In: pp. 1-6, 2019.
Evolving Space-Time Neural Architectures for Videos Proceedings Article
In: pp. 1793-1802, 2019.
Deep Active Learning with a Neural Architecture Search Proceedings Article
In: pp. 5974-5984, 2019.
Stochastic Adaptive Neural Architecture Search for Keyword Spotting Proceedings Article
In: pp. 2842-2846, 2019.
The CoSTAR Block Stacking Dataset - Learning with Workspace Constraints Proceedings Article
In: pp. 1797-1804, 2019.
Fast Neural Architecture Search of Compact Semantic Segmentation Models via Auxiliary Cells Proceedings Article
In: pp. 9126-9135, 2019.
Automatic Configuration of Deep Neural Networks with Parallel Efficient Global Optimization Proceedings Article
In: pp. 1-7, 2019.
BANANAS - Bayesian Optimization with Neural Architectures for Neural Architecture Search Technical Report
2019.
A Survey on Neural Architecture Search Technical Report
2019.
RENAS - Reinforced Evolutionary Neural Architecture Search Proceedings Article
In: pp. 4787-4796, 2019.
Teacher Guided Architecture Search Proceedings Article
In: pp. 5319-5328, 2019.
MnasNet - Platform-Aware Neural Architecture Search for Mobile Proceedings Article
In: pp. 2820-2828, 2019.
TAPAS - Train-Less Accuracy Predictor for Architecture Search Proceedings Article
In: pp. 3927-3934, 2019.
Regularized Evolution for Image Classifier Architecture Search Proceedings Article
In: pp. 4780-4789, 2019.
Neural network architecture search with differentiable cartesian genetic programming for regression Proceedings Article
In: pp. 181-182, 2019.
Learnable Embedding Space for Efficient Neural Architecture Compression Technical Report
2019.
Towards Automatically-Tuned Deep Neural Networks Technical Report
2019.
Deep neural network architecture search using network morphism Proceedings Article
In: pp. 30-35, 2019.
2018
AutoGAN: Robust Classifier Against Adversarial Attacks Technical Report
2018.