Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2020
Neural Architecture Design for GPU-Efficient Networks Technical Report
2020.
Equivalence in Deep Neural Networks via Conjugate Matrix Ensembles Technical Report
2020.
Auto-PyTorch Tabular - Multi-Fidelity MetaLearning for Efficient and Robust AutoDL Technical Report
2020.
FNA++ - Fast Network Adaptation via Parameter Remapping and Architecture Search Technical Report
2020.
Neural networks adapting to datasets - learning network size and topology Technical Report
2020.
AutoOD - Automated Outlier Detection via Curiosity-guided Search and Self-imitation Learning Technical Report
2020.
Reinforcement Learning Aided Network Architecture Generation for JPEG Image Steganalysis Proceedings Article
In: pp. 23-32, 2020.
Neural Architecture Search for Time Series Classification Proceedings Article
In: pp. 1-8, 2020.
Cyclic Differentiable Architecture Search Technical Report
2020.
Differentially-private Federated Neural Architecture Search Technical Report
2020.
DrNAS - Dirichlet Neural Architecture Search Technical Report
2020.
Neural Architecture Optimization with Graph VAE Technical Report
2020.
Fine-Grained Stochastic Architecture Search Technical Report
2020.
Bonsai-Net - One-Shot Neural Architecture Search via Differentiable Pruners Technical Report
2020.
AlphaGAN - Fully Differentiable Architecture Search for Generative Adversarial Networks Technical Report
2020.
Fine-Tuning DARTS for Image Classification Technical Report
2020.
Neural Anisotropy Directions Proceedings Article
In: 2020.
CryptoNAS - Private Inference on a ReLU Budget Proceedings Article
In: 2020.
Heuristic Architecture Search Using Network Morphism for Chest X-Ray Classification Proceedings Article
In: pp. 107-121, 2020.
Task-Aware Performance Prediction for Efficient Architecture Search Proceedings Article
In: pp. 1238-1245, 2020.
Beyond Network Pruning - a Joint Search-and-Training Approach Proceedings Article
In: pp. 2583-2590, 2020.
Neural Ensemble Search for Performant and Calibrated Predictions Technical Report
2020.
Multi-fidelity Neural Architecture Search with Knowledge Distillation Technical Report
2020.
Inner Ensemble Networks: Average Ensemble as an Effective Regularizer Technical Report
2020.
Differentiable Neural Architecture Transformation for Reproducible Architecture Improvement Technical Report
2020.
Neural Architecture Search using Bayesian Optimisation with Weisfeiler-Lehman Kernel Technical Report
2020.
NAS-Bench-NLP - Neural Architecture Search Benchmark for Natural Language Processing Technical Report
2020.
Does Unsupervised Architecture Representation Learning Help Neural Architecture Search? Proceedings Article
In: 2020.
Few-shot Neural Architecture Search Technical Report
2020.
NADS - Neural Architecture Distribution Search for Uncertainty Awareness Proceedings Article
In: pp. 356-366, 2020.
AMER - Automatic Behavior Modeling and Interaction Exploration in Recommender System Technical Report
2020.
Neuroevolution in Deep Neural Networks - Current Trends and Future Challenges Technical Report
2020.
AutoGAN-Distiller - Searching to Compress Generative Adversarial Networks Proceedings Article
In: pp. 3292-3303, 2020.
Does Unsupervised Architecture Representation Learning Help Neural Architecture Search? Proceedings Article
In: 2020.
Hardware-Aware Transformable Architecture Search with Efficient Search Space Proceedings Article
In: pp. 1-6, 2020.
Auto-Generating Neural Networks with Reinforcement Learning for Multi-Purpose Image Forensics Proceedings Article
In: pp. 1-6, 2020.
Neural Architecture Search without Training Technical Report
2020.
Differentiable Neural Input Search for Recommender Systems Technical Report
2020.
Efficient Architecture Search for Continual Learning Technical Report
2020.
Conditional Neural Architecture Search Technical Report
2020.
AutoHAS - Differentiable Hyper-parameter and Architecture Search Technical Report
2020.
Modeling task-based fMRI data via deep belief network with neural architecture search Journal Article
In: vol. 83, pp. 101747, 2020.
Fast Hardware-Aware Neural Architecture Search Proceedings Article
In: pp. 2959-2967, 2020.
Memory-Efficient Hierarchical Neural Architecture Search for Image Denoising Proceedings Article
In: pp. 3654-3663, 2020.
GP-NAS - Gaussian Process Based Neural Architecture Search Proceedings Article
In: pp. 11930-11939, 2020.
MemNAS - Memory-Efficient Neural Architecture Search With Grow-Trim Learning Proceedings Article
In: pp. 2105-2113, 2020.
Can Weight Sharing Outperform Random Architecture Search? An Investigation With TuNAS Proceedings Article
In: pp. 14311-14320, 2020.