Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

1237 entries « 1 of 25 »



Lin, Yi; Liu, Yanfei; Liu, Jingguang; Liu, Guocai; Ma, Kai; Zheng, Yefeng

LE-NAS: Learning-based Ensemble with Neural Architecture Search for 3D Radiotherapy Dose Prediction Journal Article


Links | BibTeX


Dimanov, Daniel; Balaguer-Ballester, Emili; Singleton, Colin; Rostami, Shahin

Moncae: Multi-Objective Neuroevolution of Convolutional Autoencoders Inproceedings

2nd Workshop on Neural Architecture Search at ICLR 2021, 2021.

Links | BibTeX


Jin, Yaochu; Wang, Handing; Sun, Chaoli

Surrogate-Assisted Evolutionary Neural Architecture Search Inproceedings

Data-Driven Evolutionary Optimization, pp. 373-387, 2021, ISBN: 978-3-030-74640-7.

Links | BibTeX


Zhu, Wei; Ni, Yuan; Wang, Xiaoling; Xie, Guotong; Zhang, Fang

Discovering Better Model Architectures for Medical Query Understanding Inproceedings

Proceedings of NAACL HLT 2021: IndustryTrack Papers, pp. 230-237, 2021.

Links | BibTeX


Dai, Xiaoliang; Wan, Alvin; Zhang, Peizhao; Wu, Bichen; He, Zijian; Wei, Zhen; Chen, Kan; Tian, Yuandong; Yu, Matthew; Vajda, Peter; Gonzalez, Joseph E

FBNetV3: Joint Architecture-Recipe Search using Predictor Pretraining Incollection

CVPR2021, 2021.

Links | BibTeX


Ma, Xiaohan; Si, Chang; Wang, Ying; Liu, Cheng; Zhang1, Lei

NASA: Accelerating Neural Network Design with a NAS Processor Inproceedings

2021 ACM/IEEE 48th Annual International Symposium on Computer Architecture (ISCA), 2021.

Links | BibTeX


Liu, Shaoli; Zheng, Chengjian; Lu, Kaidi; Gao, Si; Wang, Ning; Wang, Bofei; Zhang, Diankai; Zhang, Xiaofeng; Xu, Tianyu

EVSRNet: Efficient Video Super-Resolution With Neural Architecture Search Inproceedings

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pp. 2480-2485, 2021.

Links | BibTeX


Geraeinejad, V; Seenan, S; Modarressi, M; Daneshtalab, M

RoCo-NAS : Robust and Compact Neural Architecture Search Inproceedings

The international joint conference on neural networks IJCNN, 2021.

Links | BibTeX


Tsokov, Stefan ; Lazarova, Milena ; Aleksieva-Petrova, Adelina

An Evolutionary Approach to the Design of Convolutional Neural Networks for Human Activity Recognition Journal Article

Indian Journal of Computer Science and Engineering, 2021.

Links | BibTeX


Chen, Wuyang; Gong, Xinyu; Wang, Zhangyang

Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective Inproceedings

ICLR 2021, 2021.

Links | BibTeX


Anwar, Abrar

Evolving Spiking Circuit Motifs Using Weight Agnostic Neural Networks Journal Article

Proceedings of the AAAI Conference on Artificial Intelligence, 35 (18), pp. 15956-15957, 2021.

Links | BibTeX


Wang, Xiaobo

Teacher Guided Neural Architecture Search for Face Recognition Journal Article

Proceedings of the AAAI Conference on Artificial Intelligence, 35 (4), pp. 2817-2825, 2021.

Links | BibTeX


Perenda, Erma; Rajendran, Sreeraj; Bovet, Gerome; Pollin, Sofie; Zheleva, Mariya

Evolutionary Optimization of Residual Neural Network Architectures for Modulation Classification Miscellaneous


Links | BibTeX


Yuan, Zhihang ; Liu, Jingze ; Li, Xingchen ; Yan, Longhao ; Chen, Haoxiang ; Wu, Bingzhe ; Yang, Yuchao ; Sun, Guangyu

NAS4RRAM: neural network architecture search for inference on RRAM-based accelerators Journal Article

Science China Information Sciences, 2021.

Links | BibTeX


Zhang, Yi ; Liu, Yang ; Liu, Shirley X

Neural network architecture search with AMBER Journal Article

Nature Machine Intelligence, pp. 372-373, 2021.

Links | BibTeX


Schoenherr, Georg P

The Nonlinearity Coefficient - A Practical Guide to Neural Architecture Design PhD Thesis


Links | BibTeX


Yang, Yuxuan; Gao, Zhongke; Li, Yanli; Wang, He

A CNN identified by reinforcement learning-based optimization framework for EEG-based state evaluation Journal Article

Journal of Neural Engineering, 18 (4), pp. 046059, 2021.

Abstract | Links | BibTeX


Pan, Zheyi; Ke, Songyu; Yang, Xiaodu; Liang, Yuxuan; Yu, Yong; Zhang, Junbo; Zheng, Yu

AutoSTG: Neural Architecture Search forPredictions of Spatio-Temporal Graphs Inproceedings

WWW 2021, 2021.

Links | BibTeX


Kyriakides, George ; Margaritis, Konstantinos

Evolving graph convolutional networks for neural architecture search Journal Article

Neural Computing and Applications, 2021.

Abstract | Links | BibTeX


Wang, Linnan; Xie, Saining; Li, Teng; Fonseca, Rodrigo; Tian, Yuandong

Sample-Efficient Neural Architecture Search by Learning Actions for Monte Carlo Tree Search Journal Article

IEEE transactions on pattern analysis and machine intelligence, PP , 2021, ISSN: 0162-8828.

Abstract | Links | BibTeX


Zhang, Zhentong ; Shan, Yugang; Yuan, Jie

Multi-Level Cell Progressive Differentiable Architecture Search to Improve Image Classification Accuracy Journal Article

Journal of Signal Processing Systems, 2021.

Abstract | Links | BibTeX


Zimmer, Lucas; Lindauer, Marius; Hutter, Frank

Auto-Pytorch: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL Journal Article

IEEE transactions on pattern analysis and machine intelligence, PP , 2021, ISSN: 0162-8828.

Abstract | Links | BibTeX


Zheng, X; Ji, R; Chen, Y; Wang, Q; Zhang, B; Ye, Q; Chen, J; Huang, F; Tian, Y

MIGO-NAS: Towards Fast and Generalizable Neural Architecture Search Journal Article

IEEE Transactions on Pattern Analysis & Machine Intelligence, (01), pp. 1-1, 2021, ISSN: 1939-3539.

Links | BibTeX


Liu, Lanlan; Zhang, Yuting; Deng, Jia; Soatto, Stefano

Dynamically Grown Generative Adversarial Networks Inproceedings

AAAI 2021, 2021.

Links | BibTeX


Xu, Y; Xie, L; Dai, W; Zhang, X; Chen, X; Qi, G; Xiong, H; Tian, Q

Partially-Connected Neural Architecture Search for Reduced Computational Redundancy Journal Article

IEEE Transactions on Pattern Analysis & Machine Intelligence, (01), pp. 1-1, 2021, ISSN: 1939-3539.

Abstract | Links | BibTeX


Ney, Jonas; Loroch, Dominik Marek; Rybalkin, Vladimir; Weber, Nico; ü, Jens Kr; Wehn, Norbert

HALF: Holistic Auto Machine Learning for FPGAs Technical Report

, 2021.

Links | BibTeX


Wang, Xinyi; Xiang, Tiange; Zhang, Chaoyi; Song, Yang; Liu, Dongnan; Huang, Heng; Cai, Weidong

BiX-NAS: Searching Efficient Bi-directional Architecture for Medical Image Segmentation Technical Report

, 2021.

Links | BibTeX


Su, Xiu; You, Shan; Xie, Jiyang; Zheng, Mingkai; Wang, Fei; Qian, Chen; Zhang, Changshui; Wang, Xiaogang; Xu, Chang

Vision Transformer Architecture Search Technical Report

, 2021.

Links | BibTeX


Wu, Robert; Saxena, Nayan; Jain, Rohan

Poisoning the Search Space in Neural Architecture Search Technical Report

, 2021.

Links | BibTeX


Negi, Shubham; Chakraborty, Indranil; Ankit, Aayush; Roy, Kaushik

NAX: Co-Designing Neural Network and Hardware Architecture for Memristive Xbar based Computing Systems Technical Report

, 2021.

Links | BibTeX


Deng, Xueqing; Zhu, Yi; Tian, Yuxin; Newsam, Shawn D

AutoAdapt: Automated Segmentation Network Search for Unsupervised Domain Adaptation Technical Report

, 2021.

Links | BibTeX


ZHAO, Huan; YAO, Quanming; TU, Weiwei

Search to aggregate neighborhood for graph neural network Inproceedings

2021 IEEE 37th International Conference on Data Engineering (ICDE), pp. 552-563, 2021.

Links | BibTeX


Zhang, Miao; Su, Steven W; Pan, Shirui; Chang, Xiaojun; Abbasnejad, Ehsan M; Haffari, Reza

iDARTS: Differentiable Architecture Search with Stochastic Implicit Gradients Inproceedings

Meila, Marina; Zhang, Tong (Ed.): Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event, pp. 12557–12566, PMLR, 2021.

Links | BibTeX


Li, Boyang; Lu, Qing; Jiang, Weiwen; Jung, Taeho; Shi, Yiyu

A mining pool solution for novel proof-of-neural-architecture consensus Inproceedings

2021 IEEE International Conference on Blockchain and Cryptocurrency (ICBC), pp. 1-3, 2021.

Links | BibTeX


Nunes, Matheus; Fraga, Paulo M; Pappa, Gisele L

Fitness Landscape Analysis of Graph Neural Network Architecture Search Spaces Inproceedings

Proceedings of the Genetic and Evolutionary Computation Conference, pp. 876–884, Association for Computing Machinery, Lille, France, 2021, ISBN: 9781450383509.

Abstract | Links | BibTeX


Zhang, Miao; Su, Steven W; Pan, Shirui; Chang, Xiaojun; Huang, Wei; Haffari, Gholamreza

Differentiable Architecture Search Without Training Nor Labels: A Pruning Perspective Technical Report

, 2021.

Links | BibTeX


Klos, Andreas; Rosenbaum, Marius; Schiffmann, Wolfram

Scalable and Highly Available Multi-Objective Neural Architecture Search in Bare Metal Kubernetes Cluster Inproceedings

2021 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), pp. 605-610, 2021.

Links | BibTeX


Eriksson, David; -, Pierce I; Daulton, Samuel; Xia, Peng; Shrivastava, Akshat; Babu, Arun; Zhao, Shicong; Aly, Ahmed; Venkatesh, Ganesh; Balandat, Maximilian

Latency-Aware Neural Architecture Search with Multi-Objective Bayesian Optimization Inproceedings

8th ICML Workshop on Automated Machine Learning (2021), 2021.

Links | BibTeX


Zeinali, Behnam; Zhuang, Di; Chang, Morris J

ESAI: Efficient Split Artificial Intelligence via Early Exiting Using Neural Architecture Search Technical Report

, 2021.

Links | BibTeX


Santra, Santanu; Hsieh, Jun-Wei; Lin, Chi-Fang

Gradient Descent Effects on Differential Neural Architecture Search: A Survey Journal Article

IEEE Access, 9 , pp. 89602-89618, 2021.

Links | BibTeX


Maile, Kaitlin; Lecarpentier, Erwan; é, Herv; Wilson, Dennis G

On Constrained Optimization in Differentiable Neural Architecture Search Technical Report

, 2021.

Links | BibTeX


Azarmehr, Neda; Ye, Xujiong; Howard, James P; Lane, Elisabeth S; Labs, Robert; Shun-Shin, Matthew J; Cole, Graham D; Bidaut, Luc; Francis, Darrel P; Zolgharni, Massoud

Neural architecture search of echocardiography view classifiers Journal Article

Journal of Medical Imaging, 8 (3), pp. 1 – 21, 2021.

Links | BibTeX


Li, Yuening; Chen, Zhengzhang; Zha, Daochen; Zhou, Kaixiong; Jin, Haifeng; Chen, Haifeng; Hu, Xia

AutoOD: Neural Architecture Search for Outlier Detection Inproceedings

2021 IEEE 37th International Conference on Data Engineering (ICDE), pp. 2117-2122, 2021.

Links | BibTeX


Manu, Daniel; Huang, Shaoyi; Ding, Caiwen; Yang, Lei

Co-Exploration of Graph Neural Network and Network-on-Chip Design Using AutoML Inproceedings

Proceedings of the 2021 on Great Lakes Symposium on VLSI, pp. 175–180, Association for Computing Machinery, Virtual Event, USA, 2021, ISBN: 9781450383936.

Abstract | Links | BibTeX


Chen, Weiwei; Wang, Ying; Lin, Gangliang; Gao, Chengsi; Liu, Cheng; Zhang, Lei

CHaNAS: Coordinated Search for Network Architecture and Scheduling Policy Inproceedings

Proceedings of the 22nd ACM SIGPLAN/SIGBED International Conference on Languages, Compilers, and Tools for Embedded Systems, pp. 42–53, Association for Computing Machinery, Virtual, Canada, 2021, ISBN: 9781450384728.

Abstract | Links | BibTeX


Lee, Hayeon; Lee, Sewoong; Chong, Song; Hwang, Sung Ju

HELP: Hardware-Adaptive Efficient Latency Predictor for NAS via Meta-Learning Technical Report

, 2021.

Links | BibTeX


Li, Hanjun; Wu, Gaojie; -, Wei

Combined Depth Space based Architecture Search For Person Re-identification Incollection

CVPR2021, abs/2104.04163 , 2021.

Links | BibTeX


Garciarena, Unai; Santana, Roberto; Mendiburu, Alexander

Redefining Neural Architecture Search of Heterogeneous Multi-Network Models by Characterizing Variation Operators and Model Components Technical Report

, 2021.

Links | BibTeX


Akhauri, Yash; Niranjan, Adithya; ñ, Pablo Mu J; Banerjee, Suvadeep; Davare, Abhijit; Cocchini, Pasquale; Sorokin, Anton A; Iyer, Ravi; Jain, Nilesh

RHNAS: Realizable Hardware and Neural Architecture Search Technical Report

, 2021.

Links | BibTeX


Fu, Yonggan; Zhang, Yongan; Zhang, Yang; Cox, David; Lin, Yingyan

Auto-NBA: Efficient and Effective Search Over the Joint Space of Networks, Bitwidths, and Accelerators Technical Report

, 2021.

Links | BibTeX

1237 entries « 1 of 25 »