Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.

3310 entries « 50 of 67 »



Banbury, Colby R; Zhou, Chuteng; Fedorov, Igor; Navarro, Ramon Matas; Thakker, Urmish; Gope, Dibakar; Reddi, Vijay Janapa; Mattina, Matthew; Whatmough, Paul N

MicroNets - Neural Network Architectures for Deploying TinyML Applications on Commodity Microcontrollers Technical Report


Links | BibTeX


Zhang, Yikang; Zhang, Jian; Zhong, Zhao

AutoBSS - An Efficient Algorithm for Block Stacking Style Search Proceedings Article

In: 2020.

Links | BibTeX


Yu, Kaicheng; Ranftl, René; Salzmann, Mathieu

How to Train Your Super-Net - An Analysis of Training Heuristics in Weight-Sharing NAS Technical Report


Links | BibTeX


Moser, Brian B; Raue, Federico; Hees, Jörn; Dengel, Andreas

DartsReNet - Exploring New RNN Cells in ReNet Architectures Proceedings Article

In: pp. 850-861, 2020.

Links | BibTeX


Khawar, Farhan; Hang, Xu; Tang, Ruiming; Liu, Bin; Li, Zhenguo; He, Xiuqiang

AutoFeature - Searching for Feature Interactions and Their Architectures for Click-through Rate Prediction Proceedings Article

In: pp. 625-634, 2020.

Links | BibTeX


Lukasik, Jovita; Friede, David; Stuckenschmidt, Heiner; Keuper, Margret

Neural Architecture Performance Prediction Using Graph Neural Networks Technical Report


Links | BibTeX


Wrosz, Izajasz P

Neural Network Subgraphs Correlation with Trained Model Accuracy Proceedings Article

In: pp. 271-279, 2020.

Links | BibTeX


Zhang, Nan; Wang, Jianzong; Yang, Jian; Qu, Xiaoyang; Xiao, Jing

Multi-objective Cuckoo Algorithm for Mobile Devices Network Architecture Search Proceedings Article

In: pp. 312-324, 2020.

Links | BibTeX


Vidnerová, Petra; Procházka, Stepán; Neruda, Roman

Multiobjective Evolution for Convolutional Neural Network Architecture Search Proceedings Article

In: pp. 261-270, 2020.

Links | BibTeX


Wang, Zhaowen; Zhang, Wei; Wang, Zhiming

G-DARTS-A - Groups of Channel Parallel Sampling with Attention Technical Report


Links | BibTeX


Zhang, Yuge; Zhang, Quanlu; Yang, Yaming

How Does Supernet Help in Neural Architecture Search? Technical Report


Links | BibTeX


Kundu, Souvik; Nazemi, Mahdi; Pedram, Massoud; Chugg, Keith M; Beerel, Peter A

Pre-defined Sparsity for Low-Complexity Convolutional Neural Networks Technical Report


Links | BibTeX


Mi, Jian-Xun; Feng, Jie

SharedNet - A Novel Efficient Convolutional Architecture Based on Group Sharing Convolution Proceedings Article

In: pp. 128-139, 2020.

Links | BibTeX


Chen, Yuan; Wang, Junyan

A Novel Multi-class Classification Framework Based on Local OVR Deep Neural Network Proceedings Article

In: pp. 48:1-48:6, 2020.

Links | BibTeX


Tang, Yanxi; Wang, Jianzong; Qu, Xiaoyang; Zhang, Nan; Xiao, Jing

D-GHNAS for Joint Intent Classification and Slot Filling Proceedings Article

In: pp. 794-807, 2020.

Links | BibTeX


Chen, Yiren; Yang, Yaming; Sun, Hong; Wang, Yujing; Xu, Yu; Shen, Wei; Zhou, Rong; Tong, Yunhai; Bai, Jing; Zhang, Ruofei

AutoADR - Automatic Model Design for Ad Relevance Proceedings Article

In: pp. 2365-2372, 2020.

Links | BibTeX


Faria, Matheus Prado Prandini; da Julia, Rita Maria Silva; Tomaz, Lidia Bononi Paiva

Improving FIFA Player Agents Decision-Making Architectures Based on Convolutional Neural Networks Through Evolutionary Techniques Proceedings Article

In: pp. 371-386, 2020.

Links | BibTeX


Garcia-López, Javier; Agudo-Martínez, Antonio; Moreno-Noguer, Francesc

E-DNAS: Differentiable Neural Architecture Search for Embedded Systems Technical Report


Links | BibTeX


Zhang, Haoyuan; Hou, Yonghong; Wang, Pichao; Guo, Zihui; Li, Wanqing

SAR-NAS - Skeleton-based action recognition via neural architecture searching Journal Article

In: vol. 73, pp. 102942, 2020.

Links | BibTeX


Zhou, Yiyi; Ji, Rongrong; Sun, Xiaoshuai; Luo, Gen; Hong, Xiaopeng; Su, Jinsong; Ding, Xinghao; Shao, Ling

K-armed Bandit based Multi-Modal Network Architecture Search for Visual Question Answering Proceedings Article

In: pp. 1245-1254, 2020.

Links | BibTeX


Garg, Anubhav; Saha, Amit Kumar; Dutta, Debo

Direct Federated Neural Architecture Search Technical Report


Links | BibTeX


Yang, Yibo; Li, Hongyang; You, Shan; Wang, Fei; Qian, Chen; Lin, Zhouchen

ISTA-NAS - Efficient and Consistent Neural Architecture Search by Sparse Coding Proceedings Article

In: 2020.

Links | BibTeX


Ru, Binxin; Lyle, Clare; Schut, Lisa; van der Wilk, Mark; Gal, Yarin

Revisiting the Train Loss - an Efficient Performance Estimator for Neural Architecture Search Technical Report


Links | BibTeX


Wang, Qifei; Ke, Junjie; Greaves, Joshua; Chu, Grace; Bender, Gabriel; Sbaiz, Luciano; Go, Alec; Howard, Andrew; Yang, Feng; Yang, Ming-Hsuan; Gilbert, Jeff; Milanfar, Peyman

Multi-path Neural Networks for On-device Multi-domain Visual Classification Technical Report


Links | BibTeX


Lukasik, Jovita; Friede, David; Zela, Arber; Stuckenschmidt, Heiner; Hutter, Frank; Keuper, Margret

Smooth Variational Graph Embeddings for Efficient Neural Architecture Search Technical Report


Links | BibTeX


Shen, Mingzhu; Liang, Feng; Li, Chuming; Lin, Chen; Sun, Ming; Yan, Junjie; Ouyang, Wanli

Once Quantized for All - Progressively Searching for Quantized Efficient Models Technical Report


Links | BibTeX


Kim, Jihwan; Wang, Jisung; Kim, Sangki; Lee, Yeha

Evolved Speech-Transformer - Applying Neural Architecture Search to End-to-End Automatic Speech Recognition Proceedings Article

In: pp. 1788-1792, 2020.

Links | BibTeX


Bao, Qian; Liu, Wu; Hong, Jun; Duan, Lingyu; Mei, Tao

Pose-native Network Architecture Search for Multi-person Human Pose Estimation Proceedings Article

In: pp. 592-600, 2020.

Links | BibTeX


Cai, Xing; Zhang, Lanqing; Li, Chengyuan; Li, Ge; Li, Thomas H

VONAS - Network Design in Visual Odometry using Neural Architecture Search Proceedings Article

In: pp. 727-735, 2020.

Links | BibTeX


MacLaughlin, Ansel; Dhamala, Jwala; Kumar, Anoop; Venkatapathy, Sriram; Venkatesan, Ragav; Gupta, Rahul

Evaluating the Effectiveness of Efficient Neural Architecture Search for Sentence-Pair Tasks Proceedings Article

In: pp. 22-31, 2020.

Links | BibTeX


Guo, Zichao; Zhang, Xiangyu; Mu, Haoyuan; Heng, Wen; Liu, Zechun; Wei, Yichen; Sun, Jian

Single Path One-Shot Neural Architecture Search with Uniform Sampling Proceedings Article

In: pp. 544-560, 2020.

Links | BibTeX


Li, Yonggang; Zhou, Yafeng; Wang, Yongtao; Tang, Zhi

PD-DARTS - Progressive Discretization Differentiable Architecture Search Proceedings Article

In: pp. 306-311, 2020.

Links | BibTeX


Ding, Yuhui; Yao, Quanming; Zhang, Tong

Propagation Model Search for Graph Neural Networks Technical Report


Links | BibTeX


Fayyazifar, Najmeh

An Accurate CNN Architecture For Atrial Fibrillation Detection Using Neural Architecture Search Proceedings Article

In: pp. 1135-1139, 2020.

Links | BibTeX


Baek, Woonhyuk; Kim, Ildoo; Kim, Sungwoong; Lim, Sungbin

AutoCLINT: The Winning Method in AutoCV Challenge 2019 Technical Report


Links | BibTeX


Liu, Shikun; Lin, Zhe; Wang, Yilin; Zhang, Jianming; Perazzi, Federico; Johns, Edward

Shape Adaptor - A Learnable Resizing Module Proceedings Article

In: pp. 661-677, 2020.

Links | BibTeX


Ponomarev, Evgeny; Matveev, Sergey A; Oseledets, Ivan V

LETI - Latency Estimation Tool and Investigation of Neural Networks inference on Mobile GPU Technical Report


Links | BibTeX


Shao, Laëtitia; Moroz, Max; Eban, Elad; Movshovitz-Attias, Yair

Neighbourhood Distillation - On the benefits of non end-to-end distillation Technical Report


Links | BibTeX


Yuan, Kun; Li, Quanquan; Chen, Dapeng; Zhou, Aojun; Yan, Junjie

Dynamic Graph - Learning Instance-aware Connectivity for Neural Networks Technical Report


Links | BibTeX


Xu, Ju; Li, Mengzhang; Zhu, Zhanxing

Automatic Data Augmentation for 3D Medical Image Segmentation Proceedings Article

In: pp. 378-387, 2020.

Links | BibTeX


Zhang, Tingting; Lan, Yushi; Song, Aiguo; Liu, Kun; Wang, Nan

Structural Combinatorial of Network Information System of Systems based on Evolutionary Optimization Method Technical Report


Links | BibTeX


Gu, Yuchao; Liu, Yun; Yang, Yi; Wu, Yu-Huan; Lu, Shao-Ping; Cheng, Ming-Ming

DOTS - Decoupling Operation and Topology in Differentiable Architecture Search Proceedings Article

In: CVPR2021, 2020.

Links | BibTeX


Wang, Haixia; Li, Rui; Chen, Xuan; Duan, Bin; Xiong, Linfewi; Yang, Xin; Fan, Haining; Ni, Dong

Remote Intelligent Assisted Diagnosis System for Hepatic Echinococcosis Technical Report

2020, ISBN: 978-3-030-60334-2.

Links | BibTeX


Li, Qing; Zhang, Wei; Lv, Jinglei; Wu, Xia; Liu, Tianming

Neural Architecture Search for Optimization of Spatial-Temporal Brain Network Decomposition Technical Report


Links | BibTeX


Ferianc, Martin; Fan, Hongxiang; Rodrigues, Miguel

VINNAS: Variational Inference-based Neural Network Architecture Search Technical Report


Links | BibTeX


Liu, Zuhao; Wang, Huan; Zhang, Shaoting; Wang, Guotai; Qi, Jin

NAS-SCAM: Neural Architecture Search-Based Spatial and Channel Joint Attention Module for Nuclei Semantic Segmentation and Classification Technical Report

2020, ISBN: 978-3-030-59710-8.

Links | BibTeX


Xiao, Bin; He, Naying; Wang, Qian; Xue, Zhong; Chen, Lei; Yan, Fuhua; Shi, Feng; Shen, Dinggang

Joint Appearance-Feature Domain Adaptation: Application to QSM Segmentation Transfer Technical Report

2020, ISBN: 978-3-030-59861-7.

Links | BibTeX


Zhu, Yanming; Meijering, Erik

Neural Architecture Search for Microscopy Cell Segmentation Technical Report

Cham, 2020, ISBN: 978-3-030-59861-7.

Links | BibTeX


Chen, Jie; Huang, Haozhe; Peng, Jian; Zhu, Jiawei; Chen, Li; Li, Wenbo; Sun, Binyu; Li, Haifeng

Convolution Neural Network Architecture Learning for Remote Sensing Scene Classification Technical Report


Links | BibTeX


Evans, Nicholas; Plested, Jo; Gedeon, Tom

Exploring the Correlation Between Random Convolutional Architectures and the Trained Equivalent Proceedings Article

In: pp. 1-6, 2020.

Links | BibTeX

3310 entries « 50 of 67 »