AutoML.org

Freiburg-Hannover

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


1497 entries « 2 of 30 »

2021

1447.

Yuan, Zhihang; Liu, Jingze; Li, Xingchen; Yan, Longhao; Chen, Haoxiang; Wu, Bingzhe; Yang, Yuchao; Sun, Guangyu

NAS4RRAM: neural network architecture search for inference on RRAM-based accelerators Journal Article

In: Science China Information Sciences, 2021.

Links | BibTeX

1446.

Perenda, Erma; Rajendran, Sreeraj; Bovet, Gerome; Pollin, Sofie; Zheleva, Mariya

Evolutionary Optimization of Residual Neural Network Architectures for Modulation Classification Miscellaneous

2021.

Links | BibTeX

1445.

Wang, Xiaobo

Teacher Guided Neural Architecture Search for Face Recognition Journal Article

In: Proceedings of the AAAI Conference on Artificial Intelligence, 35 (4), pp. 2817-2825, 2021.

Links | BibTeX

1444.

Anwar, Abrar

Evolving Spiking Circuit Motifs Using Weight Agnostic Neural Networks Journal Article

In: Proceedings of the AAAI Conference on Artificial Intelligence, 35 (18), pp. 15956-15957, 2021.

Links | BibTeX

1443.

Pan, Zheyi; Ke, Songyu; Yang, Xiaodu; Liang, Yuxuan; Yu, Yong; Zhang, Junbo; Zheng, Yu

AutoSTG: Neural Architecture Search forPredictions of Spatio-Temporal Graphs Inproceedings

In: WWW 2021, 2021.

Links | BibTeX

1442.

Kyriakides, George; Margaritis, Konstantinos

Evolving graph convolutional networks for neural architecture search Journal Article

In: Neural Computing and Applications, 2021.

Abstract | Links | BibTeX

1441.

Harikrishnan, V. K.; Gambhir, MeenuAshima

Neural AutoML with Convolutional Networks for Diabetic Retinopathy Diagnosis Journal Article

In: Machine Intelligence and Smart Systems, pp. 145-157, 2021.

Links | BibTeX

1440.

Wang, Linnan; Xie, Saining; Li, Teng; Fonseca, Rodrigo; Tian, Yuandong

Sample-Efficient Neural Architecture Search by Learning Actions for Monte Carlo Tree Search Journal Article

In: IEEE transactions on pattern analysis and machine intelligence, PP , 2021, ISSN: 0162-8828.

Abstract | Links | BibTeX

1439.

Zhang, Zhentong; Shan, Yugang; Yuan, Jie

Multi-Level Cell Progressive Differentiable Architecture Search to Improve Image Classification Accuracy Journal Article

In: Journal of Signal Processing Systems, 2021.

Abstract | Links | BibTeX

1438.

Zheng, X; Ji, R; Chen, Y; Wang, Q; Zhang, B; Ye, Q; Chen, J; Huang, F; Tian, Y

MIGO-NAS: Towards Fast and Generalizable Neural Architecture Search Journal Article

In: IEEE Transactions on Pattern Analysis & Machine Intelligence, (01), pp. 1-1, 2021, ISSN: 1939-3539.

Links | BibTeX

1437.

Zimmer, Lucas; Lindauer, Marius; Hutter, Frank

Auto-Pytorch: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL Journal Article

In: IEEE transactions on pattern analysis and machine intelligence, PP , 2021, ISSN: 0162-8828.

Abstract | Links | BibTeX

1436.

Liu, Lanlan; Zhang, Yuting; Deng, Jia; Soatto, Stefano

Dynamically Grown Generative Adversarial Networks Inproceedings

In: AAAI 2021, 2021.

Links | BibTeX

1435.

Xu, Y; Xie, L; Dai, W; Zhang, X; Chen, X; Qi, G; Xiong, H; Tian, Q

Partially-Connected Neural Architecture Search for Reduced Computational Redundancy Journal Article

In: IEEE Transactions on Pattern Analysis & Machine Intelligence, (01), pp. 1-1, 2021, ISSN: 1939-3539.

Abstract | Links | BibTeX

1434.

Hao, Jie; Zhu, William

Architecture self-attention mechanism: nonlinear optimization for neural architecture search Journal Article

In: Journal of Nonlinear and Variational Analysis, 5 , pp. 119-140, 2021.

Links | BibTeX

1433.

Gao, Yanjie; Gu, Xianyu; Zhang, Hongyu; Lin, Haoxiang; Yang, Mao

Runtime Performance Prediction for Deep Learning Models with Graph Neural Network Technical Report

Microsoft (MSR-TR-2021-3), 2021.

Abstract | Links | BibTeX

1432.

Pham, Hieu; Le, Quoc V

AutoDropout - Learning Dropout Patterns to Regularize Deep Networks Technical Report

, 2021.

Links | BibTeX

1431.

Huang, Yufang; Axsom, Kelly M; Lee, John; Subramanian, Lakshminarayanan; Zhang, Yiye

DICE: Deep Significance Clustering for Outcome-Aware Stratification Technical Report

2021.

Links | BibTeX

1430.

Ma, Ailong; Wan, Yuting; Zhong, Yanfei; Wang, Junjue; Zhang, Liangpei

SceneNet: Remote sensing scene classification deep learning network using multi-objective neural evolution architecture search Technical Report

, 2021, ISSN: 0924-2716.

Links | BibTeX

1429.

Yang, Hansi; Yao, Quanming; Kwok, James T

Tensorizing Subgraph Search in the Supernet Technical Report

, 2021.

Links | BibTeX

1428.

Syed, Muhtadyuzzaman; Srinivasan, Arvind Akpuram

Generalized Latency Performance Estimation for Once-For-All Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

1427.

Huang, Hanxun; Ma, Xingjun; Erfani, Sarah M; Bailey, James

Neural Architecture Search via Combinatorial Multi-Armed Bandit Technical Report

, 2021.

Links | BibTeX

1426.

Tang, Tianqi; Yu, Xin; Dong, Xuanyi; Yang, Yi

Auto-Navigator: Decoupled Neural Architecture Search for Visual Navigation Technical Report

2021.

Links | BibTeX

1425.

Zheng, Shuai; Wang, Yabin; Li, Baotong; Li, Xin

A Hardware-adaptive Deep Feature Matching Pipeline for Real-time 3D Reconstruction Journal Article

In: 132 , pp. 102984, 2021.

Links | BibTeX

1424.

Hosseini, Ramtin; Yang, Xingyi; Xie, Pengtao

DSRNA - Differentiable Search of Robust Neural Architectures Inproceedings

In: CVPR 2021, 2021.

Links | BibTeX

1423.

Ruchte, Michael; Zela, Arber; Siems, Julien Niklas; Grabocka, Josif; Hutter, Frank

NASLib: A Modular and Flexible Neural Architecture Search Library Technical Report

2021.

Links | BibTeX

1422.

Shaikh, Azhar; Sinha, Nishant

Learn to Bind and Grow Neural Structures Inproceedings

In: pp. 119-126, 2021.

Links | BibTeX

1421.

Lu, Hao; Han, Hu

NAS-HR: search of neural architecture for heart-rate estimation from face videos Technical Report

2021.

Links | BibTeX

1420.

Peng, Daiyi; Dong, Xuanyi; Real, Esteban; Tan, Mingxing; Lu, Yifeng; Liu, Hanxiao; Bender, Gabriel; Kraft, Adam; Liang, Chen; Le, Quoc V

PyGlove - Symbolic Programming for Automated Machine Learning Technical Report

, 2021.

Links | BibTeX

1419.

Liu, Jiaheng; Zhou, Shunfeng; Wu, Yichao; Chen, Ken; Ouyang, Wanli; Xu, Dong

Block Proposal Neural Architecture Search Journal Article

In: 30 , pp. 15-25, 2021.

Links | BibTeX

1418.

He, Xin; Wang, Shihao; Ying, Guohao; Zhang, Jiyong; Chu, Xiaowen

Efficient Multi-objective Evolutionary 3D Neural Architecture Search for COVID-19 Detection with Chest CT Scans Technical Report

, 2021.

Links | BibTeX

1417.

Chu, Xiangxiang; Wang, Xiaoxing; Zhang, Bo; Lu, Shun; Wei, Xiaolin; Yan, Junchi

DARTS-: Robustly Stepping out of Performance Collapse Without Indicators Technical Report

2021.

Links | BibTeX

1416.

Liang, Xinle; Liu, Yang; Luo, Jiahuan; He, Yuanqin; Chen, Tianjian; Yang, Qiang

Self-supervised Cross-silo Federated Neural Architecture Search Technical Report

, 2021.

Links | BibTeX

1415.

Mittal, Govind; Korus, Pawel; Memon, Nasir D

FiFTy - Large-Scale File Fragment Type Identification Using Convolutional Neural Networks Journal Article

In: 16 , pp. 28-41, 2021.

Links | BibTeX

1414.

Yang, Zhao; Zhang, Shengbing; Li, Ruxu; Li, Chuxi; Wang, Miao; Wang, Danghui; Zhang, Meng

Efficient Resource-Aware Convolutional Neural Architecture Search for Edge Computing with Pareto-Bayesian Optimization Journal Article

In: 21 (2), pp. 444, 2021.

Links | BibTeX

1413.

Wei, Tao; Wang, Changhu; Chen, Chang Wen

Modularized Morphing of Deep Convolutional Neural Networks - A Graph Approach Journal Article

In: 70 (2), pp. 305-315, 2021.

Links | BibTeX

1412.

Song, Xingyou; Choromanski, Krzysztof; Parker-Holder, Jack; Tang, Yunhao; Peng, Daiyi; Jain, Deepali; Gao, Wenbo; Pacchiano, Aldo; Sarlós, Tamás; Yang, Yuxiang

ES-ENAS - Combining Evolution Strategies with Neural Architecture Search at No Extra Cost for Reinforcement Learning Technical Report

, 2021.

Links | BibTeX

1411.

Rorabaugh, Ariel Keller; -, Silvina Caíno; II, Michael Wyatt R; Johnston, Travis; Taufer, Michela

PEng4NN: An Accurate Performance Estimation Engine for Efficient Automated Neural Network Architecture Search Technical Report

, 2021.

Links | BibTeX

1410.

Zhang, Haokui; Gong, Chengrong; Bai, Yunpeng; Bai, Zongwen; Li, Ying

3D-ANAS: 3D Asymmetric Neural Architecture Search for Fast Hyperspectral Image Classification Miscellaneous

2021.

Links | BibTeX

1409.

Gu, Hongyang; Fu, Guangyuan; Li, Jianmin; Zhu, Jun

Auto-ReID+: Searching for a multi-branch ConvNet for person re-identification Journal Article

In: Neurocomputing, 435 , pp. 53-66, 2021, ISSN: 0925-2312.

Abstract | Links | BibTeX

1408.

He, Xin; Wang, Shihao; Chu, Xiaowen; Shi, Shaohuai; Tang, Jiangping; Liu, Xin; Yan, Chenggang; Zhang, Jiyong; Ding, Guiguang

Automated Model Design and Benchmarking of 3D Deep Learning Models for COVID-19 Detection with Chest CT Scans Technical Report

, 2021.

Links | BibTeX

1407.

Zhou, Benjia; Li, Yunan; Wan, Jun

Regional Attention with Architecture-Rebuilt 3D Network for RGB-D Gesture Recognition Technical Report

2021.

Links | BibTeX

1406.

Yang, Zhao; Zhang, Shengbing; Li, Ruxu; Li, Chuxi; Wang, Miao; Wang, Danghui; Zhang, Meng

Efficient Resource-Aware Convolutional Neural Architecture Search for Edge Computing with Pareto-Bayesian Optimization Journal Article

In: Sensors, 21 (2), 2021, ISSN: 1424-8220.

Abstract | Links | BibTeX

1405.

Weng, Yu; Chen, Zehua; Zhou, Tianbao

Improved differentiable neural architecture search for single image super-resolution Journal Article

In: Peer-to-Peer Networking and Applications, 2021.

Abstract | Links | BibTeX

1404.

Liu, Jia; Jin, Yaochu

Multi-objective Search of Robust Neural Architectures against Multiple Types of Adversarial Attacks Technical Report

, 2021.

Links | BibTeX

1403.

Wu, Yan; Huang, Zhiwu; Kumar, Suryansh; Sukthanker, Rhea Sanjay; Timofte, Radu; Gool, Luc Van

Trilevel Neural Architecture Search for Efficient Single Image Super-Resolution Technical Report

, 2021.

Links | BibTeX

1402.

Alparslan, Yigit; Moyer, Ethan Jacob; Isozaki, Isamu Mclean; Schwartz, Daniel; Dunlop, Adam; Dave, Shesh; Kim, Edward

Towards Searching Efficient and Accurate Neural Network Architectures in Binary Classification Problems Technical Report

, 2021.

Links | BibTeX

1401.

Lee, Sanghyeop; Kim, Junyeob; Kang, Hyeon; Kang, Do-Young; Park, Jangsik

Genetic Algorithm Based Deep Learning Neural Network Structure and Hyperparameter Optimization Journal Article

In: Applied Sciences, 11 (2), 2021, ISSN: 2076-3417.

Abstract | Links | BibTeX

1400.

Jiang, Hanliang; Shen, Fuhao; Gao, Fei; Han, Weidong

Learning efficient, explainable and discriminative representations for pulmonary nodules classification Journal Article

In: Pattern Recognition, 113 , pp. 107825, 2021, ISSN: 0031-3203.

Abstract | Links | BibTeX

1399.

Alparslan, Yigit; Moyer, Ethan Jacob; Kim, Edward

Evaluating Online and Offline Accuracy Traversal Algorithms for k-Complete Neural Network Architectures Journal Article

In: CoRR, abs/2101.06518 , 2021.

Links | BibTeX

1398.

Vaccaro, Lorenzo; Sansonetti, Giuseppe; Micarelli, Alessandro

An Empirical Review of Automated Machine Learning Journal Article

In: Computers, 10 (1), 2021, ISSN: 2073-431X.

Abstract | Links | BibTeX

1497 entries « 2 of 30 »