AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3298 entries « 53 of 66 »

2020

698.

Devaguptapu, Chaitanya; Agarwal, Devansh; Mittal, Gaurav; Balasubramanian, Vineeth N

An Empirical Study on the Robustness of NAS based Architectures Technical Report

2020.

Links | BibTeX

697.

Wang, Xiaoxing; Xue, Chao; Yan, Junchi; Yang, Xiaokang; Hu, Yonggang; Sun, Kewei

MergeNAS - Merge Operations into One for Differentiable Architecture Search Proceedings Article

In: pp. 3065-3072, 2020.

Links | BibTeX

696.

Hong, Weijun; Li, Guilin; Zhang, Weinan; Tang, Ruiming; Wang, Yunhe; Li, Zhenguo; Yu, Yong

DropNAS - Grouped Operation Dropout for Differentiable Architecture Search Proceedings Article

In: pp. 2326-2332, 2020.

Links | BibTeX

695.

Kotyan, Shashank; Vargas, Danilo Vasconcellos

Towards evolving robust neural architectures to defend from adversarial attacks Proceedings Article

In: pp. 135-136, 2020.

Links | BibTeX

694.

Nekrasov, Vladimir; Chen, Hao; Shen, Chunhua; Reid, Ian D

Architecture Search of Dynamic Cells for Semantic Video Segmentation Proceedings Article

In: pp. 1959-1968, 2020.

Links | BibTeX

693.

Guo, Yong; Chen, Yaofo; Zheng, Yin; Zhao, Peilin; Chen, Jian; Huang, Junzhou; Tan, Mingkui

Breaking the Curse of Space Explosion - Towards Efficient NAS with Curriculum Search Proceedings Article

In: pp. 3822-3831, 2020.

Links | BibTeX

692.

Song, Qingquan; Cheng, Dehua; Zhou, Hanning; Yang, Jiyan; Tian, Yuandong; Hu, Xia

Towards Automated Neural Interaction Discovery for Click-Through Rate Prediction Proceedings Article

In: pp. 945-955, 2020.

Links | BibTeX

691.

Yan, Xingang; Jiang, Weiwen; Shi, Yiyu; Zhuo, Cheng

MS-NAS - Multi-scale Neural Architecture Search for Medical Image Segmentation Proceedings Article

In: pp. 388-397, 2020.

Links | BibTeX

690.

Ferianc, Martin; Fan, Hongxiang; Rodrigues, Miguel

VINNAS - Variational Inference-based Neural Network Architecture Search Technical Report

2020.

Links | BibTeX

689.

Peng, Yige; Bi, Lei; Fulham, Michael J; Feng, Dagan; Kim, Jinman

Multi-modality Information Fusion for Radiomics-Based Neural Architecture Search Proceedings Article

In: pp. 763-771, 2020.

Links | BibTeX

688.

Li, Wei; Gong, Shaogang; Zhu, Xiatian

Neural Graph Embedding for Neural Architecture Search Proceedings Article

In: pp. 4707-4714, 2020.

Links | BibTeX

687.

Herron, Emily J; Young, Steven R; Potok, Thomas E

Ensembles of Networks Produced from Neural Architecture Search Proceedings Article

In: pp. 223-234, 2020.

Links | BibTeX

686.

White, Colin; Neiswanger, Willie; Nolen, Sam; Savani, Yash

A Study on Encodings for Neural Architecture Search Proceedings Article

In: 2020.

Links | BibTeX

685.

Luo, Renqian; Tan, Xu; Wang, Rui; Qin, Tao; Chen, Enhong; Liu, Tie-Yan

Neural Architecture Search with GBDT Technical Report

2020.

Links | BibTeX

684.

Cheng, Hsin-Pai; Zhang, Tunhou; Li, Shiyu; Yan, Feng; Li, Meng; Chandra, Vikas; Li, Hai Helen; Chen, Yiran

NASGEM - Neural Architecture Search via Graph Embedding Method Technical Report

2020.

Links | BibTeX

683.

Waris, Faisal; Reynolds, Robert G

Neuro-evolution using game-driven cultural algorithms Proceedings Article

In: pp. 1857-1865, 2020.

Links | BibTeX

682.

Kobayashi, Masayuki; Nagao, Tomoharu

An evolution-based approach for efficient differentiable architecture search Proceedings Article

In: pp. 131-132, 2020.

Links | BibTeX

681.

Souquet, Léo; Shvai, Nadiya; Llanza, Arcadi; Nakib, Amir

HyperFDA: A Bi-Level Optimization Approach to Neural Architecture Search and Hyperparameters' Optimization via Fractal Decomposition-Based Algorithm Technical Report

Cancún, Mexico, 2020, ISBN: 9781450371278.

Links | BibTeX

680.

Kotyan, Shashank; Vargas, Danilo Vasconcellos

Towards evolving robust neural architectures to defend from adversarial attacks Proceedings Article

In: pp. 135-136, 2020.

Links | BibTeX

679.

Barnes, Dustin K; Davis, Sara R; Hand, Emily M; Louis, Sushil J

A first step toward incremental evolution of convolutional neural networks Proceedings Article

In: pp. 115-116, 2020.

Links | BibTeX

678.

Zhang, Haoyu; Jin, Yaochu; Cheng, Ran; Hao, Kuangrong

Sampled Training and Node Inheritance for Fast Evolutionary Neural Architecture Search Technical Report

2020.

Links | BibTeX

677.

Lee, Royson; Dudziak, Lukasz; Abdelfattah, Mohamed S; Venieris, Stylianos I; Kim, Hyeji; Wen, Hongkai; Lane, Nicholas D

Journey Towards Tiny Perceptual Super-Resolution Proceedings Article

In: pp. 85-102, 2020.

Links | BibTeX

676.

Cho, Minsu; Soltani, Mohammadreza; Hegde, Chinmay

Hyperparameter Optimization in Neural Networks via Structured Sparse Recovery Technical Report

2020.

Links | BibTeX

675.

Bi, Kaifeng; Xie, Lingxi; Chen, Xin; Wei, Longhui; Tian, Qi

GOLD-NAS - Gradual, One-Level, Differentiable Technical Report

2020.

Links | BibTeX

674.

Tian, Yunjie; Liu, Chang; Xie, Lingxi; Jiao, Jianbin; Ye, Qixiang

Discretization-Aware Architecture Search Technical Report

2020.

Links | BibTeX

673.

Vertechi, Pietro; Frosini, Patrizio; Bergomi, Mattia G

Parametric machines - a fresh approach to architecture search Technical Report

2020.

Links | BibTeX

672.

Wang, Chunnan; Wang, Hongzhi; Feng, Guocheng; Geng, Fei

Multi-Objective Neural Architecture Search Based on Diverse Structures and Adaptive Recommendation Technical Report

2020.

Links | BibTeX

671.

Wang, Bin; Xue, Bing; Zhang, Mengjie

Surrogate-assisted Particle Swarm Optimisation for Evolving Variable-length Transferable Blocks for Image Classification Journal Article

In: IEEE transactions on Neural Networks and Learning Systems, vol. abs/2007.01556, pp. 1-14, 2020.

Links | BibTeX

670.

Wang, Jiaxing; Wu, Jiaxiang; Bai, Haoli; Cheng, Jian

M-NAS - Meta Neural Architecture Search Proceedings Article

In: pp. 6186-6193, 2020.

Links | BibTeX

669.

Wang, Junjue; Zhong, Yanfei; Zheng, Zhuo; Ma, Ailong; Zhang, Liangpei

RSNet: The Search for Remote Sensing Deep Neural Networks in Recognition Tasks Technical Report

2020.

Links | BibTeX

668.

Zhou, Pan; Xiong, Caiming; Socher, Richard; Hoi, Steven Chu-Hong

Theory-Inspired Path-Regularized Differential Network Architecture Search Proceedings Article

In: 2020.

Links | BibTeX

667.

Li, Yawei; Li, Wen; Danelljan, Martin; Zhang, Kai; Gu, Shuhang; Gool, Luc Van; Timofte, Radu

The Heterogeneity Hypothesis - Finding Layer-Wise Dissimilated Network Architecture Technical Report

2020.

Links | BibTeX

666.

Trillos, Nicolás García; Morales, Javier

Semi-discrete optimization through semi-discrete optimal transport - a framework for neural architecture search Technical Report

2020.

Links | BibTeX

665.

Trillos, Nicolás García; Morales, Felix; Morales, Javier

Traditional and accelerated gradient descent for neural architecture search Technical Report

2020.

Links | BibTeX

664.

Kügler, David; Uecker, Marc; Kuijper, Arjan; Mukhopadhyay, Anirban

AutoSNAP - Automatically Learning Neural Architectures for Instrument Pose Estimation Proceedings Article

In: pp. 375-384, 2020.

Links | BibTeX

663.

Li, Ting; Zhang, Junbo; Bao, Kainan; Liang, Yuxuan; Li, Yexin; Zheng, Yu

AutoST - Efficient Neural Architecture Search for Spatio-Temporal Prediction Proceedings Article

In: pp. 794-802, 2020.

Links | BibTeX

662.

O'Neill, Damien; Xue, Bing; Zhang, Mengjie

Neural architecture search for sparse DenseNets with dynamic compression Proceedings Article

In: pp. 386-394, 2020.

Links | BibTeX

661.

Zhou, Peng; Xie, Lingxi; Zhang, Xiaopeng; Ni, Bingbing; Tian, Qi

Searching towards Class-Aware Generators for Conditional Generative Adversarial Networks Technical Report

2020.

Links | BibTeX

660.

Lin, Ming; Chen, Hesen; Sun, Xiuyu; Qian, Qi; Li, Hao; Jin, Rong

Neural Architecture Design for GPU-Efficient Networks Technical Report

2020.

Links | BibTeX

659.

Süzen, Mehmet

Equivalence in Deep Neural Networks via Conjugate Matrix Ensembles Technical Report

2020.

Links | BibTeX

658.

Zimmer, Lucas; Lindauer, Marius; Hutter, Frank

Auto-PyTorch Tabular - Multi-Fidelity MetaLearning for Efficient and Robust AutoDL Technical Report

2020.

Links | BibTeX

657.

Panda, Rameswar; Merler, Michele; Jaiswal, Mayoore; Wu, Hui; Ramakrishnan, Kandan; Finkler, Ulrich; Chen, Chun-Fu; Cho, Minsik; Kung, David S; Feris, Rogério; Bhattacharjee, Bishwaranjan

NASTransfer - Analyzing Architecture Transferability in Large Scale Neural Architecture Search Technical Report

2020.

Links | BibTeX

656.

Fang, Jiemin; Sun, Yuzhu; Zhang, Qian; Peng, Kangjian; Li, Yuan; Liu, Wenyu; Wang, Xinggang

FNA++ - Fast Network Adaptation via Parameter Remapping and Architecture Search Technical Report

2020.

Links | BibTeX

655.

Janik, Romuald A; Nowak, Aleksandra

Neural networks adapting to datasets - learning network size and topology Technical Report

2020.

Links | BibTeX

654.

Li, Yuening; Chen, Zhengzhang; Zha, Daochen; Zhou, Kaixiong; Jin, Haifeng; Chen, Haifeng; Hu, Xia

AutoOD - Automated Outlier Detection via Curiosity-guided Search and Self-imitation Learning Technical Report

2020.

Links | BibTeX

653.

Yang, Jianhua; Lu, Beiling; Xiao, Liang; Kang, Xiangui; Shi, Yunqing

Reinforcement Learning Aided Network Architecture Generation for JPEG Image Steganalysis Proceedings Article

In: pp. 23-32, 2020.

Links | BibTeX

652.

Rakhshani, Hojjat; Fawaz, Hassan Ismail; Idoumghar, Lhassane; Forestier, Germain; Lepagnot, Julien; Weber, Jonathan; Brévilliers, Mathieu; Muller, Pierre-Alain

Neural Architecture Search for Time Series Classification Proceedings Article

In: pp. 1-8, 2020.

Links | BibTeX

651.

Yu, Hongyuan; Peng, Houwen

Cyclic Differentiable Architecture Search Technical Report

2020.

Links | BibTeX

650.

Singh, Ishika; Zhou, Haoyi; Yang, Kunlin; Ding, Meng; Lin, Bill; Xie, Pengtao

Differentially-private Federated Neural Architecture Search Technical Report

2020.

Links | BibTeX

649.

Chen, Xiangning; Wang, Ruochen; Cheng, Minhao; Tang, Xiaocheng; Hsieh, Cho-Jui

DrNAS - Dirichlet Neural Architecture Search Technical Report

2020.

Links | BibTeX

3298 entries « 53 of 66 »