AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3157 entries « 51 of 64 »

2020

657.

Zimmer, Lucas; Lindauer, Marius; Hutter, Frank

Auto-PyTorch Tabular - Multi-Fidelity MetaLearning for Efficient and Robust AutoDL Technical Report

2020.

Links | BibTeX

656.

Panda, Rameswar; Merler, Michele; Jaiswal, Mayoore; Wu, Hui; Ramakrishnan, Kandan; Finkler, Ulrich; Chen, Chun-Fu; Cho, Minsik; Kung, David S; Feris, Rogério; Bhattacharjee, Bishwaranjan

NASTransfer - Analyzing Architecture Transferability in Large Scale Neural Architecture Search Technical Report

2020.

Links | BibTeX

655.

Fang, Jiemin; Sun, Yuzhu; Zhang, Qian; Peng, Kangjian; Li, Yuan; Liu, Wenyu; Wang, Xinggang

FNA++ - Fast Network Adaptation via Parameter Remapping and Architecture Search Technical Report

2020.

Links | BibTeX

654.

Janik, Romuald A; Nowak, Aleksandra

Neural networks adapting to datasets - learning network size and topology Technical Report

2020.

Links | BibTeX

653.

Li, Yuening; Chen, Zhengzhang; Zha, Daochen; Zhou, Kaixiong; Jin, Haifeng; Chen, Haifeng; Hu, Xia

AutoOD - Automated Outlier Detection via Curiosity-guided Search and Self-imitation Learning Technical Report

2020.

Links | BibTeX

652.

Yang, Jianhua; Lu, Beiling; Xiao, Liang; Kang, Xiangui; Shi, Yunqing

Reinforcement Learning Aided Network Architecture Generation for JPEG Image Steganalysis Proceedings Article

In: pp. 23-32, 2020.

Links | BibTeX

651.

Rakhshani, Hojjat; Fawaz, Hassan Ismail; Idoumghar, Lhassane; Forestier, Germain; Lepagnot, Julien; Weber, Jonathan; Brévilliers, Mathieu; Muller, Pierre-Alain

Neural Architecture Search for Time Series Classification Proceedings Article

In: pp. 1-8, 2020.

Links | BibTeX

650.

Yu, Hongyuan; Peng, Houwen

Cyclic Differentiable Architecture Search Technical Report

2020.

Links | BibTeX

649.

Singh, Ishika; Zhou, Haoyi; Yang, Kunlin; Ding, Meng; Lin, Bill; Xie, Pengtao

Differentially-private Federated Neural Architecture Search Technical Report

2020.

Links | BibTeX

648.

Chen, Xiangning; Wang, Ruochen; Cheng, Minhao; Tang, Xiaocheng; Hsieh, Cho-Jui

DrNAS - Dirichlet Neural Architecture Search Technical Report

2020.

Links | BibTeX

647.

Li, Jian; Liu, Yong; Liu, Jiankun; Wang, Weiping

Neural Architecture Optimization with Graph VAE Technical Report

2020.

Links | BibTeX

646.

Chaudhuri, Shraman Ray; Eban, Elad; Li, Hanhan; Moroz, Max; Movshovitz-Attias, Yair

Fine-Grained Stochastic Architecture Search Technical Report

2020.

Links | BibTeX

645.

Geada, Rob; Prangle, Dennis; McGough, Andrew Stephen

Bonsai-Net - One-Shot Neural Architecture Search via Differentiable Pruners Technical Report

2020.

Links | BibTeX

644.

Tian, Yuesong; Shen, Li; Shen, Li; Su, Guinan; Li, Zhifeng; Liu, Wei

AlphaGAN - Fully Differentiable Architecture Search for Generative Adversarial Networks Technical Report

2020.

Links | BibTeX

643.

Tanveer, Muhammad Suhaib; Khan, Muhammad Umar Karim; Kyung, Chong-Min

Fine-Tuning DARTS for Image Classification Technical Report

2020.

Links | BibTeX

642.

Ortiz-Jiménez, Guillermo; Modas, Apostolos; Moosavi-Dezfooli, Seyed-Mohsen; Frossard, Pascal

Neural Anisotropy Directions Proceedings Article

In: 2020.

Links | BibTeX

641.

Ghodsi, Zahra; Veldanda, Akshaj Kumar; Reagen, Brandon; Garg, Siddharth

CryptoNAS - Private Inference on a ReLU Budget Proceedings Article

In: 2020.

Links | BibTeX

640.

Radiuk, Pavlo; Kutucu, Hakan

Heuristic Architecture Search Using Network Morphism for Chest X-Ray Classification Proceedings Article

In: pp. 107-121, 2020.

Links | BibTeX

639.

Kokiopoulou, Efi; Hauth, Anja; Sbaiz, Luciano; Gesmundo, Andrea; Bartók, Gábor; Berent, Jesse

Task-Aware Performance Prediction for Efficient Architecture Search Proceedings Article

In: pp. 1238-1245, 2020.

Links | BibTeX

638.

Lu, Xiaotong; Huang, Han; Dong, Weisheng; Li, Xin; Shi, Guangming

Beyond Network Pruning - a Joint Search-and-Training Approach Proceedings Article

In: pp. 2583-2590, 2020.

Links | BibTeX

637.

Zaidi, Sheheryar; Zela, Arber; Elsken, Thomas; Holmes, Chris; Hutter, Frank; Teh, Yee Whye

Neural Ensemble Search for Performant and Calibrated Predictions Technical Report

2020.

Links | BibTeX

636.

Trofimov, Ilya; Klyuchnikov, Nikita; Salnikov, Mikhail; Filippov, Alexander; Burnaev, Evgeny

Multi-fidelity Neural Architecture Search with Knowledge Distillation Technical Report

2020.

Links | BibTeX

635.

Mohamed, Abduallah; Sadiq, Muhammed Mohaimin; AlBadawy, Ehab; Elhoseiny, Mohamed; Claudel, Christian

Inner Ensemble Networks: Average Ensemble as an Effective Regularizer Technical Report

2020.

Links | BibTeX

634.

Kim, Do-Guk; Lee, Heung-Chang

Differentiable Neural Architecture Transformation for Reproducible Architecture Improvement Technical Report

2020.

Links | BibTeX

633.

Ru, Bin Xin; Wan, Xingchen; Dong, Xiaowen; Osborne, Michael A

Neural Architecture Search using Bayesian Optimisation with Weisfeiler-Lehman Kernel Technical Report

2020.

Links | BibTeX

632.

Klyuchnikov, Nikita; Trofimov, Ilya; Artemova, Ekaterina; Salnikov, Mikhail; Fedorov, Maxim; Burnaev, Evgeny

NAS-Bench-NLP - Neural Architecture Search Benchmark for Natural Language Processing Technical Report

2020.

Links | BibTeX

631.

Yan, Shen; Zheng, Yu; Ao, Wei; Zeng, Xiao; Zhang, Mi

Does Unsupervised Architecture Representation Learning Help Neural Architecture Search? Proceedings Article

In: 2020.

Links | BibTeX

630.

Zhao, Yiyang; Wang, Linnan; Tian, Yuandong; Fonseca, Rodrigo; Guo, Tian

Few-shot Neural Architecture Search Technical Report

2020.

Links | BibTeX

629.

Ardywibowo, Randy; Boluki, Shahin; Gong, Xinyu; Wang, Zhangyang; Qian, Xiaoning

NADS - Neural Architecture Distribution Search for Uncertainty Awareness Proceedings Article

In: pp. 356-366, 2020.

Links | BibTeX

628.

Shi, Tianyu; Wang, Jiawei; Wu, Yuankai; Sun, Lijun

Towards Efficient Connected and Automated Driving System via Multi-agent Graph Reinforcement Learning Technical Report

2020.

Links | BibTeX

627.

Zhao, Pengyu; Xiao, Kecheng; Zhang, Yuanxing; Bian, Kaigui; Yan, Wei

AMER - Automatic Behavior Modeling and Interaction Exploration in Recommender System Technical Report

2020.

Links | BibTeX

626.

Galván, Edgar; Mooney, Peter

Neuroevolution in Deep Neural Networks - Current Trends and Future Challenges Technical Report

2020.

Links | BibTeX

625.

Fu, Yonggan; Chen, Wuyang; Wang, Haotao; Li, Haoran; Lin, Yingyan; Wang, Zhangyang

AutoGAN-Distiller - Searching to Compress Generative Adversarial Networks Proceedings Article

In: pp. 3292-3303, 2020.

Links | BibTeX

624.

Yan, Shen; Zheng, Yu; Ao, Wei; Zeng, Xiao; Zhang, Mi

Does Unsupervised Architecture Representation Learning Help Neural Architecture Search? Proceedings Article

In: 2020.

Links | BibTeX

623.

Jiang, Yuhang; Wang, Xin; Zhu, Wenwu

Hardware-Aware Transformable Architecture Search with Efficient Search Space Proceedings Article

In: pp. 1-6, 2020.

Links | BibTeX

622.

Wei, Yujun; Chen, Yifang; Kang, Xiangui; Wang, Jane Z; Xiao, Liang

Auto-Generating Neural Networks with Reinforcement Learning for Multi-Purpose Image Forensics Proceedings Article

In: pp. 1-6, 2020.

Links | BibTeX

621.

Mellor, Joseph; Turner, Jack; Storkey, Amos J; Crowley, Elliot J

Neural Architecture Search without Training Technical Report

2020.

Links | BibTeX

620.

Ru, Binxin; Lyle, Clare; Schut, Lisa; van der Wilk, Mark; Gal, Yarin

Revisiting the Train Loss - an Efficient Performance Estimator for Neural Architecture Search Technical Report

2020.

Links | BibTeX

619.

Cheng, Weiyu; Shen, Yanyan; Huang, Linpeng

Differentiable Neural Input Search for Recommender Systems Technical Report

2020.

Links | BibTeX

618.

Gao, Qiang; Luo, Zhipeng; Klabjan, Diego

Efficient Architecture Search for Continual Learning Technical Report

2020.

Links | BibTeX

617.

Kao, Sheng-Chun; Ramamurthy, Arun; Williams, Reed; Krishna, Tushar

Conditional Neural Architecture Search Technical Report

2020.

Links | BibTeX

616.

Dong, Xuanyi; Tan, Mingxing; Yu, Adams Wei; Peng, Daiyi; Gabrys, Bogdan; Le, Quoc V

AutoHAS - Differentiable Hyper-parameter and Architecture Search Technical Report

2020.

Links | BibTeX

615.

Qiang, Ning; Dong, Qinglin; Zhang, Wei; Ge, Bao; Ge, Fangfei; Liang, Hongtao; Sun, Yifei; Gao, Jie; Liu, Tianming

Modeling task-based fMRI data via deep belief network with neural architecture search Journal Article

In: vol. 83, pp. 101747, 2020.

Links | BibTeX

614.

Zhang, Li Lyna; Yang, Yuqing; Jiang, Yuhang; Zhu, Wenwu; Liu, Yunxin

Fast Hardware-Aware Neural Architecture Search Proceedings Article

In: pp. 2959-2967, 2020.

Links | BibTeX

613.

Zhang, Haokui; Li, Ying; Chen, Hao; Shen, Chunhua

Memory-Efficient Hierarchical Neural Architecture Search for Image Denoising Proceedings Article

In: pp. 3654-3663, 2020.

Links | BibTeX

612.

Li, Zhihang; Xi, Teng; Deng, Jiankang; Zhang, Gang; Wen, Shengzhao; He, Ran

GP-NAS - Gaussian Process Based Neural Architecture Search Proceedings Article

In: pp. 11930-11939, 2020.

Links | BibTeX

611.

Liu, Peiye; Wu, Bo; Ma, Huadong; Seok, Mingoo

MemNAS - Memory-Efficient Neural Architecture Search With Grow-Trim Learning Proceedings Article

In: pp. 2105-2113, 2020.

Links | BibTeX

610.

Bender, Gabriel; Liu, Hanxiao; Chen, Bo; Chu, Grace; Cheng, Shuyang; Kindermans, Pieter-Jan; Le, Quoc V

Can Weight Sharing Outperform Random Architecture Search? An Investigation With TuNAS Proceedings Article

In: pp. 14311-14320, 2020.

Links | BibTeX

609.

Alizadeh-Vahid, Keivan; Prabhu, Anish; Farhadi, Ali; Rastegari, Mohammad

Butterfly Transform - An Efficient FFT Based Neural Architecture Design Proceedings Article

In: pp. 12021-12030, 2020.

Links | BibTeX

608.

Wang, Tianzhe; Wang, Kuan; Cai, Han; Lin, Ji; Liu, Zhijian; Wang, Hanrui; Lin, Yujun; Han, Song

APQ - Joint Search for Network Architecture, Pruning and Quantization Policy Proceedings Article

In: pp. 2075-2084, 2020.

Links | BibTeX

3157 entries « 51 of 64 »