AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3298 entries « 48 of 66 »

2020

948.

Xie, Pengtao; Du, Xuefeng; Ban, Hao

Skillearn: Machine Learning Inspired by Humans' Learning Skills Technical Report

2020.

Links | BibTeX

947.

Pan, Jingyu; Chang, Chen-Chia; Zhang, Tunhou; Xie, Zhiyao; Hu, Jiang; Qi, Weiyi; Lin, Chung-Wei; Liang, Rongjian; Mitra, Joydeep; Fallon, Elias; Chen, Yiran

Automatic Routability Predictor Development Using Neural Architecture Search Technical Report

2020.

Links | BibTeX

946.

Garcia-Valencia, Sebastian; Betancourt, Alejandro; Pulido, Juan Guillermo Lalinde

Sequence Generation using Deep Recurrent Networks and Embeddings - A study case in music Technical Report

2020.

Links | BibTeX

945.

Wang, Qifei; Ke, Junjie; Greaves, Joshua; Chu, Grace; Bender, Gabriel; Sbaiz, Luciano; Go, Alec; Howard, Andrew; Yang, Feng; Yang, Ming-Hsuan; Gilbert, Jeff; Milanfar, Peyman

Multi-path Neural Networks for On-device Multi-domain Visual Classification Technical Report

2020.

Links | BibTeX

944.

d'Avila Garcez, Artur; Lamb, Luis C

Neurosymbolic AI: The 3rd Wave Technical Report

2020.

Links | BibTeX

943.

Cheng, Hsin-Pai; Liang, Feng; Li, Meng; Cheng, Bowen; Yan, Feng; Li, Hai; Chandra, Vikas; Chen, Yiran

ScaleNAS - One-Shot Learning of Scale-Aware Representations for Visual Recognition Technical Report

2020.

Links | BibTeX

942.

Li, Zhengang; Yuan, Geng; Niu, Wei; Li, Yanyu; Zhao, Pu; Cai, Yuxuan; Shen, Xuan; Zhan, Zheng; Kong, Zhenglun; Jin, Qing; Chen, Zhiyu; Liu, Sijia; Yang, Kaiyuan; Ren, Bin; Wang, Yanzhi; Lin, Xue

67ms on Mobile with over 78% ImageNet Accuracy - Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration Technical Report

2020.

Links | BibTeX

941.

Zhang, Haoyu; Jin, Yaochu; Cheng, Ran; Hao, Kuangrong

Sampled Training and Node Inheritance for Fast Evolutionary Neural Architecture Search Technical Report

2020.

Links | BibTeX

940.

Zhao, Z; -e Zhang, G; Jiang, M; Feng, L; Tan, K C

EDNAS: An Efficient Neural Architecture Design based on Distribution Estimation Technical Report

2020.

Links | BibTeX

939.

Awad, Noor; Mallik, Neeratyoy; Hutter, Frank

Differential Evolution for Neural Architecture Search Technical Report

2020.

Links | BibTeX

938.

Mazyavkina, Nina; Moustafa, S; Trofimov, Ilya; Burnaev, Evgeniy

Optimizing the Neural Architecture of Reinforcement Learning Agents Technical Report

2020.

Links | BibTeX

937.

Fan, Y; Tang, X; Zhou, G; Shen, J

EfficientAutoGAN: Predicting the rewards in reinforcement-based neural architecture search for Generative Adversarial Networks Technical Report

2020.

Links | BibTeX

936.

Ma, Benteng; Zhang, Jing; Xia, Yong; Tao, Dacheng

Inter-layer Transition in Neural Architecture Search Technical Report

2020.

Links | BibTeX

935.

Hu, Shengran; Cheng, Ran; He, Cheng; Lu, Zhichao

Multi-objective Neural Architecture Search with Almost No Training Technical Report

2020.

Links | BibTeX

934.

Kyriakides, George; Margaritis, Konstantinos G

NORD - A python framework for Neural Architecture Search Technical Report

2020.

Links | BibTeX

933.

Liang, Yi-Chuan; Liao, Ying-Chiao; Lin, Chen-Ching; Hung, Shih-Hao

Toward Fast Platform-Aware Neural Architecture Search for FPGA-Accelerated Edge AI Applications Proceedings Article

In: pp. 219-225, 2020.

Links | BibTeX

932.

Chen, Hanlin; Zhang, Baochang; Xue, Song; Gong, Xuan; Liu, Hong; Ji, Rongrong; Doermann, David S

Anti-bandit Neural Architecture Search for Model Defense Proceedings Article

In: pp. 70-85, 2020.

Links | BibTeX

931.

Borgohain, Satya; Kowadlo, Gideon; Rawlinson, David; Bergmeir, Christoph; Loo, Kok; Rangarajan, Harivallabha; Kuhlmann, Levin

Self-organising Neural Network Hierarchy Proceedings Article

In: pp. 359-370, 2020.

Links | BibTeX

930.

Mauch, Lukas; Tiedemann, Stephen; García, Javier Alonso; Cong, Bac Nguyen; Yoshiyama, Kazuki; Cardinaux, Fabien; Kemp, Thomas

Efficient Sampling for Predictor-Based Neural Architecture Search Technical Report

2020.

Links | BibTeX

929.

Wang, Xiaoxing; Chu, Xiangxiang; Fan, Yuda; Zhang, Zhexi; Wei, Xiaolin; Yan, Junchi; Yang, Xiaokang

ROME - Robustifying Memory-Efficient NAS via Topology Disentanglement and Gradients Accumulation Technical Report

2020.

Links | BibTeX

928.

Li, Xudong; Hu, Yang; Zheng, Jianhua; Li, Mingtao

Neural Architecture Search For Fault Diagnosis Technical Report

2020.

Links | BibTeX

927.

Yan, Zhicheng; Dai, Xiaoliang; Zhang, Peizhao; Tian, Yuandong; Wu, Bichen; Feiszli, Matt

FP-NAS - Fast Probabilistic Neural Architecture Search Technical Report

2020.

Links | BibTeX

926.

Ci, Yuanzheng; Lin, Chen; Sun, Ming; Chen, Boyu; Zhang, Hongwen; Ouyang, Wanli

Evolving Search Space for Neural Architecture Search Technical Report

2020.

Links | BibTeX

925.

ElSaid, AbdElRahman A; Karns, Joshua; Lyu, Zimeng; Ororbia, Alexander; Desell, Travis

Continuous Ant-Based Neural Topology Search Technical Report

2020.

Links | BibTeX

924.

Zhao, Tianchen; Ning, Xuefei; Yang, Songyi; Liang, Shuang; Lei, Peng; Chen, Jianfei; Yang, Huazhong; Wang, Yu

BARS - Joint Search of Cell Topology and Layout for Accurate and Efficient Binary ARchitectures Technical Report

2020.

Links | BibTeX

923.

Finkler, Ulrich; Merler, Michele; Panda, Rameswar; Jaiswal, Mayoore S; Wu, Hui; Ramakrishnan, Kandan; Chen, Chun-Fu; Cho, Minsik; Kung, David S; Feris, Rogério; Bhattacharjee, Bishwaranjan

Large Scale Neural Architecture Search with Polyharmonic Splines Technical Report

2020.

Links | BibTeX

922.

Li, Yaoman; King, Irwin

AutoGraph - Automated Graph Neural Network Proceedings Article

In: pp. 189-201, 2020.

Links | BibTeX

921.

Yue, Zhixiong; Lin, Baijiong; Huang, Xiaonan; Zhang, Yu

Effective, Efficient and Robust Neural Architecture Search Technical Report

2020.

Links | BibTeX

920.

Nascimento, Marcelo Gennari Do; Costain, Theo W; Prisacariu, Victor Adrian

Finding Non-uniform Quantization Schemes Using Multi-task Gaussian Processes Proceedings Article

In: pp. 383-398, 2020.

Links | BibTeX

919.

Chu, Xiangxiang; Zhou, Tianbao; Zhang, Bo; Li, Jixiang

Fair DARTS - Eliminating Unfair Advantages in Differentiable Architecture Search Proceedings Article

In: pp. 465-480, 2020.

Links | BibTeX

918.

Dai, Xiyang; Chen, Dongdong; Liu, Mengchen; Chen, Yinpeng; Yuan, Lu

DA-NAS - Data Adapted Pruning for Efficient Neural Architecture Search Proceedings Article

In: pp. 584-600, 2020.

Links | BibTeX

917.

Hu, Yutao; Jiang, Xiaolong; Liu, Xuhui; Zhang, Baochang; Han, Jungong; Cao, Xianbin; Doermann, David S

NAS-Count - Counting-by-Density with Neural Architecture Search Proceedings Article

In: pp. 747-766, 2020.

Links | BibTeX

916.

Tabarisaadi, Pegah; Khosravi, Abbas; Nahavandi, Saeid

Bayesian Randomly Wired Neural Network with Variational Inference for Image Recognition Proceedings Article

In: pp. 197-207, 2020.

Links | BibTeX

915.

Vidnerová, Petra; Neruda, Roman

Multi-objective Evolution for Deep Neural Network Architecture Search Proceedings Article

In: pp. 270-281, 2020.

Links | BibTeX

914.

Hu, Kai; Ding, Dong; Tian, Shuo; Gong, Rui; Luo, Li; Wang, Lei

FTR-NAS - Fault-Tolerant Recurrent Neural Architecture Search Proceedings Article

In: pp. 589-597, 2020.

Links | BibTeX

913.

Pauletto, Loïc; Amini, Massih-Reza; Babbar, Rohit; Winckler, Nicolas

Neural Architecture Search for Extreme Multi-label Text Classification Proceedings Article

In: pp. 282-293, 2020.

Links | BibTeX

912.

Huang, Tao; You, Shan; Yang, Yibo; Tu, Zhuozhuo; Wang, Fei; Qian, Chen; Zhang, Changshui

Explicitly Learning Topology for Differentiable Neural Architecture Search Technical Report

2020.

Links | BibTeX

911.

Wang, Dilin; Li, Meng; Gong, Chengyue; Chandra, Vikas

AttentiveNAS - Improving Neural Architecture Search via Attentive Sampling Technical Report

2020.

Links | BibTeX

910.

McNally, William J; Vats, Kanav; Wong, Alexander; McPhee, John

EvoPose2D - Pushing the Boundaries of 2D Human Pose Estimation using Neuroevolution Technical Report

2020.

Links | BibTeX

909.

(Ed.)

Reducing Inference Latency with Concurrent Architectures for Image Recognition Collection

2020.

Links | BibTeX

908.

Heidari, Negar; Iosifidis, Alexandros

Progressive Spatio-Temporal Graph Convolutional Network for Skeleton-Based Human Action Recognition Technical Report

2020.

Links | BibTeX

907.

Lee, Royson; Dudziak, Lukasz; Abdelfattah, Mohamed S; Venieris, Stylianos I; Kim, Hyeji; Wen, Hongkai; Lane, Nicholas D

Journey Towards Tiny Perceptual Super-Resolution Proceedings Article

In: pp. 85-102, 2020.

Links | BibTeX

906.

Pasunuru, Ramakanth; Bansal, Mohit

FENAS - Flexible and Expressive Neural Architecture Search Proceedings Article

In: pp. 2869-2876, 2020.

Links | BibTeX

905.

Park, Daniel S; Lee, Jaehoon; Peng, Daiyi; Cao, Yuan; Sohl-Dickstein, Jascha

Towards NNGP-guided Neural Architecture Search Technical Report

2020.

Links | BibTeX

904.

Zheng, Huahuan; An, Keyu; Ou, Zhijian

Efficient Neural Architecture Search for End-to-end Speech Recognition via Straight-Through Gradients Technical Report

2020.

Links | BibTeX

903.

Calisto, Maria Baldeon G; Lai-Yuen, Susana K

Neural Architecture Search with an Efficient Multiobjective Evolutionary Framework Technical Report

2020.

Links | BibTeX

902.

Liu, Chang; Tian, Yunjie; Jiao, Jianbin; Ye, Qixiang

Adaptive Linear Span Network for Object Skeleton Detection Technical Report

2020.

Links | BibTeX

901.

Zhang, Chunhui; Liang, Yongyuan; Yuan, Xiaoming; Cheng, Lei

FDNAS - Improving Data Privacy and Model Diversity in AutoML Technical Report

2020.

Links | BibTeX

900.

Li, Yanxi; Yang, Zhaohui; Wang, Yunhe; Xu, Chang

Adapting Neural Architectures Between Domains Proceedings Article

In: 2020.

Links | BibTeX

899.

Shi, Han; Pi, Renjie; Xu, Hang; Li, Zhenguo; Kwok, James T; Zhang, Tong

Bridging the Gap between Sample-based and One-shot Neural Architecture Search with BONAS Proceedings Article

In: 2020.

Links | BibTeX

3298 entries « 48 of 66 »