AutoML.org

Freiburg-Hannover

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


1370 entries « 1 of 28 »

2022

1370.

Fei, Ke; Li, Qi; Zhu, Congcong

Non-technical losses detection using missing values’ pattern and neural architecture search Journal Article

In: International Journal of Electrical Power & Energy Systems, 134 , pp. 107410, 2022, ISSN: 0142-0615.

Abstract | Links | BibTeX

2021

1369.

Yan, Kefan; Wang, Shunlong; Guan, Yuwei; Jiang, Ailian

TNAS: Neural Network Architecture Search Sampling Module Based on Variational Autoencoder Journal Article

In: CONVERTER, pp. 288-296, 2021.

Links | BibTeX

1368.

Zhao, Zimin; Kang, Ying; Hou, Aiqin; Gan, Daguang

SP-DARTS: Synchronous Progressive Differentiable Neural Architecture Search for Image Classification Journal Article

In: IEICE TRANSACTIONS on Information and Systems , E104-D (8 ), pp. 1232-1238, 2021, ISBN: 1745-1361.

Links | BibTeX

1367.

Wendlinger, Lorenz; Berndl, Emanuel; Granitzer, Michael

Methods for Automatic Machine-Learning Workflow Analysis Inproceedings

In: ECML PKDD 2021, 2021.

Links | BibTeX

1366.

Zhu, Yanming; Meijering, Erik

Automatic Improvement of Deep Learning Based Cell Segmentation in Time-Lapse Microscopy by Neural Architecture Search Journal Article

In: Bioinformatics, 2021.

Links | BibTeX

1365.

Zhao, Jiejie; Lv, Weifeng; Du, Bowen; Ye, Junchen; Sun, Leilei; Xiong, Guixi

Deep multi-task learning with flexible and compact architecture search Journal Article

In: International Journal of Data Science and Analytics , 2021.

Links | BibTeX

1364.

Ünal, Hamit Taner; Başçiftçi, Fatih

Evolutionary design of neural network architectures: a review of three decades of research Journal Article

In: Artificial Intelligence Review, 2021.

Links | BibTeX

1363.

Coquelin, Daniel; Sedona, Rocco; Riedel, Morris; Götz, Markus

Evolutionary Optimization of Neural Architectures in Remote Sensing Classification Problems Technical Report

2021.

Links | BibTeX

1362.

Yu, Kaicheng

From Human-Designed Convolutional Neural Networks Towards Robust Neural Architecture Search PhD Thesis

2021.

Abstract | Links | BibTeX

1361.

Siems, Julien; Klein, Aaron; Archambeau, Cedric; Mahsereci, Maren

Dynamic Pruning of a Neural Networkvia Gradient Signal-to-Noise Ratio Inproceedings

In: 8th ICML Workshop on Automated Machine Learning (2021), 2021.

Links | BibTeX

1360.

Tian, Ye; Peng, Shichen; Yang, Shangshang; Zhang, Xingyi; Tan, Kay Chen; Jin, Yaochu

Action Command Encoding for SurrogateAssisted Neural Architecture Search Technical Report

2021.

Links | BibTeX

1359.

Sääw, Daniel; Nijweide, Frederik

Exploring the feasibility of Weight Agnostic Neural Networks for low-end hardware Technical Report

2021.

Links | BibTeX

1358.

White, Colin; Nolen, Sam; Savani, Yash

Exploring the Loss Landscape in Neural Architecture Search Inproceedings

In: 37th Conference on Uncertainty in Artificial Intelligence (UAI 2021), 2021.

Links | BibTeX

1357.

Lin, Yi; Liu, Yanfei; Liu, Jingguang; Liu, Guocai; Ma, Kai; Zheng, Yefeng

LE-NAS: Learning-based Ensemble with Neural Architecture Search for 3D Radiotherapy Dose Prediction Journal Article

In: 2021.

Links | BibTeX

1356.

Dimanov, Daniel; Balaguer-Ballester, Emili; Singleton, Colin; Rostami, Shahin

Moncae: Multi-Objective Neuroevolution of Convolutional Autoencoders Inproceedings

In: 2nd Workshop on Neural Architecture Search at ICLR 2021, 2021.

Links | BibTeX

1355.

Jin, Yaochu; Wang, Handing; Sun, Chaoli

Surrogate-Assisted Evolutionary Neural Architecture Search Inproceedings

In: Data-Driven Evolutionary Optimization, pp. 373-387, 2021, ISBN: 978-3-030-74640-7.

Links | BibTeX

1354.

Zhu, Wei; Ni, Yuan; Wang, Xiaoling; Xie, Guotong; Zhang, Fang

Discovering Better Model Architectures for Medical Query Understanding Inproceedings

In: Proceedings of NAACL HLT 2021: IndustryTrack Papers, pp. 230-237, 2021.

Links | BibTeX

1353.

Dai, Xiaoliang; Wan, Alvin; Zhang, Peizhao; Wu, Bichen; He, Zijian; Wei, Zhen; Chen, Kan; Tian, Yuandong; Yu, Matthew; Vajda, Peter; Gonzalez, Joseph E.

FBNetV3: Joint Architecture-Recipe Search using Predictor Pretraining Incollection

In: CVPR2021, 2021.

Links | BibTeX

1352.

Ma, Xiaohan; Si, Chang; Wang, Ying; Liu, Cheng; Zhang1, Lei

NASA: Accelerating Neural Network Design with a NAS Processor Inproceedings

In: 2021 ACM/IEEE 48th Annual International Symposium on Computer Architecture (ISCA), 2021.

Links | BibTeX

1351.

Liu, Shaoli; Zheng, Chengjian; Lu, Kaidi; Gao, Si; Wang, Ning; Wang, Bofei; Zhang, Diankai; Zhang, Xiaofeng; Xu, Tianyu

EVSRNet: Efficient Video Super-Resolution With Neural Architecture Search Inproceedings

In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pp. 2480-2485, 2021.

Links | BibTeX

1350.

Geraeinejad, V.; Seenan, S.; Modarressi, M.; Daneshtalab, M.

RoCo-NAS : Robust and Compact Neural Architecture Search Inproceedings

In: The international joint conference on neural networks IJCNN, 2021.

Links | BibTeX

1349.

Tsokov, Stefan; Lazarova, Milena; Aleksieva-Petrova, Adelina

An Evolutionary Approach to the Design of Convolutional Neural Networks for Human Activity Recognition Journal Article

In: Indian Journal of Computer Science and Engineering, 2021.

Links | BibTeX

1348.

Huang, Shenyang; Francois-Lavet, Vincent; Rabusseau, Guillaume

Understanding Capacity Saturation in Incremental Learning Inproceedings

In: The 34th Canadian Conference on Artificial Intelligence, 2021.

Links | BibTeX

1347.

Chen, Wuyang; Gong, Xinyu; Wang, Zhangyang

Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective Inproceedings

In: ICLR 2021, 2021.

Links | BibTeX

1346.

Anwar, Abrar

Evolving Spiking Circuit Motifs Using Weight Agnostic Neural Networks Journal Article

In: Proceedings of the AAAI Conference on Artificial Intelligence, 35 (18), pp. 15956-15957, 2021.

Links | BibTeX

1345.

Wang, Xiaobo

Teacher Guided Neural Architecture Search for Face Recognition Journal Article

In: Proceedings of the AAAI Conference on Artificial Intelligence, 35 (4), pp. 2817-2825, 2021.

Links | BibTeX

1344.

Perenda, Erma; Rajendran, Sreeraj; Bovet, Gerome; Pollin, Sofie; Zheleva, Mariya

Evolutionary Optimization of Residual Neural Network Architectures for Modulation Classification Miscellaneous

2021.

Links | BibTeX

1343.

Yuan, Zhihang; Liu, Jingze; Li, Xingchen; Yan, Longhao; Chen, Haoxiang; Wu, Bingzhe; Yang, Yuchao; Sun, Guangyu

NAS4RRAM: neural network architecture search for inference on RRAM-based accelerators Journal Article

In: Science China Information Sciences, 2021.

Links | BibTeX

1342.

Zhang, Yi; Liu, Yang; Liu, X. Shirley

Neural network architecture search with AMBER Journal Article

In: Nature Machine Intelligence, pp. 372-373, 2021.

Links | BibTeX

1341.

Schoenherr, Georg P.

The Nonlinearity Coefficient - A Practical Guide to Neural Architecture Design PhD Thesis

2021.

Links | BibTeX

1340.

Yang, Yuxuan; Gao, Zhongke; Li, Yanli; Wang, He

A CNN identified by reinforcement learning-based optimization framework for EEG-based state evaluation Journal Article

In: Journal of Neural Engineering, 18 (4), pp. 046059, 2021.

Abstract | Links | BibTeX

1339.

Pan, Zheyi; Ke, Songyu; Yang, Xiaodu; Liang, Yuxuan; Yu, Yong; Zhang, Junbo; Zheng, Yu

AutoSTG: Neural Architecture Search forPredictions of Spatio-Temporal Graphs Inproceedings

In: WWW 2021, 2021.

Links | BibTeX

1338.

Kyriakides, George; Margaritis, Konstantinos

Evolving graph convolutional networks for neural architecture search Journal Article

In: Neural Computing and Applications, 2021.

Abstract | Links | BibTeX

1337.

Wang, Linnan; Xie, Saining; Li, Teng; Fonseca, Rodrigo; Tian, Yuandong

Sample-Efficient Neural Architecture Search by Learning Actions for Monte Carlo Tree Search Journal Article

In: IEEE transactions on pattern analysis and machine intelligence, PP , 2021, ISSN: 0162-8828.

Abstract | Links | BibTeX

1336.

Zhang, Zhentong; Shan, Yugang; Yuan, Jie

Multi-Level Cell Progressive Differentiable Architecture Search to Improve Image Classification Accuracy Journal Article

In: Journal of Signal Processing Systems, 2021.

Abstract | Links | BibTeX

1335.

Zimmer, Lucas; Lindauer, Marius; Hutter, Frank

Auto-Pytorch: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL Journal Article

In: IEEE transactions on pattern analysis and machine intelligence, PP , 2021, ISSN: 0162-8828.

Abstract | Links | BibTeX

1334.

Zheng, X; Ji, R; Chen, Y; Wang, Q; Zhang, B; Ye, Q; Chen, J; Huang, F; Tian, Y

MIGO-NAS: Towards Fast and Generalizable Neural Architecture Search Journal Article

In: IEEE Transactions on Pattern Analysis & Machine Intelligence, (01), pp. 1-1, 2021, ISSN: 1939-3539.

Links | BibTeX

1333.

Liu, Lanlan; Zhang, Yuting; Deng, Jia; Soatto, Stefano

Dynamically Grown Generative Adversarial Networks Inproceedings

In: AAAI 2021, 2021.

Links | BibTeX

1332.

Hao, Jie; Zhu, William

Architecture self-attention mechanism: nonlinear optimization for neural architecture search Journal Article

In: Journal of Nonlinear and Variational Analysis, 5 , pp. 119-140, 2021.

Links | BibTeX

1331.

Xu, Y; Xie, L; Dai, W; Zhang, X; Chen, X; Qi, G; Xiong, H; Tian, Q

Partially-Connected Neural Architecture Search for Reduced Computational Redundancy Journal Article

In: IEEE Transactions on Pattern Analysis & Machine Intelligence, (01), pp. 1-1, 2021, ISSN: 1939-3539.

Abstract | Links | BibTeX

1330.

Liao, Yi-Lun; Karaman, Sertac; Sze, Vivienne

Searching for Efficient Multi-Stage Vision Transformers Technical Report

, 2021.

Links | BibTeX

1329.

Liu, Jinyuan; Wu, Yuhui; Huang, Zhanbo; Liu, Risheng; Fan, Xin

SMoA: Searching a Modality-Oriented Architecture for Infrared and Visible Image Fusion Journal Article

In: IEEE Signal Processing Letters, 28 , pp. 1818-1822, 2021.

Links | BibTeX

1328.

Umamageswari, A.; Bharathiraja, N.; Irene, D. Shiny

A Novel Fuzzy C-Means based Chameleon Swarm Algorithm for Segmentation and Progressive Neural Architecture Search for Plant Disease Classification Journal Article

In: ICT Express, 2021, ISSN: 2405-9595.

Abstract | Links | BibTeX

1327.

Shu, Yao; Cai, Shaofeng; Dai, Zhongxiang; Ooi, Beng Chin; Low, Bryan Kian Hsiang

NASI: Label- and Data-agnostic Neural Architecture Search at Initialization Technical Report

, 2021.

Links | BibTeX

1326.

Deng, Jiajun; Gutierrez, Fabian Ritter; Hu, Shoukang; Geng, Mengzhe; Xie, Xurong; Ye, Zi; Liu, Shansong; Yu, Jianwei; Liu, Xunying; Meng, Helen

Bayesian Parametric and Architectural Domain Adaptation of LF-MMI Trained TDNNs for Elderly and Dysarthric Speech Recognition Inproceedings

In: Proc. Interspeech 2021, pp. 4818–4822, 2021.

Links | BibTeX

1325.

Gong, Xinyu; Wang, Heng; Shou, Zheng; Feiszli, Matt; Wang, Zhangyang; Yan, Zhicheng

Searching for Two-Stream Models in Multivariate Space for Video Recognition Technical Report

, 2021.

Links | BibTeX

1324.

Yu, Kaicheng; Ranftl, Rene; Salzmann, Mathieu

An Analysis of Super-Net Heuristics in Weight-Sharing NAS Journal Article

In: IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1-1, 2021.

Links | BibTeX

1323.

Xue, Song; Zhao, Bo; Chen, Hanlin; Wang, Runqi; Zhang, Baochang

UCB-ENAS based on Reinforcement Learning Inproceedings

In: 2021 IEEE 16th Conference on Industrial Electronics and Applications (ICIEA), pp. 2008-2013, 2021.

Links | BibTeX

1322.

Nie, Xing; Liu, Yongcheng; Chen, Shaohong; Chang, Jianlong; Huo, Chunlei; Meng, Gaofeng; Tian, Qi; Hu, Weiming; Pan, Chunhong

Differentiable Convolution Search for Point Cloud Processing Technical Report

, 2021.

Links | BibTeX

1321.

Li, Yuening; Chen, Zhengzhang; Zha, Daochen; Zhou, Kaixiong; Jin, Haifeng; Chen, Haifeng; Hu, Xia

Automated Anomaly Detection via Curiosity-Guided Search and Self-Imitation Learning Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-13, 2021.

Links | BibTeX

1370 entries « 1 of 28 »