AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


2559 entries « 2 of 52 »

2023

2509.

Li, Chuanyou; Zhang, Kun; Li, Yifan; Shang, Jiangwei; Zhang, Xinyue; Qian, Lei

ANNA: Accelerating Neural Network Accelerator through software-hardware co-design for vertical applications in edge systems Journal Article

In: Future Generation Computer Systems, vol. 140, pp. 91-103, 2023, ISSN: 0167-739X.

Abstract | Links | BibTeX

2508.

Zharikov, Ilia; Krivorotov, Ivan; Maximov, Egor; Korviakov, Vladimir; Letunovskiy, Alexey

Ä Review of One-Shot Neural Architecture Search Methods Inproceedings

In: Kryzhanovsky, Boris; Dunin-Barkowski, Witali; Redko, Vladimir; Tiumentsev, Yury (Ed.): Ädvances in Neural Computation, Machine Learning, and Cognitive Research VI", pp. 130–147, Springer International Publishing, Cham, 2023, ISBN: 978-3-031-19032-2.

Abstract | BibTeX

2507.

Kolganov, Pavel A.; Tiumentsev, Yury V.

Än Attempt to Formalize the Formulation of the Network Architecture Search Problem for Convolutional Neural Networks Inproceedings

In: Kryzhanovsky, Boris; Dunin-Barkowski, Witali; Redko, Vladimir; Tiumentsev, Yury (Ed.): Ädvances in Neural Computation, Machine Learning, and Cognitive Research VI", pp. 550–556, Springer International Publishing, Cham, 2023, ISBN: 978-3-031-19032-2.

Abstract | BibTeX

2506.

Graham-Knight, John Brandon; Bond, Corey; Najjaran, Homayoun; Lucet, Yves; Lasserre, Patricia

Predicting and explaining performance and diversity of neural network architecture for semantic segmentation Journal Article

In: Expert Systems with Applications, vol. 214, pp. 119101, 2023, ISSN: 0957-4174.

Abstract | Links | BibTeX

2505.

Sun, Yanan; Yen, Gary G.; Zhang, Mengjie

End-to-End Performance Predictors Book Chapter

In: Evolutionary Deep Neural Architecture Search: Fundamentals, Methods, and Recent Advances, pp. 237–255, Springer International Publishing, Cham, 2023, ISBN: 978-3-031-16868-0.

Abstract | Links | BibTeX

2504.

Sun, Yanan; Yen, Gary G.; Zhang, Mengjie

Hybrid GA and PSO for Architecture Design Book Chapter

In: Evolutionary Deep Neural Architecture Search: Fundamentals, Methods, and Recent Advances, pp. 171–180, Springer International Publishing, Cham, 2023, ISBN: 978-3-031-16868-0.

Abstract | Links | BibTeX

2503.

Sun, Yanan; Yen, Gary G.; Zhang, Mengjie

Architecture Design for Skip-Connection Based CNNs Book Chapter

In: Evolutionary Deep Neural Architecture Search: Fundamentals, Methods, and Recent Advances, pp. 147–170, Springer International Publishing, Cham, 2023, ISBN: 978-3-031-16868-0.

Abstract | Links | BibTeX

2502.

Sun, Yanan; Yen, Gary G.; Zhang, Mengjie

Differential Evolution for Architecture Design Book Chapter

In: Evolutionary Deep Neural Architecture Search: Fundamentals, Methods, and Recent Advances, pp. 193–202, Springer International Publishing, Cham, 2023, ISBN: 978-3-031-16868-0.

Abstract | Links | BibTeX

2501.

Jing, Kun; Chen, Luoyu; Xu, Jungang

An architecture entropy regularizer for differentiable neural architecture search Journal Article

In: Neural Networks, vol. 158, pp. 111-120, 2023, ISSN: 0893-6080.

Abstract | Links | BibTeX

2500.

Yao, Fengqin; Wang, Shengke; Ding, Laihui; Zhong, Guoqiang; Bullock, Leon Bevan; Xu, Zhiwei; Dong, Junyu

Lightweight network learning with Zero-Shot Neural Architecture Search for UAV images Journal Article

In: Knowledge-Based Systems, vol. 260, pp. 110142, 2023, ISSN: 0950-7051.

Abstract | Links | BibTeX

2499.

Wang, Wenna; Zhang, Xiuwei; Cui, Hengfei; Yin, Hanlin; Zhang, Yannnig

FP-DARTS: Fast parallel differentiable neural architecture search for image classification Journal Article

In: Pattern Recognition, vol. 136, pp. 109193, 2023, ISSN: 0031-3203.

Abstract | Links | BibTeX

2498.

Jin, Cong; Huang, Jinjie; Wei, Tianshu; Chen, Yuanjian

Neural architecture search based on dual attention mechanism for image classification Journal Article

In: Mathematical Biosciences and Engineering, vol. 20, no. 2, pp. 2691-2715, 2023, ISSN: 1551-0018.

Links | BibTeX

2497.

Jin, Yaochu; Zhu, Hangyu; Xu, Jinjin; Chen, Yang

Evolutionary Multi-objective Federated Learning Book Chapter

In: Federated Learning: Fundamentals and Advances, pp. 139–164, Springer Nature Singapore, Singapore, 2023, ISBN: 978-981-19-7083-2.

Abstract | Links | BibTeX

2496.

Lyu, Bo; Lu, Longfei; Hamdi, Maher; Wen, Shiping; Yang, Yin; Li, Ke

MTLP-JR: Multi-task learning-based prediction for joint ranking in neural architecture search Journal Article

In: Computers and Electrical Engineering, vol. 105, pp. 108474, 2023, ISSN: 0045-7906.

Abstract | Links | BibTeX

2495.

Gudzius, Povilas; Kurasova, Olga; Darulis, Vytenis; Filatovas, Ernestas

AutoML-Based Neural Architecture Search for Object Recognition in Satellite Imagery Journal Article

In: Remote Sensing, vol. 15, no. 1, 2023, ISSN: 2072-4292.

Abstract | Links | BibTeX

2494.

Wang, Xiaojuan; He, Mingshu; Yang, Liu; Wang, Hui; Zhong, Yun

Human Activity Recognition Based on an Efficient Neural Architecture Search Framework Using Evolutionary Multi-Objective Surrogate-Assisted Algorithms Journal Article

In: Electronics, vol. 12, no. 1, 2023, ISSN: 2079-9292.

Abstract | Links | BibTeX

2493.

Verma, Monu; Lubal, Priyanka; Vipparthi, Santosh Kumar; Abdel-Mottaleb, Mohamed

RNAS-MER: A Refined Neural Architecture Search With Hybrid Spatiotemporal Operations for Micro-Expression Recognition Inproceedings

In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp. 4770-4779, 2023.

Links | BibTeX

2492.

Nagpure, Vikrant; Okuma, Kenji

Searching Efficient Neural Architecture With Multi-Resolution Fusion Transformer for Appearance-Based Gaze Estimation Inproceedings

In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp. 890-899, 2023.

Links | BibTeX

2491.

Ahn, Daehyun; Kim, Hyungjun; Kim, Taesu; Park, Eunhyeok; Kim, Jae-Joon

Searching for Robust Binary Neural Networks via Bimodal Parameter Perturbation Inproceedings

In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp. 2410-2419, 2023.

Links | BibTeX

2490.

Li, Yinqiao; Cao, Runzhe; He, Qiaozhi; Xiao, Tong; Zhu, Jingbo

Learning Reliable Neural Networks with Distributed Architecture Representations Journal Article

In: ACM Trans. Asian Low-Resour. Lang. Inf. Process., 2023, ISSN: 2375-4699, (Just Accepted).

Abstract | Links | BibTeX

2489.

Ahmadian, Arash; Fei, Yue; Liu, Louis S. P.; Plataniotis, Konstantinos N.; Hosseini, Mahdi S.

Pseudo-Inverted Bottleneck Convolution for DARTS Search Space Technical Report

2023.

Links | BibTeX

2488.

Ding, Li; Spector, Lee

Multi-Objective Evolutionary Architecture Search for Parameterized Quantum Circuits Journal Article

In: Entropy, vol. 25, no. 1, 2023, ISSN: 1099-4300.

Abstract | Links | BibTeX

2487.

Saeed, Fahman; Hussain, Muhammad; Aboalsamh, Hatim A.; Adel, Fadwa Al; Owaifeer, Adi Mohammed Al

Designing the Architecture of a Convolutional Neural Network Automatically for Diabetic Retinopathy Diagnosis Journal Article

In: Mathematics, vol. 11, no. 2, 2023, ISSN: 2227-7390.

Abstract | Links | BibTeX

2486.

Magalhães, Dimmy; Lima, Ricardo H. R.; Pozo, Aurora

Creating deep neural networks for text classification tasks using grammar genetic programming Journal Article

In: Applied Soft Computing, pp. 110009, 2023, ISSN: 1568-4946.

Abstract | Links | BibTeX

2485.

Li, Xingzhuo; Hou, Sujuan; Zhang, Baisong; Wang, Jing; Jia, Weikuan; Zheng, Yuanjie

Long-Range Dependence Involutional Network for Logo Detection Journal Article

In: Entropy, vol. 25, no. 1, 2023, ISSN: 1099-4300.

Abstract | Links | BibTeX

2484.

Xie, Xiangning; Song, Xiaotian; Lv, Zeqiong; Yen, Gary G.; Ding, Weiping; Sun, Yanan

Efficient Evaluation Methods for Neural Architecture Search: A Survey Technical Report

2023.

Links | BibTeX

2483.

Lee, Seunghyun; Song, Byung Cheol

Fast Filter Pruning via Coarse-to-Fine Neural Architecture Search and Contrastive Knowledge Transfer Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-12, 2023.

Links | BibTeX

2482.

Chauhan, Anshumaan; Bhattacharyya, Siddhartha; Vadivel, S.

DQNAS: Neural Architecture Search using Reinforcement Learning Technical Report

2023.

Links | BibTeX

2481.

Ye, Peng; He, Tong; Li, Baopu; Chen, Tao; Bai, Lei; Ouyang, Wanli

(beta)-DARTS++: Bi-level Regularization for Proxy-robust Differentiable Architecture Search Technical Report

2023.

Links | BibTeX

2480.

Ford, Noah; Winder, John; McClellan, Josh

Adaptive Neural Networks Using Residual Fitting Technical Report

2023.

Links | BibTeX

2479.

Lakhmiri, Dounia; Zolnouri, Mahdi; Nia, Vahid Partovi; Tribes, Christophe; Digabel, Sébastien Le

Scaling Deep Networks with the Mesh Adaptive Direct Search algorithm Technical Report

2023.

Links | BibTeX

2478.

White, Colin; Safari, Mahmoud; Sukthanker, Rhea; Ru, Binxin; Elsken, Thomas; Zela, Arber; Dey, Debadeepta; Hutter, Frank

Neural Architecture Search: Insights from 1000 Papers Technical Report

2023.

Links | BibTeX

2477.

Kong, Gangwei; Li, Chang; Peng, Hu; Han, Zhihui; Qiao, Heyuan

EEG-Based Sleep Stage Classification via Neural Architecture Search Journal Article

In: IEEE transactions on neural systems and rehabilitation engineering: a publication of the IEEE Engineering in Medicine and Biology Society, 2023.

Links | BibTeX

2476.

Shi, Chaokun; Hao, Yuexing; Li, Gongyan; Xu, Shaoyun

EBNAS: Efficient binary network design for image classification via neural architecture search Journal Article

In: Engineering Applications of Artificial Intelligence, vol. 120, pp. 105845, 2023, ISSN: 0952-1976.

Abstract | Links | BibTeX

2475.

Nath, Utkarsh; Wang, Yancheng; Yang, Yingzhen

RNAS-CL: Robust Neural Architecture Search by Cross-Layer Knowledge Distillation Technical Report

2023.

Links | BibTeX

2474.

Jin, Haifeng; Chollet, François; Song, Qingquan; Hu, Xia

AutoKeras: An AutoML Library for Deep Learning Journal Article

In: Journal of Machine Learning Research, vol. 24, no. 6, pp. 1–6, 2023.

Links | BibTeX

2473.

Carrasquilla, Juan; Hibat-Allah, Mohamed; Inack, Estelle; Makhzani, Alireza; Neklyudov, Kirill; Taylor, Graham W.; Torlai, Giacomo

Quantum HyperNetworks: Training Binary Neural Networks in Quantum Superposition Technical Report

2023.

Links | BibTeX

2472.

Shi, Chaokun; Hao, Yuexing; Li, Gongyan; Xu, Shaoyun

EBNAS: Efficient binary network design for image classification via neural architecture search Journal Article

In: Engineering Applications of Artificial Intelligence, vol. 120, pp. 105845, 2023, ISSN: 0952-1976.

Abstract | Links | BibTeX

2471.

Eminaga, Okyaz; Abbas, Mahmoud; Shen, Jeanne; Laurie, Mark; Brooks, James D.; Liao, Joseph C.; Rubin, Daniel L.

PlexusNet: A neural network architectural concept for medical image classification Journal Article

In: Computers in Biology and Medicine, pp. 106594, 2023, ISSN: 0010-4825.

Abstract | Links | BibTeX

2470.

Dong, Peijie; Niu, Xin; Li, Lujun; Tian, Zhiliang; Wang, Xiaodong; Wei, Zimian; Pan, Hengyue; Li, Dongsheng

RD-NAS: Enhancing One-shot Supernet Ranking Ability via Ranking Distillation from Zero-cost Proxies Technical Report

2023.

Links | BibTeX

2469.

Zolnouri, Mahdi; Lakhmiri, Dounia; Tribes, Christophe; Sari, Eyyüb; Digabel, Sébastien Le

Efficient Training Under Limited Resources Technical Report

2023.

Links | BibTeX

2468.

Thomas, Jibin B.; K.V., Shihabudheen

Neural architecture search algorithm to optimize deep Transformer model for fault detection in electrical power distribution systems Journal Article

In: Engineering Applications of Artificial Intelligence, vol. 120, pp. 105890, 2023, ISSN: 0952-1976.

Abstract | Links | BibTeX

2467.

An, Yang; Zhang, Changsheng; Zheng, Xuanyu

Knowledge reconstruction assisted evolutionary algorithm for neural network architecture search Journal Article

In: Knowledge-Based Systems, vol. 264, pp. 110341, 2023, ISSN: 0950-7051.

Abstract | Links | BibTeX

2466.

Li, Guihong; Yang, Yuedong; Bhardwaj, Kartikeya; Marculescu, Radu

ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients Inproceedings

In: ICLR 2023, 2023.

Links | BibTeX

2465.

Liu, Yukun; Li, Ta; Zhang, Pengyuan; Yan, Yonghong

LWMD: A Comprehensive Compression Platform for End-to-End Automatic Speech Recognition Models Journal Article

In: Applied Sciences, vol. 13, no. 3, 2023, ISSN: 2076-3417.

Abstract | Links | BibTeX

2464.

Son, David; Putter, Floran; Vogel, Sebastian; Corporaal, Henk

BOMP-NAS: Bayesian Optimization Mixed Precision NAS Technical Report

2023.

Links | BibTeX

2463.

Wang, Yawen; Zhang, Shihua

Prediction of Tumor Lymph Node Metastasis Using Wasserstein Distance-Based Generative Adversarial Networks Combing with Neural Architecture Search for Predicting Journal Article

In: Mathematics, vol. 11, no. 3, 2023, ISSN: 2227-7390.

Abstract | Links | BibTeX

2462.

Vidnerová, Petra; Kalina, Jan

Multi-objective Bayesian Optimization for Neural Architecture Search Inproceedings

In: Rutkowski, Leszek; Scherer, Rafał; Korytkowski, Marcin; Pedrycz, Witold; Tadeusiewicz, Ryszard; Zurada, Jacek M. (Ed.): Ärtificial Intelligence and Soft Computing", pp. 144–153, Springer International Publishing, Cham, 2023, ISBN: 978-3-031-23492-7.

Abstract | Links | BibTeX

2461.

Huang, Lan; Sun, Shiqi; Zeng, Jia; Wang, Wencong; Pang, Wei; Wang, Kangping

U-DARTS: Uniform-space differentiable architecture search Journal Article

In: Information Sciences, vol. 628, pp. 339-349, 2023, ISSN: 0020-0255.

Abstract | Links | BibTeX

2460.

Ji, Zhanghexuan; Guo, Dazhou; Wang, Puyang; Yan, Ke; Lu, Le; Xu, Minfeng; Zhou, Jingren; Wang, Qifeng; Ge, Jia; Gao, Mingchen; Ye, Xianghua; Jin, Dakai

Continual Segment: Towards a Single, Unified and Accessible Continual Segmentation Model of 143 Whole-body Organs in CT Scans Technical Report

2023.

Links | BibTeX

2559 entries « 2 of 52 »