AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


4236 entries « 37 of 85 »

2023

2436.

Li, Qing; Dai, Haixing; Lv, Jinglei; Zhao, Lin; Liu, Zhengliang; Wu, Zihao; Wu, Xia; Coles, Claire; Hu, Xiaoping; Liu, Tianming; Zhu, Dajiang

Individual Functional Network Abnormalities Mapping via Graph Representation-Based Neural Architecture Search Proceedings Article

In: Yang, Xiaochun; Suhartanto, Heru; Wang, Guoren; Wang, Bin; Jiang, Jing; Li, Bing; Zhu, Huaijie; Cui, Ningning (Ed.): Advanced Data Mining and Applications, pp. 79–91, Springer Nature Switzerland, Cham, 2023, ISBN: 978-3-031-46671-7.

Abstract | Links | BibTeX

2435.

Yang, Shangshang; Zhen, Cheng; Tian, Ye; Ma, Haiping; Liu, Yuanchao; Zhang, Panpan; Zhang, Xingyi

Evolutionary Multi-Objective Neural Architecture Search for Generalized Cognitive Diagnosis Models Proceedings Article

In: 2023 5th International Conference on Data-driven Optimization of Complex Systems (DOCS), pp. 1-10, 2023.

Links | BibTeX

2434.

Shi, Huihong; Xu, Yang; Wang, Yuefei; Mao, Wendong; Wang, Zhongfeng

NASA-F: FPGA-Oriented Search and Acceleration for Multiplication-Reduced Hybrid Networks Journal Article

In: IEEE Transactions on Circuits and Systems I: Regular Papers, pp. 1-14, 2023.

Links | BibTeX

2433.

Dooley, Samuel; Sukthanker, Rhea Sanjay; Dickerson, John P; White, Colin; Hutter, Frank; Goldblum, Micah

Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face Recognition Proceedings Article

In: Thirty-seventh Conference on Neural Information Processing Systems, 2023.

Links | BibTeX

2432.

Niu, Ruicheng; Zhu, Ziyuan; Leng, Tao; Li, Chaofei; Liu, Yuxin; Meng, Dan

Improving Adversarial Robustness via Channel and Depth Compatibility Proceedings Article

In: Yang, Xiaochun; Suhartanto, Heru; Wang, Guoren; Wang, Bin; Jiang, Jing; Li, Bing; Zhu, Huaijie; Cui, Ningning (Ed.): Advanced Data Mining and Applications, pp. 137–149, Springer Nature Switzerland, Cham, 2023, ISBN: 978-3-031-46677-9.

Abstract | BibTeX

2431.

Passos, Dário; Mishra, Puneet

Deep Tutti Frutti: Exploring CNN architectures for dry matter prediction in fruit from multi-fruit near-infrared spectra Journal Article

In: Chemometrics and Intelligent Laboratory Systems, vol. 243, pp. 105023, 2023, ISSN: 0169-7439.

Abstract | Links | BibTeX

2430.

Schrodi, Simon; Stoll, Danny; Ru, Binxin; Sukthanker, Rhea; Brox, Thomas; Hutter, Frank

Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammars Proceedings Article

In: Advances in Neural Information Processing Systems, 2023.

Links | BibTeX

2429.

Sinha, Nilotpal; Shabayek, Abd El Rahman; Kacem, Anis; Rostami, Peyman; Shneider, Carl; Aouada, Djamila

Hardware Aware Evolutionary Neural Architecture Search using Representation Similarity Metric Technical Report

2023.

Links | BibTeX

2428.

McKnight, Shaun; MacKinnon, Christopher; Pierce, S. Gareth; Mohseni, Ehsan; Tunukovic, Vedran; MacLeod, Charles N.; Vithanage, Randika K. W.; OHare, Tom

3-Dimensional residual neural architecture search for ultrasonic defect detection Technical Report

2023.

Links | BibTeX

2427.

Li, Yueyang; Zhang, Qican

NAS-assisted single-shot real-time 3D measurement Proceedings Article

In: Shao, Xiaopeng (Ed.): Third International Computing Imaging Conference (CITA 2023), pp. 129210S, International Society for Optics and Photonics SPIE, 2023.

Links | BibTeX

2426.

Prezja, Fabi; Annala, Leevi; Kiiskinen, Sampsa; Lahtinen, Suvi; Ojala, Timo

Adaptive Variance Thresholding: A Novel Approach to Improve Existing Deep Transfer Vision Models and Advance Automatic Knee-Joint Osteoarthritis Classification Technical Report

2023.

Links | BibTeX

2425.

Hou, Jia; Zhang, Jingyu; Chen, Qi; Xiang, Siwei; Meng, Yishuo; Wang, Jianfei; Lu, Cimang; Yang, Chen

POSS-CNN: An Automatically Generated Convolutional Neural Network with Precision and Operation Separable Structure Aiming at Target Recognition and Detection Journal Article

In: Information, vol. 14, no. 11, 2023, ISSN: 2078-2489.

Abstract | Links | BibTeX

2424.

Wu, Meng-Ting; Tsai, Chun-Wei

Training-free neural architecture search: A review Journal Article

In: ICT Express, 2023, ISSN: 2405-9595.

Abstract | Links | BibTeX

2423.

Dong, Dong; Jiang, Hongxu; Wei, Xuekai; Song, Yanfei; Zhuang, Xu; Wang, Jason

ETNAS: An energy consumption task-driven neural architecture search Journal Article

In: Sustainable Computing: Informatics and Systems, vol. 40, pp. 100926, 2023, ISSN: 2210-5379.

Abstract | Links | BibTeX

2422.

Tang, Siao; Wang, Xin; Chen, Hong; Guan, Chaoyu; Tang, Yansong; Zhu, Wenwu

Lightweight Diffusion Models with Distillation-Based Block Neural Architecture Search Technical Report

2023.

Links | BibTeX

2421.

Li, Yuke; Baik, Jiwon; Rahman, Md Marufi; Anagnostopoulos, Iraklis; Li, Ruopu; Shu, Tong

Pareto Optimization of CNN Models via Hardware-Aware Neural Architecture Search for Drainage Crossing Classification on Resource-Limited Devices Proceedings Article

In: Proceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis, pp. 1767–1775, Association for Computing Machinery, Denver, CO, USA, 2023, ISBN: 9798400707858.

Abstract | Links | BibTeX

2420.

Hsieh, Jun-Wei; Chou, Cheng-Han; Chang, Ming-Ching; Chen, Ping-Yang; Santra, Santanu; Huang, Chih-Sheng

Mean-Shift Based Differentiable Architecture Search Journal Article

In: IEEE Transactions on Artificial Intelligence, pp. 1-11, 2023.

Links | BibTeX

2419.

Chang, Chi-Chih; Sung, Yuan-Yao; Yu, Shixing; Huang, Ning-Chi; Marculescu, Diana; Wu, Kai-Chiang

FLORA: Fine-grained Low-Rank Architecture Search for Vision Transformer Technical Report

2023.

Links | BibTeX

2418.

Chang, Chen-Chia; Pan, Jingyu; Xie, Zhiyao; Zhang, Tunhou; Hu, Jiang; Chen, Yiran

Towards Fully Automated Machine Learning for Routability Estimator Development Journal Article

In: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, pp. 1-1, 2023.

Links | BibTeX

2417.

An, Taegun; Joo, Changhee

CycleGANAS: Differentiable Neural Architecture Search for CycleGAN Technical Report

2023.

Links | BibTeX

2416.

Ji, Junzhong; Wang, Xingyu

Convolutional architecture search based on particle swarm algorithm for functional brain network classification Journal Article

In: Applied Soft Computing, vol. 149, pp. 111049, 2023, ISSN: 1568-4946.

Abstract | Links | BibTeX

2415.

Wen, Wei; Liu, Kuang-Hung; Fedorov, Igor; Zhang, Xin; Yin, Hang; Chu, Weiwei; Hassani, Kaveh; Sun, Mengying; Liu, Jiang; Wang, Xu; Jiang, Lin; Chen, Yuxin; Zhang, Buyun; Liu, Xi; Cheng, Dehua; Chen, Zhengxing; Zhao, Guang; Han, Fangqiu; Yang, Jiyan; Hao, Yuchen; Xiong, Liang; Chen, Wen-Yen

Rankitect: Ranking Architecture Search Battling World-class Engineers at Meta Scale Technical Report

2023.

Links | BibTeX

2414.

Wang, Zhenrong; Li, Bin; Li, Weifeng; Niu, Shuanlong; Miao, Wang; Niu, Tongzhi

NAS-ASDet: An Adaptive Design Method for Surface Defect Detection Network using Neural Architecture Search Technical Report

2023.

Links | BibTeX

2413.

Hu, Yiming; Chu, Xiangxiang; Zhang, Bo

Masked Autoencoders Are Robust Neural Architecture Search Learners Technical Report

2023.

Links | BibTeX

2412.

Han, Xiaoyu; Li, Chenyu; Wang, Zifan; Liu, Guohua

NDARTS: A Differentiable Architecture Search Based on the Neumann Series Journal Article

In: Algorithms, vol. 16, no. 12, 2023, ISSN: 1999-4893.

Abstract | Links | BibTeX

2411.

Li, Xiangyi; Guo, Jiajia; Wen, Chao-Kai; Jin, Shi

Auto-CsiNet: Scenario-customized Automatic Neural Network Architecture Generation for Massive MIMO CSI Feedback Technical Report

2023.

Links | BibTeX

2410.

Hafiz, Faizal M. F.; Broekaert, Jan; Swain, Akshya

Evolution of Neural Architectures for Financial Forecasting: A Note on Data Incompatibility during Crisis Periods Technical Report

2023.

Links | BibTeX

2409.

Wei, Zimian; Pan, Hengyue; Li, Lujun; Dong, Peijie; Tian, Zhiliang; Niu, Xin; Li, Dongsheng

TVT: Training-Free Vision Transformer Search on Tiny Datasets Technical Report

2023.

Links | BibTeX

2408.

Herberg, Evelyn; Herzog, Roland; Köhne, Frederik; Kreis, Leonie; Schiela, Anton

Sensitivity-Based Layer Insertion for Residual and Feedforward Neural Networks Technical Report

2023.

Links | BibTeX

2407.

Haq, Ijaz Ul; Lee, Byung Suk

TransNAS-TSAD: Harnessing Transformers for Multi-Objective Neural Architecture Search in Time Series Anomaly Detection Technical Report

2023.

Links | BibTeX

2406.

Loya, Hrushikesh; Dudziak, Lukasz; Mehrotra, Abhinav; Lee, Royson; Fernández-Marqués, Javier; Lane, Nicholas D.; Wen, Hongkai

How Much Is Hidden in the NAS Benchmarks? Few-Shot Adaptation of a NAS Predictor Technical Report

2023.

Links | BibTeX

2405.

Benmeziane, Hadjer; Ouarnoughi, Hamza; Niar, Smail; Maghraoui, Kaoutar El

Pareto Rank-Preserving Supernetwork for HW-NAS Technical Report

2023.

Links | BibTeX

2404.

Mohammed, Mubarek

Model Compression Beyond Size Reduction Proceedings Article

In: Conference on Parsimony and Learning (Recent Spotlight Track), 2023.

Links | BibTeX

2403.

Wan, Qiyu; Wang, Lening; Wang, Jing; Song, Shuaiwen Leon; Fu, Xin

NAS-SE: Designing A Highly-Efficient In-Situ Neural Architecture Search Engine for Large-Scale Deployment Proceedings Article

In: Proceedings of the 56th Annual IEEE/ACM International Symposium on Microarchitecture, pp. 756–768, Association for Computing Machinery, <conf-loc>, <city>Toronto</city>, <state>ON</state>, <country>Canada</country>, </conf-loc>, 2023, ISBN: 9798400703294.

Abstract | Links | BibTeX

2402.

Ghebriout, Mohamed Imed Eddine; Bouzidi, Halima; Niar, Sma"ıl; Ouarnoughi, Hamza

Harmonic-NAS: Hardware-Aware Multimodal Neural Architecture Search on Resource-constrained Devices Technical Report

2023.

Links | BibTeX

2401.

McDermott, Luke; Weitz, Jason; Demler, Dmitri; Cummings, Daniel; Tran, Nhan; Duarte, Javier

Neural Architecture Codesign for Fast Bragg Peak Analysis Technical Report

2023.

Links | BibTeX

2400.

Lee, Jaeseong; hwang,

Multilingual Lottery Tickets to Pretrain Language Models Proceedings Article

In: The 2023 Conference on Empirical Methods in Natural Language Processing, 2023.

Links | BibTeX

2399.

Arabi, Pau Mulet; Flowers, Alec; Mauch, Lukas; Cardinaux, Fabien

DBsurf: A Discrepancy Based Method for Discrete Stochastic Gradient Estimation Technical Report

2023.

Links | BibTeX

2398.

Qin, Huafeng; Fan, Chao; Deng, Shaojiang; Li, Yantao; El-Yacoubi, Mounim A.; Zhou, Gang

AG-NAS: An Attention GRU-based Neural Architecture Search for Finger-Vein Recognition Journal Article

In: IEEE Transactions on Information Forensics and Security, pp. 1-1, 2023.

Links | BibTeX

2397.

ZiWen, Dou; Dong, Ye

Multi-objective Neural Architecture Search for Efficient and Fast Semantic Segmentation on Edge Journal Article

In: IEEE Transactions on Intelligent Vehicles, pp. 1-12, 2023.

Links | BibTeX

2396.

Yang, Changdi; Sheng, Yi; Dong, Peiyan; Kong, Zhenglun; Li, Yanyu; Yu, Pinrui; Yang, Lei; Lin, Xue; Wang, Yanzhi

Fast and Fair Medical AI on the Edge Through Neural Architecture Search for Hybrid Vision Models Proceedings Article

In: 2023 IEEE/ACM International Conference on Computer Aided Design (ICCAD), pp. 01-09, 2023.

Links | BibTeX

2395.

Poliakov, Egor; Hung, Wei-Jie; Huang, Ching-Chun

Efficient Constraint-Aware Neural Architecture Search for Object Detection Proceedings Article

In: 2023 Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), pp. 733-740, 2023.

Links | BibTeX

2394.

Liu, Lian; Wang, Ying; Zhao, Xiandong; Chen, Weiwei; Li, Huawei; Li, Xiaowei; Han, Yinhe

An Automatic Neural Network Architecture-and-Quantization Joint Optimization Framework for Efficient Model Inference Journal Article

In: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, pp. 1-1, 2023.

Links | BibTeX

2393.

Sharifi, Zaniar; Soltanian, Khabat; Amiri, Ali

Developing Convolutional Neural Networks using a Novel Lamarckian Co-Evolutionary Algorithm Proceedings Article

In: 2023 13th International Conference on Computer and Knowledge Engineering (ICCKE), pp. 399-408, 2023.

Links | BibTeX

2392.

Li, Xiangyi; Guo, Jiajia; Wen, Chao Kai; Tian, Wenqiang; Jin, Shi

Automatic Neural Network Design of Scene-customization for Massive MIMO CSI Feedback Proceedings Article

In: 2023 IEEE 98th Vehicular Technology Conference (VTC2023-Fall), pp. 1-5, 2023.

Links | BibTeX

2391.

Liu, Xuan; Liu, Xiong; Huang, Zhifeng; Zhao, Tianyang

A Compact Neural Network-Based Conversion Loss Model with Hard Constraints for Energy Management Journal Article

In: IEEE Transactions on Industry Applications, pp. 1-13, 2023.

Links | BibTeX

2390.

Aliouat, Wahiba; Badis, Lamis; Bouchiba, Kenza

Metaheuristic-based automated design of Convolutional Neural Network architecture for plant seedlings classification Proceedings Article

In: 2023 5th International Conference on Pattern Analysis and Intelligent Systems (PAIS), pp. 1-8, 2023.

Links | BibTeX

2389.

Dong, Haoyuan; Gao, Yang; Wang, Haishuai; Yang, Hong; Zhang, Peng

Heterogeneous Graph Neural Architecture Search with GPT-4 Technical Report

2023.

Links | BibTeX

2388.

Li, J.; Lv, Y.; Zhang, P.; Zhao, J.

Neural Architecture Search for Unsupervised PET Image Denoising Proceedings Article

In: 2023 IEEE Nuclear Science Symposium, Medical Imaging Conference and International Symposium on Room-Temperature Semiconductor Detectors (NSS MIC RTSD), pp. 1-1, 2023.

Links | BibTeX

2387.

Mu, Pan; Wu, Guanyao; Liu, Jinyuan; Zhang, Yuduo; Fan, Xin; Liu, Risheng

Learning to Search a Lightweight Generalized Network for Medical Image Fusion Journal Article

In: IEEE Transactions on Circuits and Systems for Video Technology, pp. 1-1, 2023.

Links | BibTeX

4236 entries « 37 of 85 »