AutoML.org

Freiburg-Hannover-Tübingen

Literature on Neural Architecture Search

Maintained by Difan Deng and Marius Lindauer.

The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.

Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.

Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.


3310 entries « 19 of 67 »

2023

2410.

Dong, Dong; Jiang, Hongxu; Wei, Xuekai; Song, Yanfei; Zhuang, Xu; Wang, Jason

ETNAS: An energy consumption task-driven neural architecture search Journal Article

In: Sustainable Computing: Informatics and Systems, vol. 40, pp. 100926, 2023, ISSN: 2210-5379.

Abstract | Links | BibTeX

2409.

Tang, Siao; Wang, Xin; Chen, Hong; Guan, Chaoyu; Tang, Yansong; Zhu, Wenwu

Lightweight Diffusion Models with Distillation-Based Block Neural Architecture Search Technical Report

2023.

Links | BibTeX

2408.

Li, Yuke; Baik, Jiwon; Rahman, Md Marufi; Anagnostopoulos, Iraklis; Li, Ruopu; Shu, Tong

Pareto Optimization of CNN Models via Hardware-Aware Neural Architecture Search for Drainage Crossing Classification on Resource-Limited Devices Proceedings Article

In: Proceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis, pp. 1767–1775, Association for Computing Machinery, Denver, CO, USA, 2023, ISBN: 9798400707858.

Abstract | Links | BibTeX

2407.

Hsieh, Jun-Wei; Chou, Cheng-Han; Chang, Ming-Ching; Chen, Ping-Yang; Santra, Santanu; Huang, Chih-Sheng

Mean-Shift Based Differentiable Architecture Search Journal Article

In: IEEE Transactions on Artificial Intelligence, pp. 1-11, 2023.

Links | BibTeX

2406.

Chang, Chi-Chih; Sung, Yuan-Yao; Yu, Shixing; Huang, Ning-Chi; Marculescu, Diana; Wu, Kai-Chiang

FLORA: Fine-grained Low-Rank Architecture Search for Vision Transformer Technical Report

2023.

Links | BibTeX

2405.

Chang, Chen-Chia; Pan, Jingyu; Xie, Zhiyao; Zhang, Tunhou; Hu, Jiang; Chen, Yiran

Towards Fully Automated Machine Learning for Routability Estimator Development Journal Article

In: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, pp. 1-1, 2023.

Links | BibTeX

2404.

An, Taegun; Joo, Changhee

CycleGANAS: Differentiable Neural Architecture Search for CycleGAN Technical Report

2023.

Links | BibTeX

2403.

Ji, Junzhong; Wang, Xingyu

Convolutional architecture search based on particle swarm algorithm for functional brain network classification Journal Article

In: Applied Soft Computing, vol. 149, pp. 111049, 2023, ISSN: 1568-4946.

Abstract | Links | BibTeX

2402.

Wen, Wei; Liu, Kuang-Hung; Fedorov, Igor; Zhang, Xin; Yin, Hang; Chu, Weiwei; Hassani, Kaveh; Sun, Mengying; Liu, Jiang; Wang, Xu; Jiang, Lin; Chen, Yuxin; Zhang, Buyun; Liu, Xi; Cheng, Dehua; Chen, Zhengxing; Zhao, Guang; Han, Fangqiu; Yang, Jiyan; Hao, Yuchen; Xiong, Liang; Chen, Wen-Yen

Rankitect: Ranking Architecture Search Battling World-class Engineers at Meta Scale Technical Report

2023.

Links | BibTeX

2401.

Wang, Zhenrong; Li, Bin; Li, Weifeng; Niu, Shuanlong; Miao, Wang; Niu, Tongzhi

NAS-ASDet: An Adaptive Design Method for Surface Defect Detection Network using Neural Architecture Search Technical Report

2023.

Links | BibTeX

2400.

Hu, Yiming; Chu, Xiangxiang; Zhang, Bo

Masked Autoencoders Are Robust Neural Architecture Search Learners Technical Report

2023.

Links | BibTeX

2399.

Han, Xiaoyu; Li, Chenyu; Wang, Zifan; Liu, Guohua

NDARTS: A Differentiable Architecture Search Based on the Neumann Series Journal Article

In: Algorithms, vol. 16, no. 12, 2023, ISSN: 1999-4893.

Abstract | Links | BibTeX

2398.

Li, Xiangyi; Guo, Jiajia; Wen, Chao-Kai; Jin, Shi

Auto-CsiNet: Scenario-customized Automatic Neural Network Architecture Generation for Massive MIMO CSI Feedback Technical Report

2023.

Links | BibTeX

2397.

Hafiz, Faizal M. F.; Broekaert, Jan; Swain, Akshya

Evolution of Neural Architectures for Financial Forecasting: A Note on Data Incompatibility during Crisis Periods Technical Report

2023.

Links | BibTeX

2396.

Wei, Zimian; Pan, Hengyue; Li, Lujun; Dong, Peijie; Tian, Zhiliang; Niu, Xin; Li, Dongsheng

TVT: Training-Free Vision Transformer Search on Tiny Datasets Technical Report

2023.

Links | BibTeX

2395.

Herberg, Evelyn; Herzog, Roland; Köhne, Frederik; Kreis, Leonie; Schiela, Anton

Sensitivity-Based Layer Insertion for Residual and Feedforward Neural Networks Technical Report

2023.

Links | BibTeX

2394.

Haq, Ijaz Ul; Lee, Byung Suk

TransNAS-TSAD: Harnessing Transformers for Multi-Objective Neural Architecture Search in Time Series Anomaly Detection Technical Report

2023.

Links | BibTeX

2393.

Loya, Hrushikesh; Dudziak, Lukasz; Mehrotra, Abhinav; Lee, Royson; Fernández-Marqués, Javier; Lane, Nicholas D.; Wen, Hongkai

How Much Is Hidden in the NAS Benchmarks? Few-Shot Adaptation of a NAS Predictor Technical Report

2023.

Links | BibTeX

2392.

Benmeziane, Hadjer; Ouarnoughi, Hamza; Niar, Smail; Maghraoui, Kaoutar El

Pareto Rank-Preserving Supernetwork for HW-NAS Technical Report

2023.

Links | BibTeX

2391.

Mohammed, Mubarek

Model Compression Beyond Size Reduction Proceedings Article

In: Conference on Parsimony and Learning (Recent Spotlight Track), 2023.

Links | BibTeX

2390.

Wan, Qiyu; Wang, Lening; Wang, Jing; Song, Shuaiwen Leon; Fu, Xin

NAS-SE: Designing A Highly-Efficient In-Situ Neural Architecture Search Engine for Large-Scale Deployment Proceedings Article

In: Proceedings of the 56th Annual IEEE/ACM International Symposium on Microarchitecture, pp. 756–768, Association for Computing Machinery, <conf-loc>, <city>Toronto</city>, <state>ON</state>, <country>Canada</country>, </conf-loc>, 2023, ISBN: 9798400703294.

Abstract | Links | BibTeX

2389.

Ghebriout, Mohamed Imed Eddine; Bouzidi, Halima; Niar, Sma"ıl; Ouarnoughi, Hamza

Harmonic-NAS: Hardware-Aware Multimodal Neural Architecture Search on Resource-constrained Devices Technical Report

2023.

Links | BibTeX

2388.

McDermott, Luke; Weitz, Jason; Demler, Dmitri; Cummings, Daniel; Tran, Nhan; Duarte, Javier

Neural Architecture Codesign for Fast Bragg Peak Analysis Technical Report

2023.

Links | BibTeX

2387.

Lee, Jaeseong; hwang,

Multilingual Lottery Tickets to Pretrain Language Models Proceedings Article

In: The 2023 Conference on Empirical Methods in Natural Language Processing, 2023.

Links | BibTeX

2386.

Arabi, Pau Mulet; Flowers, Alec; Mauch, Lukas; Cardinaux, Fabien

DBsurf: A Discrepancy Based Method for Discrete Stochastic Gradient Estimation Technical Report

2023.

Links | BibTeX

2385.

Qin, Huafeng; Fan, Chao; Deng, Shaojiang; Li, Yantao; El-Yacoubi, Mounim A.; Zhou, Gang

AG-NAS: An Attention GRU-based Neural Architecture Search for Finger-Vein Recognition Journal Article

In: IEEE Transactions on Information Forensics and Security, pp. 1-1, 2023.

Links | BibTeX

2384.

ZiWen, Dou; Dong, Ye

Multi-objective Neural Architecture Search for Efficient and Fast Semantic Segmentation on Edge Journal Article

In: IEEE Transactions on Intelligent Vehicles, pp. 1-12, 2023.

Links | BibTeX

2383.

Yang, Changdi; Sheng, Yi; Dong, Peiyan; Kong, Zhenglun; Li, Yanyu; Yu, Pinrui; Yang, Lei; Lin, Xue; Wang, Yanzhi

Fast and Fair Medical AI on the Edge Through Neural Architecture Search for Hybrid Vision Models Proceedings Article

In: 2023 IEEE/ACM International Conference on Computer Aided Design (ICCAD), pp. 01-09, 2023.

Links | BibTeX

2382.

Poliakov, Egor; Hung, Wei-Jie; Huang, Ching-Chun

Efficient Constraint-Aware Neural Architecture Search for Object Detection Proceedings Article

In: 2023 Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), pp. 733-740, 2023.

Links | BibTeX

2381.

Liu, Lian; Wang, Ying; Zhao, Xiandong; Chen, Weiwei; Li, Huawei; Li, Xiaowei; Han, Yinhe

An Automatic Neural Network Architecture-and-Quantization Joint Optimization Framework for Efficient Model Inference Journal Article

In: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, pp. 1-1, 2023.

Links | BibTeX

2380.

Sharifi, Zaniar; Soltanian, Khabat; Amiri, Ali

Developing Convolutional Neural Networks using a Novel Lamarckian Co-Evolutionary Algorithm Proceedings Article

In: 2023 13th International Conference on Computer and Knowledge Engineering (ICCKE), pp. 399-408, 2023.

Links | BibTeX

2379.

Li, Xiangyi; Guo, Jiajia; Wen, Chao Kai; Tian, Wenqiang; Jin, Shi

Automatic Neural Network Design of Scene-customization for Massive MIMO CSI Feedback Proceedings Article

In: 2023 IEEE 98th Vehicular Technology Conference (VTC2023-Fall), pp. 1-5, 2023.

Links | BibTeX

2378.

Liu, Xuan; Liu, Xiong; Huang, Zhifeng; Zhao, Tianyang

A Compact Neural Network-Based Conversion Loss Model with Hard Constraints for Energy Management Journal Article

In: IEEE Transactions on Industry Applications, pp. 1-13, 2023.

Links | BibTeX

2377.

Aliouat, Wahiba; Badis, Lamis; Bouchiba, Kenza

Metaheuristic-based automated design of Convolutional Neural Network architecture for plant seedlings classification Proceedings Article

In: 2023 5th International Conference on Pattern Analysis and Intelligent Systems (PAIS), pp. 1-8, 2023.

Links | BibTeX

2376.

Dong, Haoyuan; Gao, Yang; Wang, Haishuai; Yang, Hong; Zhang, Peng

Heterogeneous Graph Neural Architecture Search with GPT-4 Technical Report

2023.

Links | BibTeX

2375.

Li, J.; Lv, Y.; Zhang, P.; Zhao, J.

Neural Architecture Search for Unsupervised PET Image Denoising Proceedings Article

In: 2023 IEEE Nuclear Science Symposium, Medical Imaging Conference and International Symposium on Room-Temperature Semiconductor Detectors (NSS MIC RTSD), pp. 1-1, 2023.

Links | BibTeX

2374.

Mu, Pan; Wu, Guanyao; Liu, Jinyuan; Zhang, Yuduo; Fan, Xin; Liu, Risheng

Learning to Search a Lightweight Generalized Network for Medical Image Fusion Journal Article

In: IEEE Transactions on Circuits and Systems for Video Technology, pp. 1-1, 2023.

Links | BibTeX

2373.

(Ed.)

Auto-Prox: Training-Free Vision Transformer Architecture Search via Automatic Proxy Discovery Collection

2023.

Links | BibTeX

2372.

Sukthanker, Rhea Sanjay; Krishnakumar, Arjun; Safari, Mahmoud; Hutter, Frank

Weight-Entanglement Meets Gradient-Based Neural Architecture Search Technical Report

2023.

Links | BibTeX

2371.

Chen, Tianyi; Ding, Tianyu; Zhu, Zhihui; Chen, Zeyu; Wu, HsiangTao; Zharkov, Ilya; Liang, Luming

OTOv3: Automatic Architecture-Agnostic Neural Network Training and Compression from Structured Pruning to Erasing Operators Technical Report

2023.

BibTeX

2370.

Castillo, Angela; Kohler, Jonas; Pérez, Juan C.; Pérez, Juan Pablo; Pumarola, Albert; Ghanem, Bernard; Arbeláez, Pablo; Thabet, Ali

Adaptive Guidance: Training-free Acceleration of Conditional Diffusion Models Technical Report

2023.

Links | BibTeX

2369.

Chopra, Jatin; Kumar, Gaddam Prathik; Ghosh, Archismita; Prasad, Paarth; Vats, Shreya

A Novel Approach to Human Activity Recognition: Integrating Automated Machine Learning and Multimodal Fusion Mechanisms Journal Article

In: International Journal for Research Trends and Innovation, vol. 8, pp. 6, 2023.

Links | BibTeX

2368.

Zhang, Mengxuan; Liu, Long; Jin, Yaochu; Lei, Zhikun; Wang, Zhigang; Jiao, Licheng

Tree-shaped multiobjective evolutionary CNN for hyperspectral image classification Journal Article

In: Applied Soft Computing, pp. 111176, 2023, ISSN: 1568-4946.

Abstract | Links | BibTeX

2367.

He, Hongyi; Liu, Longjun; Zhang, Haonan; Zheng, Nanning

IS-DARTS: Stabilizing DARTS through Precise Measurement on Candidate Importance Technical Report

2023.

BibTeX

2366.

Sridhar, Sharath Nittur; Szankin, Maciej; Chen, Fang; Sundaresan, Sairam; Sarah, Anthony

SimQ-NAS: Simultaneous Quantization Policy and Neural Architecture Search Technical Report

2023.

BibTeX

2365.

Zhang, Zitong; Liu, Zhicheng; Zhao, Yunfeng; Qiu, Chao; Zhang, Cheng; Wang, Xiaofei

ENASFL: A Federated Neural Architecture Search Scheme for Heterogeneous Deep Models in Distributed Edge Computing Systems Journal Article

In: IEEE Transactions on Network Science and Engineering, pp. 1-11, 2023.

Links | BibTeX

2364.

Chen, Tianyi; Liang, Luming; Ding, Tianyu; Zharkov, Ilya

OTOv3: Towards Automatic Sub-Network Search Within General Super Deep Neural Networks Miscellaneous

2023.

Links | BibTeX

2363.

Lanjewar, Madhusudan G; Panchbhai, Kamini G

Enhancing Fish Freshness Prediction using NasNet-LSTM Journal Article

In: Journal of Food Composition and Analysis, pp. 105945, 2023, ISSN: 0889-1575.

Abstract | Links | BibTeX

2362.

Xie, Tao; Dai, Kun; Jiang, Zhiqiang; Li, Ruifeng; Mao, Shouren; Wang, Ke; Zhao, Lijun

ViT-MVT: A Unified Vision Transformer Network for Multiple Vision Tasks Journal Article

In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-15, 2023.

Links | BibTeX

2361.

Tu, Chongjun; Ye, Peng; Lin, Weihao; Ye, Hancheng; Yu, Chong; Chen, Tao; Li, Baopu; Ouyang, Wanli

Efficient Architecture Search via Bi-level Data Pruning Technical Report

2023.

BibTeX

3310 entries « 19 of 67 »