Maintained by Difan Deng and Marius Lindauer.
The following list considers papers related to neural architecture search. It is by no means complete. If you miss a paper on the list, please let us know.
Please note that although NAS methods steadily improve, the quality of empirical evaluations in this field are still lagging behind compared to other areas in machine learning, AI and optimization. We would therefore like to share some best practices for empirical evaluations of NAS methods, which we believe will facilitate sustained and measurable progress in the field. If you are interested in a teaser, please read our blog post or directly jump to our checklist.
Transformers have gained increasing popularity in different domains. For a comprehensive list of papers focusing on Neural Architecture Search for Transformer-Based spaces, the awesome-transformer-search repo is all you need.
2024
Training-Free Transformer Architecture Search With Zero-Cost Proxy Guided Evolution Journal Article
In: IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1-17, 2024.
Real-Time Image Segmentation via Hybrid Convolutional-Transformer Architecture Search Technical Report
2024.
Grassroots operator search for model edge adaptation using mathematical search space Journal Article
In: Future Generation Computer Systems, vol. 157, pp. 29-40, 2024, ISSN: 0167-739X.
Building Optimal Neural Architectures using Interpretable Knowledge Technical Report
2024.
Robust NAS under adversarial training: benchmark, theory, and beyond Technical Report
2024.
Hypergraph Neural Architecture Search Proceedings Article
In: Wooldridge, Michael J.; Dy, Jennifer G.; Natarajan, Sriraam (Ed.): Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada, pp. 13837–13845, AAAI Press, 2024.
DC-NAS: Divide-and-Conquer Neural Architecture Search for Multi-Modal Classification Proceedings Article
In: Wooldridge, Michael J.; Dy, Jennifer G.; Natarajan, Sriraam (Ed.): Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada, pp. 13754–13762, AAAI Press, 2024.
EG-NAS: Neural Architecture Search with Fast Evolutionary Exploration Proceedings Article
In: Wooldridge, Michael J.; Dy, Jennifer G.; Natarajan, Sriraam (Ed.): Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada, pp. 11159–11167, AAAI Press, 2024.
Multimodal Graph Neural Architecture Search under Distribution Shifts Proceedings Article
In: Wooldridge, Michael J.; Dy, Jennifer G.; Natarajan, Sriraam (Ed.): Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada, pp. 8227–8235, AAAI Press, 2024.
PNAS-MOT: Multi-Modal Object Tracking with Pareto Neural Architecture Search Miscellaneous
2024.
Chain-structured neural architecture search for financial time series forecasting Technical Report
2024.
Robust Neural Architecture Search Using Differential Evolution for Medical Images Proceedings Article
In: Smith, Stephen; Correia, João; Cintrano, Christian (Ed.): Applications of Evolutionary Computation, pp. 163–179, Springer Nature Switzerland, Cham, 2024, ISBN: 978-3-031-56855-8.
Training-Free Quantum Architecture Search Proceedings Article
In: Wooldridge, Michael J.; Dy, Jennifer G.; Natarajan, Sriraam (Ed.): Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada, pp. 12430–12438, AAAI Press, 2024.
A Pre-Search Evaluation Framework for Assessing Search Space Complexity Proceedings Article
In: The Second Tiny Papers Track at ICLR 2024, 2024.
Progressive Self-supervised Multi-objective NAS for Image Classification Proceedings Article
In: Smith, Stephen; Correia, João; Cintrano, Christian (Ed.): Applications of Evolutionary Computation, pp. 180–195, Springer Nature Switzerland, Cham, 2024, ISBN: 978-3-031-56855-8.
VP-DARTS: Validated Pruning Differentiable Architecture Search Proceedings Article
In: Rocha, Ana Paula; Steels, Luc; Herik, H. Jaap (Ed.): Proceedings of the 16th International Conference on Agents and Artificial Intelligence, ICAART 2024, Volume 2, Rome, Italy, February 24-26, 2024, pp. 47–57, SCITEPRESS, 2024.
SasWOT: Real-Time Semantic Segmentation Architecture Search WithOut Training Proceedings Article
In: Wooldridge, Michael J.; Dy, Jennifer G.; Natarajan, Sriraam (Ed.): Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada, pp. 7722–7730, AAAI Press, 2024.
UniADS: Universal Architecture-Distiller Search for Distillation Gap Proceedings Article
In: Wooldridge, Michael J.; Dy, Jennifer G.; Natarajan, Sriraam (Ed.): Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada, pp. 14167–14174, AAAI Press, 2024.
Neural Architecture Search for Bearing Fault Classification Proceedings Article
In: Rocha, Ana Paula; Steels, Luc; Herik, H. Jaap (Ed.): Proceedings of the 16th International Conference on Agents and Artificial Intelligence, ICAART 2024, Volume 2, Rome, Italy, February 24-26, 2024, pp. 288–300, SCITEPRESS, 2024.
On Spectrogram Analysis in a Multiple Classifier Fusion Framework for Power Grid Classification Using Electric Network Frequency Proceedings Article
In: Santana, Modesto Castrillón; Marsico, Maria De; Fred, Ana L. N. (Ed.): Proceedings of the 13th International Conference on Pattern Recognition Applications and Methods, ICPRAM 2024, Rome, Italy, February 24-26, 2024, pp. 91–99, SCITEPRESS, 2024.
STO-DARTS: Stochastic Bilevel Optimization for Differentiable Neural Architecture Search Journal Article
In: IEEE Transactions on Emerging Topics in Computational Intelligence, pp. 1-12, 2024.
Hyperspectral Image Reconstruction Using Hierarchical Neural Architecture Search from A Snapshot Image Proceedings Article
In: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2500-2504, 2024.
NAS-OD: Neural Architecture Search for Object Detection Proceedings Article
In: 2024 International Conference on Electronics, Information, and Communication (ICEIC), pp. 1-3, 2024.
A Novel Fuzzy Neural Network Architecture Search Framework for Defect Recognition With Uncertainties Journal Article
In: IEEE Transactions on Fuzzy Systems, pp. 1-12, 2024.
Inner Loop-Based Modified Differentiable Architecture Search Journal Article
In: IEEE Access, vol. 12, pp. 41918–41933, 2024.
TCNAS: Transformer Architecture Evolving in Code Clone Detection Proceedings Article
In: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5745-5749, 2024.
Segmentation-Driven Infrared and Visible Image Fusion Via Transformer-Enhanced Architecture Searching Proceedings Article
In: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 4230-4234, 2024.
Evolutionary Search via channel attention based parameter inheritance and stochastic uniform sampled training Journal Article
In: Computer Vision and Image Understanding, vol. 243, pp. 104000, 2024, ISSN: 1077-3142.
Search Robust and Adaptable Architecture Proceedings Article
In: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5155-5159, 2024.
Beyond the Limit of Weight-Sharing: Pioneering Space-Evolving NAS with Large Language Models Proceedings Article
In: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 6225-6229, 2024.
NAS-MFF:NAS-Guided Multiscale Feature Fusion Network with Pareto Optimization for Sonar Images Classification Journal Article
In: IEEE Sensors Journal, pp. 1-1, 2024.
DBS: Differentiable Budget-Aware Searching For Channel Pruning Proceedings Article
In: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5810-5814, 2024.
Efficient Architecture Search for Real-Time Instance Segmentation Proceedings Article
In: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 3310-3314, 2024.
AZ-NAS: Assembling Zero-Cost Proxies for Network Architecture Search Technical Report
2024.
When Training-Free Nas Meets Vision Transformers: A Neural Tangent Kernel Perspective Proceedings Article
In: 2024.
Analyzing the Expected Hitting Time of Evolutionary Computation-Based Neural Architecture Search Algorithms Journal Article
In: IEEE Transactions on Emerging Topics in Computational Intelligence, pp. 1-13, 2024.
Mixed-precision Supernet Training from Vision Foundation Models using Low Rank Adapter Technical Report
2024.
PHD-NAS: Preserving helpful data to promote Neural Architecture Search Journal Article
In: Neurocomputing, vol. 587, pp. 127646, 2024, ISSN: 0925-2312.
LRNAS: Differentiable Searching for Adversarially Robust Lightweight Neural Architecture Journal Article
In: IEEE Transactions on Neural Networks and Learning Systems, pp. 1-15, 2024.
Enhancing Efficiency in HAR Models: NAS Meets Pruning Proceedings Article
In: 22nd IEEE International Conference on Pervasive Computing and Communications (PerCom 2024), Institute of Electrical and Electronics Engineers (IEEE), 2024.
Insights from the Use of Previously Unseen Neural Architecture Search Datasets Technical Report
2024.
On optimizing morphological neural networks for hyperspectral image classification Proceedings Article
In: Osten, Wolfgang (Ed.): Sixteenth International Conference on Machine Vision (ICMV 2023), pp. 1307202, International Society for Optics and Photonics SPIE, 2024.
Neural Architecture Search-Based Few-Shot Learning for Hyperspectral Image Classification Journal Article
In: IEEE Transactions on Geoscience and Remote Sensing, vol. 62, pp. 1-15, 2024.
OnceNAS: Discovering efficient on-device inference neural networks for edge devices Journal Article
In: Information Sciences, vol. 669, pp. 120567, 2024, ISSN: 0020-0255.
ApproxDARTS: Differentiable Neural Architecture Search with Approximate Multipliers Technical Report
2024.