GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → anonymone → Neural-Architecture-Search

anonymone / Neural-Architecture-Search

Licence: GPL-3.0 license
This repo is about NAS

Labels

deep-neural-networksoptimizationpapernasautomlneural-architecture-searchefficient-architecture-search

Projects that are alternatives of or similar to Neural-Architecture-Search

Nas Benchmark
"NAS evaluation is frustratingly hard", ICLR2020
Stars: ✭ 126 (+384.62%)
Mutual labels:  nas, automl, neural-architecture-search
Awesome Nas Papers
Awesome Neural Architecture Search Papers
Stars: ✭ 213 (+719.23%)
Mutual labels:  nas, automl, neural-architecture-search
Awesome Automl And Lightweight Models
A list of high-quality (newest) AutoML works and lightweight models including 1.) Neural Architecture Search, 2.) Lightweight Structures, 3.) Model Compression, Quantization and Acceleration, 4.) Hyperparameter Optimization, 5.) Automated Feature Engineering.
Stars: ✭ 691 (+2557.69%)
Mutual labels:  nas, automl, neural-architecture-search
Nni
An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
Stars: ✭ 10,698 (+41046.15%)
Mutual labels:  nas, automl, neural-architecture-search
Awesome Autodl
A curated list of automated deep learning (including neural architecture search and hyper-parameter optimization) resources.
Stars: ✭ 1,819 (+6896.15%)
Mutual labels:  nas, automl, neural-architecture-search
Autodl Projects
Automated deep learning algorithms implemented in PyTorch.
Stars: ✭ 1,187 (+4465.38%)
Mutual labels:  nas, automl, neural-architecture-search
nas-encodings
Encodings for neural architecture search
Stars: ✭ 29 (+11.54%)
Mutual labels:  nas, automl, neural-architecture-search
BossNAS
(ICCV 2021) BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search
Stars: ✭ 125 (+380.77%)
Mutual labels:  nas, automl, neural-architecture-search
Hypernets
A General Automated Machine Learning framework to simplify the development of End-to-end AutoML toolkits in specific domains.
Stars: ✭ 221 (+750%)
Mutual labels:  nas, automl, neural-architecture-search
Autodl
Automated Deep Learning without ANY human intervention. 1'st Solution for AutoDL [email protected]
Stars: ✭ 854 (+3184.62%)
Mutual labels:  nas, automl
Once For All
[ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment
Stars: ✭ 1,127 (+4234.62%)
Mutual labels:  nas, automl
Shape Adaptor
The implementation of "Shape Adaptor: A Learnable Resizing Module" [ECCV 2020].
Stars: ✭ 59 (+126.92%)
Mutual labels:  nas, automl
Paddleslim
PaddleSlim is an open-source library for deep model compression and architecture search.
Stars: ✭ 677 (+2503.85%)
Mutual labels:  nas, neural-architecture-search
Fairdarts
Fair DARTS: Eliminating Unfair Advantages in Differentiable Architecture Search
Stars: ✭ 145 (+457.69%)
Mutual labels:  nas, automl
Dna
Block-wisely Supervised Neural Architecture Search with Knowledge Distillation (CVPR 2020)
Stars: ✭ 147 (+465.38%)
Mutual labels:  nas, neural-architecture-search
Awesome Computer Vision
Awesome Resources for Advanced Computer Vision Topics
Stars: ✭ 92 (+253.85%)
Mutual labels:  paper, automl
Awesome System For Machine Learning
A curated list of research in machine learning system. I also summarize some papers if I think they are really interesting.
Stars: ✭ 1,185 (+4457.69%)
Mutual labels:  paper, automl
AutoSpeech
[InterSpeech 2020] "AutoSpeech: Neural Architecture Search for Speaker Recognition" by Shaojin Ding*, Tianlong Chen*, Xinyu Gong, Weiwei Zha, Zhangyang Wang
Stars: ✭ 195 (+650%)
Mutual labels:  automl, neural-architecture-search
Autodeeplab
AutoDeeplab / auto-deeplab / AutoML for semantic segmentation, implemented in Pytorch
Stars: ✭ 269 (+934.62%)
Mutual labels:  nas, automl
Nas Bench 201
NAS-Bench-201 API and Instruction
Stars: ✭ 537 (+1965.38%)
Mutual labels:  nas, automl
View All Similar Projects ➔

Neural Architecture Search

Tabel of contents

Introduction

The list includes the papers related to NAS I have read. All of them are grouped into three classes ( Search Space, Seach strategy and evaluation strategy) based on my subjectivity.

Papers

Reviews

Data Title Venue Notes
2018 Neural Architecture Search: A Survey JMLR -
2008 Neuroevolution: From Architectures to Learning Evolutionary Intelligence -
1999 Evolving Artificial Neural Networks IEEE -

Search Space / Encoding strategies

Data Title Venue Code Notes
2018 Neural Architecture Search Over a Graph Search Space - - This paper defined a search space on direct graph which is used to instruct the construction of networks.
2017 Genetic CNN ICCV Tensorflow This paper proposed a binary string encoding strategy.
2017/18 Efficient Architecture Search by Network Transformation AAAI - This paper Proposed a popular block based network definition method.
2009 A Hypercube-based Encoding for Evolving large-scale Neural Networks IEEE Artificial Life - This method use a extended CPPNs to encode the ANN.
2006 Evolutionary Design of Neural Network Architectures Using a Descriptive Encoding Language IEEE TEVC - This paper proposed a human-readable and writable encoding method.
2002 Evolving Neural Networks through Augmenting Topologies EC - NEAT: An Awesome Approach to NeuroEvolution
1998 Network Generating Attribute grammar Encoding IJCNN - Grammar Encoding
1996 A comparison between cellular encoding and direct encoding for genetic neural networks - - This paper compared the celluar encoding and direct encoding methods
1996 Evolving Graphs and Networks with Edge encoding: preliminary report The Genetic Programming Conference - Edge Encoding method.
1994 Neurogenetic learning: an integrated method of designing and training neural networks using genetic algorithms Physica D - This paper inspired by L-System.
1994 Automatic definition of modular neural networks Adaptive behavior - -
1990 Designing Neural Networks Using Genetic Algorithms with Graph Generation System The Conference on Genetic Algorithms - This paper proposed a graph grammatical encoding and analysed the problems of the direct encoding method.

Search Strategies

Data Title Venue Code Notes
2018 Reinforced Evolutionary Neural Architecture Search CVPR mxnet EA/RL
2018 Neural Architecture Optimization NeurIPS Pytorch Tensorflow Gradient Based
2018 NSGA-NET: A Multi-Objective Genetic Algorithm for Neural Architecture Search GECCO - This paper can be viewed as an extension of Genetic CNN in search strategy and slightly improving in encoding strategy.
2017 Large-Scale Evolution of Image Classifiers ICML - Google's work. Trying to prove the possibility of evolving CNN automatically.
2017 SMASH: One-Shot Model Architecture Search through HyperNetworks NeurIPS - Gradient Based
2017 Neural Architecture Search with Reinforcement Learning ICLR 2017 - RL
2017 Designing Neural Network Architectures using Reinforcement Learning ICLR - RL

Evaluation Strategies

Data Title Venue Code Notes
2018 Progressive Neural Architecture Search ECCV Pytorch Tensorflow This paper use a predictor to evaluate the acc of each network with few real training.

Extension

Data Title Venue Code Notes
2019 NAS-Bench-101: Towards Reproducible Neural Architecture Search ICML Code A Benchmark of NAS.
2016 Net2Net: Accelerating Learning via Knowledge Transfer ICLR 2016 - This paper proposed a mehtod (similar to parameters sharing) to transfer the knowledge from previous network to a larger one.

Useful pages

  1. LITERATURE ON NEURAL ARCHITECTURE SEARCH
  2. Awesome NAS
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].