All Projects → Lyken17 → Sparsenet

Lyken17 / Sparsenet

Licence: mit
[ECCV 2018] Sparsely Aggreagated Convolutional Networks https://arxiv.org/abs/1801.05895

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Sparsenet

Style Transfer
A Keras Implementation of "A Neural Algorithm of Artistic Style"
Stars: ✭ 115 (-9.45%)
Mutual labels:  convolutional-neural-networks
Pytorch Dc Tts
Text to Speech with PyTorch (English and Mongolian)
Stars: ✭ 122 (-3.94%)
Mutual labels:  convolutional-neural-networks
Motionblur Detection By Cnn
Stars: ✭ 126 (-0.79%)
Mutual labels:  convolutional-neural-networks
Convncf
Experimental codes for paper "Outer Product-based Neural Collaborative Filtering".
Stars: ✭ 118 (-7.09%)
Mutual labels:  convolutional-neural-networks
Keras transfer cifar10
Object classification with CIFAR-10 using transfer learning
Stars: ✭ 120 (-5.51%)
Mutual labels:  convolutional-neural-networks
Hyperdensenet
This repository contains the code of HyperDenseNet, a hyper-densely connected CNN to segment medical images in multi-modal image scenarios.
Stars: ✭ 124 (-2.36%)
Mutual labels:  convolutional-neural-networks
Region Ensemble Network
Repository for Region Ensemble Network based Hand Pose Estimation
Stars: ✭ 115 (-9.45%)
Mutual labels:  convolutional-neural-networks
Deepco3
[CVPR19] DeepCO3: Deep Instance Co-segmentation by Co-peak Search and Co-saliency (Oral paper)
Stars: ✭ 127 (+0%)
Mutual labels:  convolutional-neural-networks
Drln
Densely Residual Laplacian Super-resolution, IEEE Pattern Analysis and Machine Intelligence (TPAMI), 2020
Stars: ✭ 120 (-5.51%)
Mutual labels:  convolutional-neural-networks
Quiver
Interactive convnet features visualization for Keras
Stars: ✭ 1,619 (+1174.8%)
Mutual labels:  convolutional-neural-networks
Food101 Coreml
A CoreML model which classifies images of food
Stars: ✭ 119 (-6.3%)
Mutual labels:  convolutional-neural-networks
Context
ConText v4: Neural networks for text categorization
Stars: ✭ 120 (-5.51%)
Mutual labels:  convolutional-neural-networks
Deepecg
ECG classification programs based on ML/DL methods
Stars: ✭ 124 (-2.36%)
Mutual labels:  convolutional-neural-networks
Deepway
This project is an aid to the blind. Till date there has been no technological advancement in the way the blind navigate. So I have used deep learning particularly convolutional neural networks so that they can navigate through the streets.
Stars: ✭ 118 (-7.09%)
Mutual labels:  convolutional-neural-networks
Jsnet
Javascript/WebAssembly deep learning library for MLPs and convolutional neural networks
Stars: ✭ 126 (-0.79%)
Mutual labels:  convolutional-neural-networks
All Conv Keras
All Convolutional Network: (https://arxiv.org/abs/1412.6806#) implementation in Keras
Stars: ✭ 115 (-9.45%)
Mutual labels:  convolutional-neural-networks
Lenet 5
PyTorch implementation of LeNet-5 with live visualization
Stars: ✭ 122 (-3.94%)
Mutual labels:  convolutional-neural-networks
Rcnn Text Classification
Tensorflow Implementation of "Recurrent Convolutional Neural Network for Text Classification" (AAAI 2015)
Stars: ✭ 127 (+0%)
Mutual labels:  convolutional-neural-networks
Pytorch convlstm
convolutional lstm implementation in pytorch
Stars: ✭ 126 (-0.79%)
Mutual labels:  convolutional-neural-networks
Aaltd18
Data augmentation using synthetic data for time series classification with deep residual networks
Stars: ✭ 124 (-2.36%)
Mutual labels:  convolutional-neural-networks

SparseNet

Sparsely Aggregated Convolutional Networks [PDF]

Ligeng Zhu, Ruizhi Deng, Michael Maire, Zhiwei Deng, Greg Mori, Ping Tan

What is SparseNet?

SparseNet is a network architecture that only aggregates previous layers with exponential offset, for example, i - 1, i - 2, i - 4, i - 8, i - 16 ...

Why use SparseNet?

The connectivity pattern yields state-of-the-art arruacies on small dataset CIFAR/10/100. On large scale ILSVRC 2012 (ImageNet) dataset, SparseNet achieves similar accuracy as ResNet and DenseNet, while only using much less parameters.

Better Performance

Without BC With BC
Architecture Params CIFAR 100
DenseNet-40-12 1.1M 24.79
DenseNet-100-12 7.2M 20.97
DenseNet-100-24 28.28M 19.61
--- --- ---
SparseNet-40-24 0.76M 24.65
SparseNet-100-36 5.65M 20.50
SparseNet-100-{16,32,64} 7.22M 19.49
Architecture Params CIFAR 100
DenseNet-100-12 0.8M 22.62
DenseNet-250-24 15.3M 17,6
DenseNet-190-40 25.6M 17.53
--- --- ---
SparseNet-100-24 1.46M 22.12
SparseNet-100-{16,32,64} 4.38M 19.71
SparseNet-100-{32,64,128} 16.72M 17.71

Efficient Parameter Utilization

  • Parameter efficiency on CIFAR

  • Paramter efficiency on ImageNet

    We notice sparsenet shows comparable efficiency even compared with pruned models.

Pretrained model

Refer for source folder.

Cite

If SparseNet helps your research, please cite our work :)

@article{DBLP:journals/corr/abs-1801-05895,
  author    = {Ligeng Zhu and
               Ruizhi Deng and
               Michael Maire and
               Zhiwei Deng and
               Greg Mori and
               Ping Tan},
  title     = {Sparsely Aggregated Convolutional Networks},
  journal   = {CoRR},
  volume    = {abs/1801.05895},
  year      = {2018},
  url       = {http://arxiv.org/abs/1801.05895},
  archivePrefix = {arXiv},
  eprint    = {1801.05895},
  biburl    = {https://dblp.org/rec/bib/journals/corr/abs-1801-05895},
  bibsource = {dblp computer science bibliography, https://dblp.org}
}
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].