Segmentation-Series-Chaos

Summary includes basic segmentation, human segmentation, human or portrait matting for both image and video. Maybe it is a little chaos, so I called it Segmentation-Series-Chaos. If you want a clear understanding, feel free to fork and modify.

• [done] Summary of 2019 Survey on semantic segmentation using deep learning techniques_Neurocomputing and other useful sights

• [done] Semantic segmentation research in CVPR2019

• [done] matting in detail

• [done] Focus on Deeplab-research

• [doing] experiments

  • MMnet experiment

  • Deeplabv3+matte: transfer deeplabv3+ to matting task experiment

Summary of 2019 Survey on semantic segmentation using deep learning techniques_Neurocomputing and other useful sights

• An efficient solution for semantic segmentation: ShuffleNet V2 with atrous separable convolutions

• In term of VOC and cityscapes, deeplab V3/V3+ is the best from the related leaderboarder: VOC2012 , Cityspaces and https://paperswithcode.com/task/semantic-segmentation

• Good advice of mobile devices: less than 2 GFLOPs from AI in RTC challenge group.

• Google‘s solution in Mobile Real-time Video Segmentation

  from 视频分割在移动端的算法进展综述 * includeing some other method

• Greate tools for implementing segmentation model easily : Semantic Segmentation Suite in TensorFlow. Implement, train, and test new Semantic Segmentation models easily!

• National University of Singapore and Best Student Paper Award at ACM MM 2018 about multi-human-parsing Official Repository for Multi-Human-Parsing (MHP)

• Similar project in GitHub about human segmetation: Human-Segmentation-PyTorch

  

• A nearest project&paper produced by Alimama called Semantic_Human_Matting (SHM) paper in ACMMM. SHM is the first algorithm that learns to jointly fit both semantic information and high quality details with deep networks. (alpha matte)

  And one of the human matting datasets: Human Matting datasets

  And another useful repo for mobile devices with NCNN tool: And mobile_phone_human_matting (including datasets )

  Another latest or s-o-t-a paper in matting:

  • A Late Fusion CNN for Digital Matting, CVPR2019.
  • Inductive Guided Filter: Real-time Deep Image Matting with Weakly Annotated Masks on Mobile Device, arXiv 2019.
  • 2016_Automatic Portrait Segmentation for Image Stylization_CGF
  • 2017_Deep Image Matting_CVPR
  • 2017_Fast Deep Matting for Portrait Animation on Mobile Phone_ACMMM, github-pytorch

• The largest and popular collection of semantic segmentation: awesome-semantic-segmentation which includes many useful resources e.g. architecture, benchmark, datasets, results of related challenge, projects et.al.

• A blog conclusion about image semantic segmentation Review of Deep Learning Algorithms for Image Semantic Segmentation

  

Updated from 20190710:

• Latested lightweight model maybe useful: mobileNetV3 (First Submitted on 6 May 2019) and efficientNet (First Submitted on 28 May 2019) using NAS (Neural Architectures Search) techs.

• An useful algorithm CVPR2019 about how to use knowledge distillation to improve accuracy of lightweight semantic segmentation models without increasing the params size and GFlops: Structured Knowledge Distillation for Semantic Segmentation proposed by microsoft research asia.

  

• New upsampling method called DUpsample: the W can be learned and a speciall feature fusion tech like inverted fusion decreases the compuation greatly. It outperform deeplabv3+ but only 30% computation. Decoders Matter for Semantic Segmentation: Data-Dependent Decoding Enables Flexible Feature Aggregation CVPR2019

  

• Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation

  

• Espnetv2: A light-weight, power efficient, and general purpose convolutional neural network

  

Semantic segmentation research in CVPR2019