wangzheallen / Vsad
Licence: mit
this is the code release for ''Weakly Supervised PatchNets: Describing and Aggregating Local Patches for Scene Recognition''
Stars: ✭ 44
Programming Languages
matlab
3953 projects
Projects that are alternatives of or similar to Vsad
Uppy
The next open source file uploader for web browsers 🐶
Stars: ✭ 24,829 (+56329.55%)
Mutual labels: encoding
Wasm Check
TypeScript / JavaScript library for detect WebAssembly features in node.js & browser
Stars: ✭ 30 (-31.82%)
Mutual labels: feature
Scodec
Scala combinator library for working with binary data
Stars: ✭ 709 (+1511.36%)
Mutual labels: encoding
Gms Feature Matcher
GMS: Grid-based Motion Statistics for Fast, Ultra-robust Feature Correspondence (CVPR 17 & IJCV 20)
Stars: ✭ 797 (+1711.36%)
Mutual labels: feature
Stegify
🔍 Go tool for LSB steganography, capable of hiding any file within an image.
Stars: ✭ 927 (+2006.82%)
Mutual labels: encoding
Decodify
Detect and decode encoded strings, recursively.
Stars: ✭ 670 (+1422.73%)
Mutual labels: encoding
Cryptii
Web app and framework offering modular conversion, encoding and encryption
Stars: ✭ 971 (+2106.82%)
Mutual labels: encoding
Anycodable
Type-erased wrappers for Encodable, Decodable, and Codable values
Stars: ✭ 811 (+1743.18%)
Mutual labels: encoding
X509
A PHP library for X.509 public key certificates, attribute certificates, certification requests and certification path validation.
Stars: ✭ 27 (-38.64%)
Mutual labels: encoding
Encoding
Go package containing implementations of efficient encoding, decoding, and validation APIs.
Stars: ✭ 705 (+1502.27%)
Mutual labels: encoding
Fasubrip
FaSubrip autodetects and converts encoding of farsi (persian) subrip files. with additional functionalities.
Stars: ✭ 22 (-50%)
Mutual labels: encoding
Iocane
An odorless, tasteless NodeJS crypto library that dissolves instantly in liquid
Stars: ✭ 35 (-20.45%)
Mutual labels: encoding
Nlp xiaojiang
自然语言处理（nlp），小姜机器人（闲聊检索式chatbot），BERT句向量-相似度（Sentence Similarity），XLNET句向量-相似度（text xlnet embedding），文本分类（Text classification）， 实体提取（ner，bert+bilstm+crf），数据增强（text augment, data enhance），同义句同义词生成，句子主干提取（mainpart），中文汉语短文本相似度，文本特征工程，keras-http-service调用
Stars: ✭ 954 (+2068.18%)
Mutual labels: feature
Bcnencoder.net
Cross-platform texture encoding libary for .NET. With support for BC1-3/DXT, BC4-5/RGTC and BC7/BPTC compression. Outputs files in ktx or dds formats.
Stars: ✭ 28 (-36.36%)
Mutual labels: encoding
this is the release code for Weakly Supervised PatchNets: Describing and Aggregating Local Patches for Scene Recognition:
Weakly Supervised PatchNets: Describing and Aggregating Local Patches for Scene Recognition
Zhe Wang, Limin Wang, Yali Wang, Bowen Zhang, and Yu Qiao
The performance is as below:
| acc | MIT_indoor | SUN397 |
|---|---|---|
| mean: | 78.5 | 63.5 |
| VLAD: | 83.9 | 70.1 |
| FV | 83.6 | 69.0 |
| VSAD | 84.9 | 71.7 |
Note: The encoding method based on our scene_patchenet feature surpass human performance on sun397(68.5%).
Feature
we released the concise and effective feature for MIT indoor feature, it is notated as hybrid_PatchNet+VSAD in the paper which obtains 86.1 accuracy. You can use it as baseline or as complementary feature for further study.| acc on MIT | dimension | storage |
|---|---|---|
| 86.1 | 100*256*2*2 | 1.9G |
Model
Our trained scene_patchnet and object_patchenet, the model is based on cudnn_v4, if your system is based on cudnn_v5, you can use the code below cudnn_v4 to cudnn_v5: https://github.com/yjxiong/caffe/blob/action_recog/python/bn_convert_style.py
| acc | Top5 |
|---|---|
| Object_patchnet_on_ImageNet: | 85.3 |
| Scene_patchnet_on_Places205: | 82.7 |
They both take 128 * 128 patches as input.
Code
- mit_hybrid_vsad.mat -- you can use this feature as your baseline or to concatenate for further study, it is only 100*256*2*2 dimensions while performs 86.1 acc on MIT indoor, you can download from mit_hybrid_vsad.mat
- extracting_feature_exmaple.m -- you can use this code as template to extract scene_patchnet_feature or object_patchnet_probability, for scene_patchnet_feature it is global average pool feature and for for object_patchnet_probability it is fully connnect feature with softmax function
- for_encoder_scene67.mat -- serve as assist to your handle on MIT_indoor dataset, from vl_feat
- for_encoder_sun397.mat -- serve as assist to your handle on sun397 dataset
- mit_pca.mat -- our generated scene_patchnet_feature pca matrix for mit indoor, used in vsad_encoding_example.m
- mit_vsad_codebook.mat -- our generated semantical codebook for mit_indoor, used in vsad_encoding_example.m
- multi_crop.m -- dense crop as 10 * 10 grid, used in extracting_feature_example.m
- object_selection_256.mat -- 256 objects selected from 1000(in ImageNet), applied to both MIT_indoor and SUN397
- sun_pca.mat -- our generated scene_patchnet_feature pca matrix for sun397, used in vsad_encoding_example.m
- sun_vsad_codebook.mat -- our generated semantical codebookfor sun397, used in vsad_encoding_example.m
- vsad_encoding_example.m -- an example for VSAD encoding algorithm
- vsad_encoding.m -- our developed VSAD encoding function
- plot_mit_sun.m -- Plot the figure in the below of this page
- xticklabel_rotate.m -- Serve for plot_mit_sun and rotate the text in the figure
Usage
1. Download code and model
2. Extract scene_net_feature and object_net_probability (extracting_feature_example.m, multi_crop.m)
3. VSAD encoding (vsad_encoding.m, vsad_encoding_example.m, mit_pca.mat, mit_vsad_codebook.mat, object_selection_256.mat)
Contact
Figure Plot for Reference
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].