DRML_pytorch
- Implementation of Deep Region and Multi-Label Learning for Facial Action Unit Detection.
Statement
-
Do the Experiments on the Cohn-Kanade dataset. And I only use about 600 images (nearly 500 images for training, 100 images for testing, 12 AU, no alignment ).
-
Compare with and without Region Layer. In the situation of without Region Layer, I use one convolution layer to replace it.
-
Directly train without sample operation to deal with imbalance between positive and negative samples. So the dataset only contains label (1, -1)
-
Calculate loss according to the formula in Paper which considers the label {-1, 0, 1}. So If you want to do the paper's experiments (positive and negative samples for each AU), you can rewrite the lib/data_loader.
-
Only calculate the F1-score.
Environment and Compile
- python 3.6
- pytorch 0.3.0
Accuracy
You can see the results in log files
- logs/region_layer.log.
- logs/without_region_layer.log.
Visualization The result with region layer is worse than without region layer. I think it maybe have something to do with
- Small dataset (overfitting) which has only 600 images and no sample operation.
- Without alignment.
Compare to the results in paper
(Some AU is different from the AU in my experiment)
