tjubiit / Tju Dhd

TJU-DHD dataset (object detection and pedestrian detection)

This is the official website for "TJU-DHD: A Diverse High-Resolution Dataset for Object Detection (TIP2020)", which is a newly built high-resolution dataset for object detection and pedestrian detection.

• 115k+ images and 700k+ instances
• Scenes: traffic and campus, Tasks: object detection and pedestrian detection
• High resolution: image resolution of at least 1624x1200 pixels, the object height from 11 pixels to 4152 pixels.
• Diversity: A large variance in appearance, scale, illumination, season, and weather
• Cross-scene evaluation and same-scene evaluation on pedestrian detection
• If you are interested in pedestrian detection, please refer to our survey paper or our github project.

Table of Contents

1. Introduction
2. Object detection dataset
   2.1 TJU-DHD-traffic
   2.2 TJU-DHD-campus
3. Pedestrian detection dataset
   3.1 TJU-Ped-traffic
   3.2 TJU-Ped-campus
4. Benchmark
   4.1 TJU-DHD-traffic
   4.2 TJU-DHD-campus
   4.3 TJU-DHD-pedestrian
5. Citation
6. Contact

1. Introduction

Vehicles, pedestrians, and riders are the most important and interesting objects in the perception modules of self-driving vehicles and video surveillance. However, the state-of-the-art performance of detecting such important objects (esp. small objects) is far from satisfying the demand of the practical systems. Large-scale, rich-diversity, and high-resolution vehicle and pedestrian datasets play an important role in developing better object detection methods to satisfy the demand. Existing public large-scale datasets such as MS COCO collected from websites do not focus on these specific scenarios. Moreover, the popular datasets (e.g., KITTI and Citypersons) collected from these specific scenarios are limited in the number of images and instances, the resolution, and the diversity in seasons, weathers, and illuminations. To attempt to solve the problem, in this paper, we build a diverse high-resolution dataset (called TJU-DHD). The dataset contains 115,354 high-resolution images (52% images have a resolution of 1624x1200 pixels and 48% images have a resolution of at least 2,560x1,440 pixels) and 709,330 labeled objects in total with a large variance in scale and appearance. Meanwhile, the dataset has a rich diversity in season variance, illumination variance, and weather variance. Based on this object dataset, a new diverse pedestrian dataset is further built. With the four different detectors (i.e., the one-stage RetinaNet, anchor-free FCOS, two-stage FPN, and Cascade R-CNN), experiments about object detection and pedestrian detection are conducted. We hope that the newly built dataset can help promote the research on object detection and pedestrian detection in these two scenes.

2. Object detection dataset

2.1 TJU-DHD-traffic

• training & validation set:
  • images: OneDrive / BaiduNetDisk (code: biit) / backup
  • annotations: OneDrive / BaiduNetDisk (code: biit) / backup
• test set:
  • images: OneDrive / BaiduNetDisk (code: biit) / backup
  • imageinfo: OneDrive / BaiduNetDisk (code: biit) / backup
• evaluation tools: cocoapi

2.2 TJU-DHD-campus

(The training imageset is too large, thus is ziped as a 4-part archive. One should download all of them and open the .zip.001 using your favorite zip file extractor.)

• training & validation set:
  • training images-1: OneDrive / BaiduNetDisk (code: biit) / backup
  • training images-2: OneDrive / BaiduNetDisk (code: biit) / backup
  • training images-3: OneDrive / BaiduNetDisk (code: biit) / backup
  • training images-4: OneDrive / BaiduNetDisk (code: biit) / backup
  • validation images: OneDrive / BaiduNetDisk (code: biit) / backup
  • annotations: OneDrive / BaiduNetDisk (code: biit) / backup
• test set:
  • images: OneDrive / BaiduNetDisk (code: biit) / backup
  • imageinfo: OneDrive / BaiduNetDisk (code: biit) / backup
• evaluation tools: cocoapi

3. Pedestrian detection dataset

3.1 TJU-Ped-traffic

(Note that the images are same as those in the TJU-DHD-traffic)

• training & validation set:
  • images: OneDrive / BaiduNetDisk (code: biit) / backup
  • annotations: OneDrive / BaiduNetDisk (code: biit) / backup
• test set:
  • images: OneDrive / BaiduNetDisk (code: biit) / backup
  • imageinfo: OneDrive / BaiduNetDisk (code: biit) / backup
• evaluation tools: Citypersons API

3.2 TJU-Ped-campus

(Note that the images are same as those in the TJU-DHD-campus)

• training & validation set:
  • training images-1: OneDrive / BaiduNetDisk (code: biit) / backup
  • training images-2: OneDrive / BaiduNetDisk (code: biit) / backup
  • training images-3: OneDrive / BaiduNetDisk (code: biit) / backup
  • training images-4: OneDrive / BaiduNetDisk (code: biit) / backup
  • validation images: OneDrive / BaiduNetDisk (code: biit) / backup
  • annotations: OneDrive / BaiduNetDisk (code: biit) / backup
• test set:
  • images: OneDrive / BaiduNetDisk (code: biit) / backup
  • imageinfo: OneDrive / BaiduNetDisk (code: biit) / backup
• evaluation tools: Citypersons API

4. Benchmark

4.1 TJU-DHD-traffic

• Results on validation

  method	backbone	input size	AP	[email protected]	[email protected]	AP_s	AP_m	AP_l
  RetinaNet	ResNet50	1333x800	53.5	80.9	60.0	24.0	50.5	68.0
  FCOS	ResNet50	1333x800	53.8	80.0	60.1	24.6	50.6	68.8
  FPN	ResNet50	1333x800	55.4	83.4	63.0	30.4	52.2	68.2
  Cascade RCNN	ResNet50	1333x800	57.9	82.7	66.6	32.6	54.4	71.4

4.2 TJU-DHD-campus

• Results on validation

  method	backbone	input size	AP	[email protected]	[email protected]	AP_t	AP_s	AP_l	AP_l
  RetinaNet	ResNet50	1333x800	48.4	79.3	52.4	4.7	27.3	56.2	73.8
  FCOS	ResNet50	1333x800	49.3	73.8	53.8	5.6	29.6	55.9	74.3
  FPN	ResNet50	1333x800	52.4	77.5	58.4	8.5	37.4	58.6	74.9
  Cascade RCNN	ResNet50	1333x800	55.1	77.6	60.9	10.8	40.1	61.2	78.8

4.3 TJU-DHD-pedestrian

• Miss rate with same-scene evaluation

  method	R/RS/HO/R+HO/A (TJU-Ped-campus)	R/RS/HO/R+HO/A (TJU-Ped-traffic)
  FPN	27.92/73.14/67.52/35.67/38.08	22.30/35.19/60.30/26.71/37.78

• Miss rate with cross-scene evaluation

  method	R/R+HO (TJU-Ped-campus -> traffic)	R/R+HO (TJU-Ped-traffic -> campus)
  FPN	30.62 / 33.89	42.08 / 50.55

5. Citation

If this project help your research, please consider to cite our paper.

@article{Pang_DHD_TIP_2020,
         author = {Yanwei Pang and Jiale Cao and Yazhao Li and Jin Xie and Hanqing Sun and Jinfeng Gong},
         title = {TJU-DHD: A Diverse High-Resolution Dataset for Object Detection},
         journal = {IEEE Transactions on Image Processing},
         year = 2020
        }

@article{Cao_PDR_arXiv_2020,
         author = {Jiale Cao and Yanwei Pang and Jin Xie and Fahad Shahbaz Khan and Ling Shao},
         title = {From Handcrafted to Deep Features for Pedestrian Detection: A Survey},
         journal = {arXiv:2010.00456},
         year = 2020
        }

6. Contact

If you have any questions or want to add your results, please feel free to contact us.