All Categories → No Category → video-language

Top 3 video-language open source projects

The repository collects many various multi-modal transformer architectures, including image transformer, video transformer, image-language transformer, video-language transformer and related datasets. Additionally, it also collects many useful tutorials and tools in these related domains.

✭ 61

multi-modal image-transformer vision-transformer video-language efficiency-transformer video-transformer mlp-mixer transformer-readling-list multi-modal-cvpr2021

VidSitu

[CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)

✭ 41

python shell nlp video vision srl captioning captioning-videos vision-and-language grounding video-language event-relations semantic-roles

ReferFormer

[CVPR2022] Official Implementation of ReferFormer

✭ 230

python Cuda C++shell video-language referring-video-object-segmentation

1-3 of 3 video-language projects