Towards effective and efficient video object detection

Secondly, how to achieve accurate video object detection algorithms with real-time speed? Finally, how to extract spatio-temporal features more efficiently and effectively? <br><br>In this thesis, we present three novel methods to address the aforementioned challenges and achieve effective and efficient video object detection. Firstly, we propose a memory bank structure to enhance the low-quality frame using features from the previous frames.

Using the memory bank, we can easily enhance the quality of features extracted from poor video frames. Therefore, our method outperforms many state-of-the-art methods on the large-scale ImageNet VID benchmark. Secondly, we propose a general framework that can be applied to various one-stage detectors for video object detection.

We design a location prior network and a size prior network to skip unnecessary computations on background regions. Thirdly, we carefully design a temporal dilated transformer block (TDTB) to build a simple yet effective backbone for dense video tasks, named temporal dilated video transformer (TDViT). TDViT achieves excellent performance on two widely used dense video benchmarks, ImageNet VID for video object detection and YouTube VIS for video instance segmentation.

The excellent performance and generalisation ability demonstrate that our TDViT can be served as a general backbone for dense video tasks.<br>