Constarium
← Search

Table · dataset · 2021

Data for Cooperative perception for 3D object detection in driving scenarios using infrastructure sensors

Listed in figshare

3D object detection is a common function within the perception system of an autonomous vehicle and outputs a list of 3D bounding boxes around objects of interest.

Description

Various 3D object detection methods have relied on fusion of different sensor modalities to overcome limitations of individual sensors. However, occlusion, limited field-of-view and low-point density of the sensor data cannot be reliably and cost-effectively addressed by multi-modal sensing from a single point of view.

Alternatively, cooperative perception incorporates information from spatially diverse sensors distributed around the environment as a way to mitigate these limitations. This article proposes two schemes for cooperative 3D object detection using single modality sensors. The early fusion scheme combines point clouds from multiple spatially diverse sensing points of view before detection.

Read the rest (3 more)

In contrast, the late fusion scheme fuses the independently detected bounding boxes from multiple spatially diverse sensors. We evaluate the performance of both schemes, and their hybrid combination, using a synthetic cooperative dataset created in two complex driving scenarios, a T-junction and a roundabout. The evaluation shows that the early fusion approach outperforms late fusion by a significant margin at the cost of higher communication bandwidth.

The results demonstrate that cooperative perception can recall more than 95% of the objects as opposed to 30% for single-point sensing in the most challenging scenario. To provide practical insights into the deployment of such system, we report how the number of sensors and their configuration impact the detection performance of the system.<br><br>Cooperative 3D Object Detection using Infrastructure Sensors Dataset ==================================================================== Files Description ------------------ File: dataset.tar.xz Description: contains the Tar compressed dataset files used to train and evaluate the model on the T-junction and Roundabout scenarios.

File: saved_models.tar.xz Description: contains the Tar compressed pre-trained pytorch weights for the T-junction and roundabout models. These were the models used for evaluation in the paper. Code Information ----------------- For more information on how to use these files, please read the official code repository at github.com/eduardohenriquearnold/coop-3dod-infra Disclaimer ----------- If you use this dataset, the pre-trained models or our code, please cite our work using @article{arnold_coop3dod, author={Arnold, Eduardo and Dianati, Mehrdad and de Temple, Robert and Fallah, Saber}, journal={IEEE Transactions on Intelligent Transportation Systems}, title={Cooperative Perception for 3D Object Detection in Driving Scenarios Using Infrastructure Sensors}, year={2020}, pages={1-13}, doi={10.1109/TITS.2020.3028424} }

Links

Where it is published

Catalogue records · 1

Topics

Provenance · 1 source records, 19 field assertions
SourceKeyLast seenRaw
figshareoai:figshare.com:article/338321418 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · figshare comconnector:figshare_com@1.0.0
concepts[field].anzsrc:field:460304mapping · figshare comvocabulary-mapper@1.0.0keywords['Computer vision']
concepts[field].anzsrc:field:460306mapping · figshare comvocabulary-mapper@1.0.0keywords['Image processing']
concepts[field].anzsrc:group:4611mapping · figshare comvocabulary-mapper@1.0.0keywords['Machine learning']
concepts[field].local:field:astronomymapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:chemistrymapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:computer-science-aimapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:earth-environmentalmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:economics-financemapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:engineeringmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:humanitiesmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:life-sciencesmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:medicine-healthmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:ocean-atmosphericmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:social-sciencemapping · figshare comconnector:figshare_com@1.0.0
descriptionsource · figshare comconnector:figshare_com@1.0.0/metadata/dc/description
licensesource · figshare comconnector:figshare_com@1.0.0/metadata/dc/rights
publication_datesource · figshare comconnector:figshare_com@1.0.0
titlesource · figshare comconnector:figshare_com@1.0.0/metadata/dc/title