InsMapper: Exploring Inner-instance Information for Vectorized HD Mapping

the University of Hong Kong

Abstract

Vectorized high-definition (HD) maps contain detailed information about surrounding road elements, which are crucial for various downstream tasks in modern autonomous vehicles, such as motion planning and vehicle control. Recent works attempt to directly detect the vectorized HD map as a point set prediction task, achieving notable detection performance improvements. However, these methods usually overlook and fail to analyze the important inner-instance correlations between predicted points, impeding further advancements. To address this issue, we investigate the utilization of inner-instance information for vectorized high-definition mapping through transformers, and propose a powerful system named InsMapper, which effectively harnesses inner-instance information with three exquisite designs, including hybrid query generation, inner-instance query fusion, and inner-instance feature aggregation. The first two modules can better initialize queries for line detection, while the last one refines predicted line instances. InsMapper is highly adaptable and can be seamlessly modified to align with the most recent HD map detection frameworks. Extensive experimental evaluations are conducted on the challenging NuScenes and Argoverse 2 datasets, where InsMapper surpasses the previous state-of-the-art method, demonstrating its effectiveness and generality.

Demo Video


Demo Figures

We visualize live demos of InsMapper under various scenarios, with different whether and time. Some scenes may have complicated road intersection areas. Short demos are visualized with 2Hz, while long demos have 4Hz FPS.

Demo 1. Short, 2Hz, day time

Alt Text

Demo 2. Short, 2Hz, day time

Alt Text

Demo 3. Short, 2Hz, day time, complicated road intersections

Alt Text

Demo 4. Short, 2Hz, night

Alt Text

Demo 5. Long, 4Hz, day time, complicated road intersections

Alt Text

Demo 6. Long, 4Hz, day time, complicated road intersections

Alt Text

Demo 7. Long, 4Hz, day time, rainy, complicated road intersections

Alt Text

Demo 8. Long, 4Hz, night

Alt Text


Code and data

The code will be released in a later stage. For latest update, please refer to our github repo.


Contact

For any questions, please send email to zhxuv at hku dot hk or open an issue in the github repo.


Acknowledgement

We thank these high-quality open-sourced projects MapTR, VectorMapNet, HDMapNet, STSU, Sat2Graph, Deformable DETR.


Citation

@article{xu2023InsMapper,
  title={InsMapper: Exploring Inner-instance Information for Vectorized HD Mapping},
  author={Xu, Zhenhua and Wong, Kenneth KY and Zhao, Hengshuang},
  journal={arXiv preprint arXiv:2308.08543},
  year={2023}
}