Abstract
Vectorized high-definition (HD) maps contain detailed information about surrounding road elements, which are crucial for various downstream tasks in modern autonomous vehicles, such as motion planning and vehicle control. Recent works attempt to directly detect the vectorized HD map as a point set prediction task, achieving notable detection performance improvements. However, these methods usually overlook and fail to analyze the important inner-instance correlations between predicted points, impeding further advancements. To address this issue, we investigate the utilization of inner-instance information for vectorized high-definition mapping through transformers, and propose a powerful system named InsMapper, which effectively harnesses inner-instance information with three exquisite designs, including hybrid query generation, inner-instance query fusion, and inner-instance feature aggregation. The first two modules can better initialize queries for line detection, while the last one refines predicted line instances. InsMapper is highly adaptable and can be seamlessly modified to align with the most recent HD map detection frameworks. Extensive experimental evaluations are conducted on the challenging NuScenes and Argoverse 2 datasets, where InsMapper surpasses the previous state-of-the-art method, demonstrating its effectiveness and generality.
Demo Video
Demo Figures
We visualize live demos of InsMapper under various scenarios, with different whether and time. Some scenes may have complicated road intersection areas. Short demos are visualized with 2Hz, while long demos have 4Hz FPS.
Demo 1. Short, 2Hz, day time
Demo 2. Short, 2Hz, day time
Demo 3. Short, 2Hz, day time, complicated road intersections
Demo 4. Short, 2Hz, night
Demo 5. Long, 4Hz, day time, complicated road intersections
Demo 6. Long, 4Hz, day time, complicated road intersections
Demo 7. Long, 4Hz, day time, rainy, complicated road intersections
Demo 8. Long, 4Hz, night
Code and data
The code will be released in a later stage. For latest update, please refer to our github repo.
Contact
For any questions, please send email to zhxuv at hku dot hk or open an issue in the github repo.
Acknowledgement
We thank these high-quality open-sourced projects MapTR, VectorMapNet, HDMapNet, STSU, Sat2Graph, Deformable DETR.
Citation
@article{xu2023InsMapper,
title={InsMapper: Exploring Inner-instance Information for Vectorized HD Mapping},
author={Xu, Zhenhua and Wong, Kwan-Yee~K. and Zhao, Hengshuang},
journal={arXiv preprint arXiv:2308.08543},
year={2023}
}