Class-balanced Grouping and Sampling for Point Cloud 3D Object Detection
read the original abstract
This report presents our method which wins the nuScenes3D Detection Challenge [17] held in Workshop on Autonomous Driving(WAD, CVPR 2019). Generally, we utilize sparse 3D convolution to extract rich semantic features, which are then fed into a class-balanced multi-head network to perform 3D object detection. To handle the severe class imbalance problem inherent in the autonomous driving scenarios, we design a class-balanced sampling and augmentation strategy to generate a more balanced data distribution. Furthermore, we propose a balanced group-ing head to boost the performance for the categories withsimilar shapes. Based on the Challenge results, our methodoutperforms the PointPillars [14] baseline by a large mar-gin across all metrics, achieving state-of-the-art detection performance on the nuScenes dataset. Code will be released at CBGS.
This paper has not been read by Pith yet.
Forward citations
Cited by 13 Pith papers
-
nuScenes: A multimodal dataset for autonomous driving
nuScenes provides the first public autonomous-driving dataset that includes synchronized 360-degree data from cameras, radars, and lidar together with 3D bounding-box annotations across 1000 scenes.
-
GaussianFusion: Unified 3D Gaussian Representation for Multi-Modal Fusion Perception
GaussianFusion presents a 3D Gaussian-based framework that unifies multi-modal features in continuous space for 3D object detection and semantic occupancy, reporting gains over BEVFusion and GaussFormer on nuScenes.
-
ATLAS: A Large-Scale Evaluation Benchmark for Adversarial LiDAR Perception
ATLAS is the first large-scale benchmark for black-box adversarial attacks on LiDAR perception, revealing that stronger clean-data models are more vulnerable to point injection due to object database sampling augmentations.
-
SimPB++: Simultaneously Detecting 2D and 3D Objects from Multiple Cameras
SimPB++ unifies multi-view 2D perspective and 3D BEV object detection in one model via an interactive hybrid decoder, reporting state-of-the-art results on nuScenes and long-range detection up to 150 m on Argoverse2.
-
CAM3DNet: Comprehensively mining the multi-scale features for 3D Object Detection with Multi-View Cameras
CAM3DNet outperforms prior camera-based 3D detectors on nuScenes, Waymo and Argoverse by using three new modules to better mine multi-scale spatiotemporal features from 2D queries and pyramid maps.
-
RQR3D: Reparametrizing the regression targets for BEV-based 3D object detection
RQR3D reparametrizes oriented bounding box regression in BEV 3D detection as regressing a horizontal box plus corner offsets and achieves SOTA camera-radar performance on nuScenes with 67.5 NDS and 59.7 mAP.
-
BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-View
BEVDet achieves 39.3% mAP and 47.2% NDS on nuScenes val set with a fast BEV-based multi-camera 3D detector that outperforms FCOS3D while using far less compute in its tiny variant.
-
Camera and LiDAR BEV Fusion for Cooperative 3D Object Detection on TUMTraf V2X
A roadside-camera plus infrastructure-vehicle LiDAR fusion model reaches 0.85 mAP on TUMTraf V2X but 44 of 50 test frames overlap with the released train and validation splits.
-
Can BEV Perception Gracefully Degrade under Sensor Failures?
Grace-BEV enables graceful degradation in BEV perception under sensor failures by using a TrustGate Router for modality trustworthiness and FailSafe Fusion Block for dynamic integration, with modality dropout training...
-
SemLT3D: Semantic-Guided Expert Distillation for Camera-only Long-Tailed 3D Object Detection
SemLT3D introduces semantic-guided expert distillation with a language MoE module and CLIP projection to enrich features for long-tailed classes in camera-only 3D detection.
-
Radar-Camera BEV Multi-Task Learning with Cross-Task Attention Bridge for Joint 3D Detection and Segmentation
CTAB exchanges features between detection and segmentation via multi-scale deformable attention in BEV space, yielding segmentation gains on 7 nuScenes classes at neutral detection cost.
-
Class-Adaptive Cooperative Perception for Multi-Class LiDAR-based 3D Object Detection in V2X Systems
A new class-adaptive fusion architecture improves multi-class LiDAR 3D object detection in V2X cooperative perception by routing small and large objects through attentive pathways and balancing training objectives.
-
All You Need for Object Detection: From Pixels, Points, and Prompts to Next-Gen Fusion and Multimodal LLMs/VLMs in Autonomous Vehicles
A survey synthesizing sensor fusion strategies, AV datasets, and emerging LLM/VLM-powered object detection pipelines for autonomous vehicles.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.