Have the radar point cloud already go through some detection methods such as cfar? Also does the radar point cloud have an accuracy y-axis value or the points have been processed to land on the ground plane?
Some questions about radar point cloud
The radar sensor itself performs clustering of the radar returns for the purpose of object detection etc.
Do take a look here for more details: https://github.com/nutonomy/nuscenes-devkit/issues/187