I want to add RGB info from camera, to each point of Lidar Point Cloud, and have the point cloud in the 3D space i.e. Lidar co-ordinate frame. How can i do this?
Would projecting the Point Cloud from Lidar co-ordinate frame to Camera co-ordinate frame, adding RGB pixel info to each point of point cloud, then doing an inverse projection back to 3D space i.e. Lidar co-ordinate frame be the right approach?