Here is what a Tesla car sees when entering autopilot mode. This looks awfully like the T-800 heads-up display from Terminator 2, don’t you think?
This video shows what Tesla Autopilot’s neural network sees on the road. Tesla says the system relies on per-camera networks to analyze raw images to perform semantic segmentation, object detection and monocular depth estimation. It employes birds-eye-view networks to take a video from all cameras to output the road layout, static infrastructure and 3D objects directly in the top-down view.