According to Apple, the new LiDAR Scanner will allow for a “new generation of AR apps” that use Scene Geometry for enhanced scene understanding and object occlusion.
Existing AR experiences on iPad Pro can also be improved with instant AR placement and improved Motion Capture and People Occlusion.
The LiDAR Scanner uses reflected light to measure the distance from the sensor to surrounding objects up to five meters away, indoors and outdoors. Depth frameworks in iPadOS combine depth points measured by the LiDAR Scanner, data from the two cameras, and data from motion sensors with computer vision algorithms handled by the A12Z Bionic to create a detailed and complete understanding of a scene.
At the current time, the new LiDAR Scanner with its enhanced augmented reality capabilities is limited to the new iPad Pro models, but Apple is also expected to include the feature in the 2020 iPhone models set to be released this fall.