Apple unveils ARKit 2 in iOS 12 with improved face tracking, shared experiences across four different iOS devices, spectator mode to watch gameplay, and more

Apple today introduced ARKit 2, a platform that allows developers to integrate shared experiences, persistent AR experiences tied to a specific location, object detection and image tracking to make AR apps even more dynamic. Apple is also unveiling the Measure app for iOS, which uses AR to quickly gauge the size of real-world objects, as well as a new open file format with iOS 12, usdz, which is designed to more deeply integrate AR throughout iOS and make AR objects available across the ecosystem of Apple apps.

Apple has been delivering major AR advancements to developers at a rapid pace since ARKit shipped last fall, and this is already the third major release. ARKit gives developers the tools to create AR experiences that change the way iOS users see the world in both fun and productive ways.

Shared experiences with ARKit 2 make AR even more engaging on iPhone and iPad, allowing multiple users to play a game or collaborate on projects like home renovations. Developers can also add a spectator mode, giving friends and family the best views of AR gameplay from a different iOS device.

Persistent AR will also change the way consumers interact with AR apps by creating opportunities to leave virtual objects in the real world to which users can return. They can start a puzzle on a table and come back to it later in the same state or create an art project over the course of a few weeks without starting over each time.

ARKit 2 also extends support for image detection and tracking, making it possible to detect 3D objects like toys or sculptures, and adds the ability to automatically apply reflections of the real world onto AR objects. This makes the AR experience an even more realistic mix of the virtual and real world.

More info