What’s New in ARKit 2

WWDC 2018

ARWorldMap

• Mapping of physical 3D space
• Mutable list of named anchors
• Raw feature points and extent
• Serialization

Persistence

Multi-User Experiences

World Mapping Status

Realistic Rendering

• Position and orientation
• Scale
• Lighting
• Shadow
• Reflection of textures

Environment Texturing

• Gathers scene texture
• Cube map representation
• Used as reflection probe
• Reflective objects

AREnviromentProbeAnchor

• Cube map (MTLTexture)
• Physical extent
• Same lifecycle as other anchors
• Integrated in ARSCNView
• Manual placement

Image Tracking

• Images don’t need to be static
• Position and orientation for every frame
• Track multiple images simultaneously
• ARImageTrackingCongfiguration

ARImageAnchor

Using Good Images

Configurations for Image Tracking

• ARWordTrackingConfiguration
  - Image anchors in world reference frame
  - Detected images can be tracked
• ARImageTrackingConfiguration
  - Independent from world tracking
  - Position and orientation for every frame

Demo

Object Detection

• Detection of a known static 3D object
• Objects need to be scanned first
• Well-textured, rigid, non-reflective
• Position and orientation
• Integration into world tracking

ARObjectAnchor

Object Scanning

• Accumulated scene information
• Transform, extent, center
• Supported by Xcode asset catalog
• ARObjectScanningCongfiguration
• Sample code available (Scanning and detecting 3D objects)

ARReferenceObject

Directional Light Estimation

• Uses face as light probe
• Light intensity, direction, color temperature
• Spherical harmonics coefficients

Gaze Tracking

Tongue support