Create a great spatial playback experience

Creating a great video playback experience in your app

Media Experience

Builds on same APIs as other AVFoundation apps on iOS and iPadOS, AVKit builds to create a experience on each platform
AVFoundation can render performantly in RealityKit
You must use the matching SDK for xrOS or VisionOS
Use AVKit and AVFoundation
- Adding the item after creating the play may improve performance
Use a UIViewControllerPresentatble and then attach it to your WindowView
Screen and audio are anchored to the screen so while you move around they stay consistent. The basics of the controls will be consistent. The video player controls will appear if you look a the screen and touch it. They will disappear in time, or you can look and touch again.

Advance Features

Thumbnail scrubbing allows for scene-less scrubbing. If a trick play track is available it can be used.
You can use interstitials UI to programmatically to identify adds or other key points in the scrubber
Contextual actions allow you to add buttons
Custom Info View Controllers allow you to show meta data and / or related content
Immersive spaces – you can add in other 3D Assets, your viewing screen will automatically anchor and position itself, moving the controls closer to the viewer
Provide feedback to talk about custom UI controls. Apple is working hard to update this new player

Other use cases

Inline media can be done in a window. This just an AVViewControlPlayer happens automatically if it doesn’t cover the whole window. It won’t be able to be 3D because of the other content in the windows
For splash screens, etc. use RealityKit Video players component.
This will be an Aspect ratio correct mesh with captions and better performance.
If you want video as an effect – you may want your own geometry use RealityKit VideoMaterial

Conclusion