{"id":3258,"date":"2023-06-09T17:12:27","date_gmt":"2023-06-09T21:12:27","guid":{"rendered":"https:\/\/michaelrowe01.com\/?p=3258"},"modified":"2023-06-09T17:12:30","modified_gmt":"2023-06-09T21:12:30","slug":"create-a-great-spatial-playback-experience","status":"publish","type":"post","link":"https:\/\/michaelrowe01.com\/index.php\/blog\/create-a-great-spatial-playback-experience\/","title":{"rendered":"Create a great spatial playback experience"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"660\" height=\"371\" data-attachment-id=\"3260\" data-permalink=\"https:\/\/michaelrowe01.com\/index.php\/blog\/create-a-great-spatial-playback-experience\/attachment\/create-a-great-spatial\/\" data-orig-file=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Create-a-great-spatial.png?fit=1920%2C1080&amp;ssl=1\" data-orig-size=\"1920,1080\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Create-a-great-spatial\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Create-a-great-spatial.png?fit=660%2C371&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Create-a-great-spatial.png?resize=660%2C371&#038;ssl=1\" alt=\"\" class=\"wp-image-3260\" srcset=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Create-a-great-spatial.png?resize=1024%2C576&amp;ssl=1 1024w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Create-a-great-spatial.png?resize=300%2C169&amp;ssl=1 300w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Create-a-great-spatial.png?resize=768%2C432&amp;ssl=1 768w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Create-a-great-spatial.png?resize=1536%2C864&amp;ssl=1 1536w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Create-a-great-spatial.png?w=1920&amp;ssl=1 1920w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Create-a-great-spatial.png?w=1320&amp;ssl=1 1320w\" sizes=\"auto, (max-width: 660px) 100vw, 660px\" \/><\/figure>\n\n\n\n<p>Creating a great video playback experience in your app<\/p>\n\n\n\n<p>Media Experience<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Builds on same APIs as other AVFoundation apps on iOS and iPadOS, AVKit builds to create a experience on each platform<\/li>\n\n\n\n<li>AVFoundation can render performantly in RealityKit<\/li>\n\n\n\n<li>You must use the matching SDK for xrOS or VisionOS&nbsp;<\/li>\n\n\n\n<li>Use AVKit and AVFoundation\n<ul class=\"wp-block-list\">\n<li>Adding the item after creating the play may improve performance<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>Use a UIViewControllerPresentatble and then attach it to your WindowView<\/li>\n\n\n\n<li>Screen and audio are anchored to the screen so while you move around they stay consistent.&nbsp; The basics of the controls will be consistent. The video player controls will appear if you look a the screen and touch it.&nbsp; They will disappear in time, or you can look and touch again.<\/li>\n<\/ul>\n\n\n\n<p>Advance Features<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Thumbnail scrubbing allows for scene-less scrubbing. If a trick play track is available it can be used.<\/li>\n\n\n\n<li>You can use interstitials UI to programmatically to identify adds or other key points in the scrubber&nbsp;<\/li>\n\n\n\n<li>Contextual actions allow you to add buttons<\/li>\n\n\n\n<li>Custom Info View Controllers allow you to show meta data and \/ or related content&nbsp;<\/li>\n\n\n\n<li>Immersive spaces &#8211; you can add in other 3D Assets, your viewing screen will automatically anchor and position itself, moving the controls closer to the viewer<\/li>\n\n\n\n<li>Provide feedback to talk about custom UI controls. Apple is working hard to update this new player<\/li>\n<\/ul>\n\n\n\n<p>Other use cases<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Inline media can be done in a window. This just an AVViewControlPlayer happens automatically&nbsp; if it doesn\u2019t cover the whole window.&nbsp; It won\u2019t be able to be 3D because of the other content in the windows<\/li>\n\n\n\n<li>For splash screens, etc. use RealityKit Video players component.<\/li>\n\n\n\n<li>This will be an Aspect ratio correct mesh with captions and better performance.<\/li>\n\n\n\n<li>If you want video as an effect &#8211; you may want your own geometry use RealityKit VideoMaterial&nbsp;<\/li>\n<\/ul>\n\n\n\n<p>Conclusion<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Take a look at this table to help decide which type of player you need:<\/li>\n\n\n\n<li>Check out DestinationVideo sample project<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"660\" height=\"371\" data-attachment-id=\"3259\" data-permalink=\"https:\/\/michaelrowe01.com\/index.php\/blog\/create-a-great-spatial-playback-experience\/attachment\/screenshot-2023-06-09-at-17-10-34-2\/\" data-orig-file=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-09-at-17.10.34-2.png?fit=1920%2C1080&amp;ssl=1\" data-orig-size=\"1920,1080\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Screenshot-2023-06-09-at-17.10.34-2\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-09-at-17.10.34-2.png?fit=660%2C371&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-09-at-17.10.34-2.png?resize=660%2C371&#038;ssl=1\" alt=\"\" class=\"wp-image-3259\" srcset=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-09-at-17.10.34-2.png?resize=1024%2C576&amp;ssl=1 1024w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-09-at-17.10.34-2.png?resize=300%2C169&amp;ssl=1 300w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-09-at-17.10.34-2.png?resize=768%2C432&amp;ssl=1 768w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-09-at-17.10.34-2.png?resize=1536%2C864&amp;ssl=1 1536w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-09-at-17.10.34-2.png?w=1920&amp;ssl=1 1920w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-09-at-17.10.34-2.png?w=1320&amp;ssl=1 1320w\" sizes=\"auto, (max-width: 660px) 100vw, 660px\" \/><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Creating a great video playback experience in your app Media Experience Advance Features Other use cases Conclusion<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"hide_page_title":"","_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[2,3],"tags":[731,732,725,528,680],"class_list":["post-3258","post","type-post","status-publish","format-standard","hentry","category-blog","category-personal-softwareandit","tag-avfoundation","tag-avkit","tag-day-5","tag-realitykit","tag-wwdc23"],"aioseo_notices":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p2aMa8-Qy","jetpack-related-posts":[],"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/posts\/3258","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/comments?post=3258"}],"version-history":[{"count":1,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/posts\/3258\/revisions"}],"predecessor-version":[{"id":3261,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/posts\/3258\/revisions\/3261"}],"wp:attachment":[{"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/media?parent=3258"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/categories?post=3258"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/tags?post=3258"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}