{"id":3199,"date":"2023-06-08T18:45:30","date_gmt":"2023-06-08T22:45:30","guid":{"rendered":"https:\/\/michaelrowe01.com\/?p=3199"},"modified":"2023-06-08T18:45:32","modified_gmt":"2023-06-08T22:45:32","slug":"evolve-your-arkit-app-for-spatial-experiences","status":"publish","type":"post","link":"https:\/\/michaelrowe01.com\/index.php\/blog\/evolve-your-arkit-app-for-spatial-experiences\/","title":{"rendered":"Evolve your ARKit app for spatial experiences"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"660\" height=\"371\" data-attachment-id=\"3201\" data-permalink=\"https:\/\/michaelrowe01.com\/index.php\/blog\/evolve-your-arkit-app-for-spatial-experiences\/attachment\/evolve-your-arkit-app\/\" data-orig-file=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Evolve-your-ARKit-app.png?fit=1920%2C1080&amp;ssl=1\" data-orig-size=\"1920,1080\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Evolve-your-ARKit-app\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Evolve-your-ARKit-app.png?fit=660%2C371&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Evolve-your-ARKit-app.png?resize=660%2C371&#038;ssl=1\" alt=\"\" class=\"wp-image-3201\" srcset=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Evolve-your-ARKit-app.png?resize=1024%2C576&amp;ssl=1 1024w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Evolve-your-ARKit-app.png?resize=300%2C169&amp;ssl=1 300w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Evolve-your-ARKit-app.png?resize=768%2C432&amp;ssl=1 768w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Evolve-your-ARKit-app.png?resize=1536%2C864&amp;ssl=1 1536w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Evolve-your-ARKit-app.png?w=1920&amp;ssl=1 1920w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Evolve-your-ARKit-app.png?w=1320&amp;ssl=1 1320w\" sizes=\"auto, (max-width: 660px) 100vw, 660px\" \/><\/figure>\n\n\n\n<p>Prepare your experience&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Expand your app beyond the window,&nbsp; by default apps launch into the shared space, like multiple apps on the desktop<\/li>\n\n\n\n<li>You can do Shared Spaces, and Full Space &#8211; this gives you more features like AnchorEntities and ARKit<\/li>\n\n\n\n<li>Prepare you content\n<ul class=\"wp-block-list\">\n<li>Use usd to create your 3D content, it is at the heart of 3D content, you can use them directly in Reality Composer Pro<\/li>\n\n\n\n<li>If you have custom materials you will need to rebuild them in the shader app in Reality Composer Pro&nbsp;<\/li>\n\n\n\n<li>You can access Reality Composer Pro directly in Xcode<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<p>Use RealityView<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>You can add both 2d and 3D content side by side<\/li>\n\n\n\n<li>But you must use RealityView as discussed in the session &#8211; <a href=\"https:\/\/michaelrowe01.com\/index.php\/blog\/enhance-your-spatial-computing-app-with-realitykit\/\">https:\/\/michaelrowe01.com\/index.php\/blog\/enhance-your-spatial-computing-app-with-realitykit\/<\/a>&nbsp;<\/li>\n\n\n\n<li>A lot of the concepts of Spatial Computing come over from ARView in iOS<\/li>\n<\/ul>\n\n\n\n<p>Bring in your content<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>In shared Space &#8211; just add them directly to the RealityView Content, you can see more details in the session above<\/li>\n\n\n\n<li>In a Full Space &#8211; a key value is you can an Anchor the app to specific surroundings.&nbsp; Different than iOS you do not need to ask for permission to use Anchor Entities<\/li>\n\n\n\n<li>ARKit can allow of WorldAnchors and Anchor persistence &#8211; you will be required to have user permission to use ARKit capabilties<\/li>\n<\/ul>\n\n\n\n<p>Recasting<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Allows you to reach out beyond arm\u2019s length<\/li>\n\n\n\n<li>Requires collision components&nbsp;<\/li>\n\n\n\n<li>You can RayCast with system Gestures or Hand Tracking&nbsp;<\/li>\n\n\n\n<li>By generating a Mesh Anchor of the environment to reconstruct the scene, you then create an Entity to recognize the time, and you create a transform and collision entity to track the environment.&nbsp; These entities represent the surroundings. &nbsp;<\/li>\n\n\n\n<li>This Recasting allows you to then add an input target to all you to hold a position in world space.<\/li>\n\n\n\n<li>By using a HandAnchor from ARKit you can build an RayCasting to identify the collision in the scene &#8211; then create a world Anchor in space to save the position.&nbsp; You now place the entity and transform it to the world anchor &#8211; you can now place the item in the real world.<\/li>\n\n\n\n<li>By taking the placed item and creating a collision model you can now interact with it as if it is really there.<\/li>\n<\/ul>\n\n\n\n<p>ARKit updates<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Receiving anchors has changed to address Spatial Computing&nbsp;<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"660\" height=\"371\" data-attachment-id=\"3200\" data-permalink=\"https:\/\/michaelrowe01.com\/index.php\/blog\/evolve-your-arkit-app-for-spatial-experiences\/attachment\/run-your-session\/\" data-orig-file=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Run-your-session.png?fit=1920%2C1080&amp;ssl=1\" data-orig-size=\"1920,1080\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Run-your-session\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Run-your-session.png?fit=660%2C371&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Run-your-session.png?resize=660%2C371&#038;ssl=1\" alt=\"\" class=\"wp-image-3200\" srcset=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Run-your-session.png?resize=1024%2C576&amp;ssl=1 1024w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Run-your-session.png?resize=300%2C169&amp;ssl=1 300w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Run-your-session.png?resize=768%2C432&amp;ssl=1 768w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Run-your-session.png?resize=1536%2C864&amp;ssl=1 1536w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Run-your-session.png?w=1920&amp;ssl=1 1920w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Run-your-session.png?w=1320&amp;ssl=1 1320w\" sizes=\"auto, (max-width: 660px) 100vw, 660px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Now you have an Ala carte selection of things to create your items you wish to receive.<\/li>\n\n\n\n<li>On xrOS data providers provide an asynchronous anchor update that is decoupled from other updates. You don\u2019t get ARFrames anymore, this is automatically done by the system, which reduces latency&nbsp;<\/li>\n\n\n\n<li>World anchor persistence\n<ul class=\"wp-block-list\">\n<li>System continuously persists this mapping for you<\/li>\n\n\n\n<li>Just use the world anchor and use WorldTrackingProvider which will allow you to load and unload virtual content<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Prepare your experience&nbsp; Use RealityView Bring in your content Recasting ARKit updates<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"hide_page_title":"","_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[2,3],"tags":[470,109,703,680],"class_list":["post-3199","post","type-post","status-publish","format-standard","hentry","category-blog","category-personal-softwareandit","tag-arkit","tag-day-4","tag-spatial-computing","tag-wwdc23"],"aioseo_notices":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p2aMa8-PB","jetpack-related-posts":[],"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/posts\/3199","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/comments?post=3199"}],"version-history":[{"count":1,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/posts\/3199\/revisions"}],"predecessor-version":[{"id":3202,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/posts\/3199\/revisions\/3202"}],"wp:attachment":[{"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/media?parent=3199"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/categories?post=3199"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/tags?post=3199"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}