{"id":3285,"date":"2023-06-10T14:56:29","date_gmt":"2023-06-10T18:56:29","guid":{"rendered":"https:\/\/michaelrowe01.com\/?p=3285"},"modified":"2023-06-10T14:56:42","modified_gmt":"2023-06-10T18:56:42","slug":"integrate-with-motorized-iphone-stands-using-dockkit","status":"publish","type":"post","link":"https:\/\/michaelrowe01.com\/index.php\/blog\/integrate-with-motorized-iphone-stands-using-dockkit\/","title":{"rendered":"Integrate with motorized iPhone stands using DockKit"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"660\" height=\"371\" data-attachment-id=\"3287\" data-permalink=\"https:\/\/michaelrowe01.com\/index.php\/blog\/integrate-with-motorized-iphone-stands-using-dockkit\/attachment\/%ef%a3%bfwwdc23-36\/\" data-orig-file=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/%EF%A3%BFWWDC23-36.png?fit=1920%2C1080&amp;ssl=1\" data-orig-size=\"1920,1080\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"\uf8ffWWDC23-36\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/%EF%A3%BFWWDC23-36.png?fit=660%2C371&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/%EF%A3%BFWWDC23-36.png?resize=660%2C371&#038;ssl=1\" alt=\"\" class=\"wp-image-3287\" srcset=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/%EF%A3%BFWWDC23-36.png?resize=1024%2C576&amp;ssl=1 1024w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/%EF%A3%BFWWDC23-36.png?resize=300%2C169&amp;ssl=1 300w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/%EF%A3%BFWWDC23-36.png?resize=768%2C432&amp;ssl=1 768w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/%EF%A3%BFWWDC23-36.png?resize=1536%2C864&amp;ssl=1 1536w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/%EF%A3%BFWWDC23-36.png?w=1920&amp;ssl=1 1920w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/%EF%A3%BFWWDC23-36.png?w=1320&amp;ssl=1 1320w\" sizes=\"auto, (max-width: 660px) 100vw, 660px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Introduction to DockKit<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Allows iPhone to act as a compute for motorized camera stands &#8211; controls pitch and yaw<\/li>\n\n\n\n<li>Stands have LED indicator to let you know that it is tracking, simple buttons for power and disabling tracking<\/li>\n\n\n\n<li>You pair a phone with the Stand &#8211; all the control is in the iPhone at the system level.&nbsp; So any App that uses camera APIs can use this Feature<\/li>\n\n\n\n<li>Demonstrated a prototyped Stand &#8211; that allows for the camera to track the speaker.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">How it works<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>It works with the camera processing pipeline in iOS, it estimates trajectory and then adjusts to keep the user in frame.<\/li>\n\n\n\n<li>The process runs as a daemon and controls actuators on the device &#8211; at 30 fps.<\/li>\n\n\n\n<li>It uses bounding boxes and can track multiple users via face and body detection.<\/li>\n\n\n\n<li>DockKit starts with a primary tracking person and will try to Fram others but will ensure that the primary stays in frame.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Custom Control<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>You can change framing, change what is being tracked, or directly control the motorized accessory&nbsp;<\/li>\n\n\n\n<li>You must register for accessory state changes in order to do this.&nbsp; DockAccessoryManager.shared.accessoryStateChanges &#8211; there are only two must handle stages, docked and undocked.<\/li>\n\n\n\n<li>You can change cropping via Framing Mode (left, center, or right) or you can set a specific Region of interest.<\/li>\n\n\n\n<li>You can also do custom motor controls &#8211; just set setSystemTrackingEnabled(false) &#8211; then you can adjust X &amp; Y for rotation\/Pitch (X) and Tilt\/Yaw (Y)<\/li>\n\n\n\n<li>You can also add your own inference using Vision, CustomML or other Heuristics &#8211; use this to decide what you want to track.&nbsp; Just set a bounding box on the item to track the Observation you\u2019ve defined.&nbsp; You can use a type of .humanFace or .object&nbsp;<\/li>\n\n\n\n<li>The current vision framework can already be used to detect the following which can be turned into trackable items:<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"660\" height=\"371\" data-attachment-id=\"3286\" data-permalink=\"https:\/\/michaelrowe01.com\/index.php\/blog\/integrate-with-motorized-iphone-stands-using-dockkit\/attachment\/human-rectangles-detection-body-pose-detection\/\" data-orig-file=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Human-Rectangles-Detection-Body-Pose-Detection-.png?fit=1920%2C1080&amp;ssl=1\" data-orig-size=\"1920,1080\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Human-Rectangles-Detection-Body-Pose-Detection-\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Human-Rectangles-Detection-Body-Pose-Detection-.png?fit=660%2C371&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Human-Rectangles-Detection-Body-Pose-Detection-.png?resize=660%2C371&#038;ssl=1\" alt=\"\" class=\"wp-image-3286\" srcset=\"https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Human-Rectangles-Detection-Body-Pose-Detection-.png?resize=1024%2C576&amp;ssl=1 1024w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Human-Rectangles-Detection-Body-Pose-Detection-.png?resize=300%2C169&amp;ssl=1 300w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Human-Rectangles-Detection-Body-Pose-Detection-.png?resize=768%2C432&amp;ssl=1 768w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Human-Rectangles-Detection-Body-Pose-Detection-.png?resize=1536%2C864&amp;ssl=1 1536w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Human-Rectangles-Detection-Body-Pose-Detection-.png?w=1920&amp;ssl=1 1920w, https:\/\/i0.wp.com\/michaelrowe01.com\/wp-content\/uploads\/2023\/06\/Human-Rectangles-Detection-Body-Pose-Detection-.png?w=1320&amp;ssl=1 1320w\" sizes=\"auto, (max-width: 660px) 100vw, 660px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Device animations<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>There are four built in animations &#8211; yes, no, wakeup and kapow!<\/li>\n\n\n\n<li>You can setup a motion detector to trigger the animations<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Introduction to DockKit How it works Custom Control Device animations<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_wp_convertkit_post_meta":{"form":"-1","landing_page":"0","tag":"0","restrict_content":"0"},"hide_page_title":"","_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[2,3],"tags":[739,743,227,680],"class_list":["post-3285","post","type-post","status-publish","format-standard","hentry","category-blog","category-personal-softwareandit","tag-day-6","tag-dockkit","tag-iphone","tag-wwdc23"],"aioseo_notices":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p2aMa8-QZ","jetpack-related-posts":[],"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/posts\/3285","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/comments?post=3285"}],"version-history":[{"count":1,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/posts\/3285\/revisions"}],"predecessor-version":[{"id":3288,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/posts\/3285\/revisions\/3288"}],"wp:attachment":[{"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/media?parent=3285"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/categories?post=3285"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/michaelrowe01.com\/index.php\/wp-json\/wp\/v2\/tags?post=3285"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}