Good Morning!

Loved the stop motion, and “Good Morning!” Energy has never been stronger, with over 1,000 submissions every hour! (Wonder how many are vibe coded).

Nice to see Tim in front of the Apple Park Rainbow! And of course there is the video from the moon trip! Apple Intelligence and Siri. And time to Craig to “get us started”.

Focus in three area

1. Platform improvement
2. Trust and Safety updates
3. Big leap forward on Apple Intelligence and Siri.

Yay! VisionOS was mentioned.

They motored north to name it! Summer of love, (love the 60’s graphics!). Golden Gate! Perfect name for the new one.

Platform improvements

Expect this to be underpinned with AI and improved reliability. So taking existing features and sweating the details. Time for the Liquid Glass improvements. A few highlights:

• Design – So Liquid Glass is upfront. So “listened” to users and developers. Updating the foundation, to improve readability, adding clarity and tinting to personalize the UI. No changes to existing apps. More uniformed toolbar, to keep test and heading legible. Sidebars now expand to the leading edge (about time). Tighter corner radius.
  • App Icons – integrating layers into the icons artwork, to make them even sharper. This means icons will be more work.
• Optimized system to address responsiveness. System animations, faster launches (up to 30%), faster content loading (up to 70%), 5x improvement on external drive access.
  • CPU Scheduler updated to make older devices feel faster. (All the way to iPhone 11, meaning that older devices are still supported).
  • Network transitions (are more seamless), via smart switching.
  • Search – rebuild spotlight, photos, and mail to improve this (I bet this is done for AI access). Prioritize new content for indexing, but more detailed search overall.
• Features
  • Photos- iCloud shared albums can now support Android users and full resolution
  • Health – Perimenopause tracking and information
  • AirPods – customer EQ (yeah!)
  • Apple VisionPro – panos can become spacial scenes and can be used as an environment
  • Maps – improved flyover for improved 3d Maps!

Trust and safety

Apple builds products to empower people and stay safe. Long standing commitment to safety for kids and teens, is import to apple. So building a trusted safety for parents and kids.

• Putting responsibility on Parents and using expert health research. Including establishing boundaries around technology use. Age based permissions guided by parental supervision. Using family media plan (guide for parents), and collaboration with researchers and advancing the science.
  • Create a child account, that tailors device to their age. You can covert existing accounts. Addresses, content they can see, who they can talk to, when they have access and more.
  • Manage downloads, App Store age groups and ask for permission from parents via messages. Added “Websites” for kids to browse. On by default for kids under 13.
  • Communication safety now includes gore.
  • Screen Time – new time allowances to allow categories, Games, entertainment, and social media. Default times based on research, but parents can adjust.
  • Can setup schedule for different times of the day, I.e. in school only allow specific apps, etc.
  • Redesigned screen time, to make it easier to use and understand.
• Developers updates to parental controls, and every app “should” enable the APIs. Wonder if my Vinyl Trackr needs this since an album cover could have gore or sex.
• New website for child safety.

Intelligence

AI has a profound value, but some are pursing AI for the sake of AI. Apple wants to make it helpful and intuitive products for everyone. AI must be centered around you and your needs. So deep integration around your personal context, and design with privacy at every level.

Architecture

Centered around you and your apple products, using Apple Foundation models, and deep collaboration with google and their Gemini model. Adapted to run on device and servers using Apple Privacy Cloud Compute. Image understanding, generation, and editing photos.
More powerful version for most capable system to generate and understand speech and more.
System orchestrator understanding across your system and using Spotlight’s new semantic index. Added in Broad world knowledge and use Private cloud compute to bring back your answer. And then App Actions to do things. On Screen Awareness, makes it more powerful.
Privacy first design! Unlike those who ask you to turn off features to be private. Apple is not stored or accessible to apple or anyone else.

Siri

All new Siri – Mike Rockwell – VP Siri Engineering. Called Siri AI. Uses new Apple Intelligence and used via “hey Siri”. A significantly more capable assistant and more conversational. And new dedicated Siri app allows you to refer back to them, with more tools like Write with Siri and more. Live demo and showing both hand and talking (call back to the marketing demos).
Dynamic Island what a nice touch. On screen awareness was cool. The demo with world knowledge was cool.
The use of intents (or what aver the new name is going to be) finally shows off what they demoed two years ago.
The most advanced products have improved audio, with expressive talking. System wide dictation improvements with punctuation , capitalization, etc. Nice to hear it is also extended to CarPlay.
iOS – swipe down for island. macOS – added into Spotlight or Control click of context windows. iPadOS or dedicated Siri app across platforms will keep history privately synced via iCloud. Allowing you to switch between devices for conversations. WatchOS will also support, and visionOS takes advantage of visualization and you put it anywhere in your space – look at it to talk talking (very cool!).
Visual Intelligence – tap shutter button to see what you see and you can then ask it questions, etc. Including nutritional info, and tab splitting. On Mac OS, you use a keyboard shortcut to select something. Multi event adding to calendar – nicely demoed. (Also coming to vision OS – baed on what you are looking at.)
Write with Siri – visually anywhere you type. Easy drafts to get started. Will know how you usually communicate with specific people. Can also do writing feedback. (Auto proofreading!).

Apps

New architecture makes apps more powerful via Apple Intelligence and Siri AI.

• Safari – simpler to manage tabs, can use AI to organize them into topics, and added new tabs to a topic as you work. Can also use it to monitor a sit and let you know when (notify me) things are available, I.e. out of stock items.
  • More personal, describe an extension will help build new safari extensions for you!
  • Passwords app – uses AI to auto update accounts which are vulnerable.
• Messages – use AI to understand context of conversation to add one tap suggestions, like find photos, reminders, etc.
• Email – suggestions
• Calendar – to add events to your schedule (via natural language).
  • Easily to edit events.
• Phone – all context to proactively surface information across your apps, i.e. confirmation code when talking to the airline. Looks at how you are calling, not what you are saying. And runs only on device.
• Home -Accessory notifications, to help you understand related notifications as a single activity. Now cameras can be used to analyze and describe what happened in the video. Easier to search for what was captured.
• Shortcuts – Describe a shortcut, will use AI to reason and assemble the steps for you.
• Image Playground – entirely new version – with high quality images using Private Cloud Compute. Bet this is using the Gemini models. Can also improve your image modifications via touch or speech. Now integrated across the system. Developers can now use these new features via Image Playground API.
• Photos – Three new feature clean up, extend, and (based on Vision Pro) Spatial Reframing (this is very very cool). Uses on device spatial models and image generation on Private Cloud Compute. Works on almost every picture in your library.

Big disclaimers

EU won’t get many of the features, nor in China.

Boxes

Agentic Codes

Xcode coding assistant – can auto localize your app. (Well that killed my app).
Device Hub to improved testing.

Back to Tim

Thank you Craig and all of our presenters. Personal note – highlights, sharing, and seeing what you create with them. No mentioned of new CEO, not surprised.