Love the intro animation, very trippy…
Good morning! 15th Anniversary of the App Store, which changed everything. Nice to start the discussion with Developers. Time for some breakthrough experiences.
Over to John to talk about the Mac. (Interior shot)
- 15 inch MacBook Air, (Nice to see Female exec with the details) – 18 hour battery lap! Definitely a nice machine for the people. Nice to show copy and paste with phone. Starting at $1299. (This may be the one to replace susie’s machine. Screen size and lowest tech would be a blow away compared to her current machine)
- Pro machine update
- Mac Studio – Used at NBC for SNL. Getting an update (Jennifer Munn – Dir. Product Engineering) – Getting M2 Max, adding the M2 Ultra, 24Core CPU, 76 Core GPU, 32 Core Neural Engine, and 192GB of Unified Memory. Can support 6 Pro Display XDRs.
- Mac Pro with Apple Silicon, adding the PCI expansion to the Mac Pro case. All are based on M2 Ultra. With built in 7 afterburner cards, built in).
- All machines are order able today and will ship next week. And Completes the transition to Mac Silicon.
Software platform time… (Craig)
- iOS
- Updates to phone, FaceTime, and messages – Personalized Contact posters… so people who get your call get’s your screen you want to send.
- It’s like personalizing your Lock Screen.
- This is using CallKit
- Live Voicemail – should you answer or not, live transcription in real time to decide if you want to answer the phone.
- When you call soon on faceTime you can leave a message
- Messages –
- Better search filters to add people or terms to find data
- Jump up to the first message you haven’t seen
- Swipe to reply on inline
- Transcribed messages
- Inline location.
- Check-In to see that people made it home okay, with shared data – End to End encrypted.
- New Stickers
- Add effects
- Tap and rotate
- And they are system wide
- AirDrop updates
- Name drop on phone, watch, etc. to hand off contact information
- Bring devices close together – can share pictures, share play, etc.
- Keyboard and Dictation improvements.
- On device machine learning with AutoCorrect (improved) uses transformer Language model. (Notice they are using Transformer Language Model instead of Large Language Model).
- Adept Ullal – special moments (new feature)
- Journal (app) – coming late this year. There is a new Suggestions API to help in the Journal app, also usable for developers. On device processing, E2E encryption and ability to “lock” your journal.
- Standby – Clock, power of Widgets, pictures, and smartstacks..
- Now you can say Siri – instead Hey Siri,
- Offline maps
- Improved People albums, and pets – because they are people too
- Updates to phone, FaceTime, and messages – Personalized Contact posters… so people who get your call get’s your screen you want to send.
- iPadOS
- Final Cut and Logic Pro on iPad (just last month)
- Widgets on the Lock Screen, and jeu are now interactive!
- Love the Astronomy screen for iPad
- Live activities on Lock Screen too
- Health on iPad
- PDF improvements
- Auto recognize fields in PDF
- Signatures, and reply back in mail as a completed form
- Notes app will auto expand PDFs for viewing and annotations with Apple Pencil, Live Collaboration!
- Stage manager improvements. Positioning and sizing, use camera in monitor
- Final Cut and Logic Pro on iPad (just last month)
- macOS
- The Name is – Sonoma, yes it is about wine
- New screen savers
- Widgets – available somewhere new – i.e. on the desktop … widgets are faded or tinted based on what you are doing.
- Continuity will allow widget handoff from iPhone to Mac
- Gaming (macOS)
- Metal 3 – huge performance
- Game Mode – prioritizes CPU and Gpu on Game being played.
- Games Porting Toolkit – to see how to make conversion simpler for shaders and graphics code
- Death Stranding game coming to Mac later this year.
- Video conferencing enhancements – Presenter Overlay , reactions overlay
- Safari
- Webkit improvements
- Privacy improvements – locks browser windows, blocks all trackers, and removes trackers from URLs
- Sharing passkeys and passwords for your group. (E2E encrypted)
- Profiles, setup work, personal, etc. this can be tied to Focus Modes
- WebApps – created from a web page. Just add to Dock from file menu
- AirPods updates
- Adaptive Audio – combines Noise cancelling and Passthru – dynamically blending to match condition of the surroundings.
- Personalized volume to give best media experience in the moment
- Conversational awareness – start talking, turns down music and focuses on the voices in front of you
- Calls on the go, will leverage adaptive audio
- Improved automatic switching
- Airplay updates
- On device intelligence will learn what device you should share to
- Airplay support in Hotel- to share your airplay to wife and TV in the hotel.
- Apple Music / CarPlay – share play in the car.
- tvOS and apple TV
- New control center.
- User your iPhone to find the remote
- Photos to the TV easily
- FaceTime on the TV (uses continuity camera)
- FaceTime API and Continuity API for developers
- watchOS
- Comprehensive App redesign across the phone
- Turn crown for widgets using Smart Stack
- Widgets can hold complications
- World clock app was updated
- Active app redesigned
- Added Cycling
- Connect to bluetooth cycling computers
- In watch OS10, cycling becomes. Full display live activity on your phone.
- Added Hiking
- New waypoint tracking (when did you last have cell overage)
- Also added a topography map and elevation details
- Added Cycling
- Two new watch faces – Pallet and Snoop / Woodstock
- Health improvements on Apple Watch
- Mental Health reflecting on your state of mind to improve wellness – from Mindfulness map
- Can also do this on iPhone
- Current risk to depression or anxiety
- Vision health – Myopia
- 80-120 minutes a day outside in daylight (using ambient light sensor
- Screen distance – uses true depth camera to measure if the device is too close
- Mental Health reflecting on your state of mind to improve wellness – from Mindfulness map
- All info is encrypted on device and only unlockable with your lock code, passcode, etc.
- Back to Craig
- Lots of new APIs across all platforms, 175 sessions
- Back to Tim
- One more thing!!! Years in the making – AR is a profound technology
- Apple Vision Pro! – A new kind of computer
- Eyes hand and voice control
- Spacial Computing
- (Alan Dye)
- Home view looks like watch
- Environments transform the space for you
- This is the holo deck
- Subtle gestures
- “Eye Sight” – the pass thru of your eyes
- Always in sync with your devices – via iCloud
- Change focus by turning your head
- 3D Object – pull it out and look at any angle
- “You have the room to do it all!”
- Works with Magic Keyboard and track pad. Look at your Mac and bring it in view
- Remote collaboration and integration with FaceTime and Sir.. you can now put people around you. (Life sized)
- At home –
- Power of spacial computing, capture and experience photos and videos in new ways
- Panaroamics allow you feel like you are standing where you took them
- First 3d camera! Allows your capture 3d value
- Movie theatre experience with spacial audio.
- Game controller support, 100 Games available on day 1.
- Walt Disney on stage, this will allow us to bring fans closer to characters they love
- Partnering the greatest Story telling company in the world with the greatest technology company
- Disney+ will be available on day 1
- Richard Howarth to talk about the design
- 3d formed and laminated glass.
- Quiet thermal design, textile parts, fleshes to your face, confirms to your face. Don’t need AirPods, Band is changeable, and micro adjustments. Custom optical inserts.
- All day use when plugged in, 2 hour when on battery.
- Mike – Technology
- Advanced realtime sensor system, spacial audio, and incredible
- resolution
- 64 pixels in the space of 1 iPhone pixel. 23 million pixels (more than a 4k TV for each eye)
- 3 element lens… true 4k and UHD range.
- Audio –
- Integrated audio pods allows for ambient sound and matches it to your room (using audio ray tracing)
- Eye tracking
- You don’t need hand controllers.
- Foundation is Apple Silicon, it’s a M2 plus a new chip called R1
- Virtually eliminates drag, 12 ms – 8 times faster than the blink of an eye
- FaceTime creates an authentic representation of you, you enroll you face to create a digital person.and matches you as a persona
- VisonOS – designed from ground up for facial computing.
- Susan Prescott – Developers
- Reimage existing apps and design new ones
- A few developers played with it
- The Heartbeat to give a new education view
- SigSpace –
- Stagent from PTC
- SkyGuide – this looks way cool!
- RealityComposer Pro
- Same frameworks from iPad and iOS are available – so available at launch
- Unity will be Brough to VisionOS
- All to be covered in the State of the Union
- Mike –
- Privacy and Security
- Optic ID, encrypted, never leaves the device, etc.
- Where you look is not communicated to apps, only where you touch with your hand
- Camera data is at the operating system only
- Filed over 5,000 patents during it’s development
- $3,499 starting next year.
- Privacy and Security