Iger discussed a partnership between the companies during the reveal of Apple’s new $3,499 headset that’s expected to be available in 2024. The portion included a teaser video from the lens of a headset-wearer and the announcement that the device will offer the Disney Plus streaming service from the start.
“We’re constantly in search of new ways to entertain, inform and inspire our fans by combining extraordinary creativity with groundbreaking technology to create truly remarkable experiences,” Iger said. “And we believe Apple Vision Pro is a revolutionary platform that can make our vision a reality.”
Watch this: Apple, Disney Partner on Vision Pro Entertainment
03:59
The video (seen here around the 1 hour, 43 minute mark), teases watching The Mandalorian from another planet and a Mickey Mouse cartoon hopping around a living room.
“We’re so proud to yet again be partnering the greatest storytelling company in the world with the most innovative technology company in the world to bring you real-life magic,” Iger said.
Apple and Disney have a good, long-standing relationship. Iger and former Apple CEO Steve Jobs were close friends, and Iger has said he believes if Jobs were still alive, the two companies would have merged.
I was in a movie theater last December watching Avatar: The Way of Water in 3D and I said to myself: “Wow, this is an immersive film I’d love to watch in next-gen VR.” That’s exactly what I just experienced in Apple’s Vision Pro headset, and yeah, it’s amazing.
I just tried out Vision Pro in a series of carefully-picked WWDC demos at WWDC at Apple’s Cupertino headquarters. I’ve been using cutting-edge VR devices for years and I found all sorts of augmented reality memories bubbling up in my brain. Apple’s compact – but still not small – headset reminds me of an Apple-designed Meta Quest Pro. The fit of the back strap was comfy yet stretchy, with a dial to adjust the rear fit and a top strap for the top of my head.
Watch this: First Impressions of Apple’s Vision Pro Mixed Reality Headset
04:21
I couldn’t wear my glasses during the demo. Apple’s headset does not support glasses, instead relying on Zeiss custom inserts to correct wearers’ vision. Apple did manage to easily find lenses that fit my vision well enough so that everything seemed crystal-clear, which is not an easy task. Also, we adjusted the fit and tuned spatial audio for my head, a process that will be finessed when the headset releases in 2024.
From there, I did my demos seated, mostly, and found myself surprised from the start. The passthrough video camera quality of this headset is good. Really, really good. Not as good as my own vision, but good enough that I could see the room well, see people in it with me, see my watch notifications easily on my wrist. The only headset that’s done this is the Varjo XR-3, and Apple’s display and cameras may rival that one.
Apple’s floating grid of apps appears when I press the top digital crown, which auto-centers the home screen to wherever I am looking. I set up eye tracking, which worked like many other VR headsets I’ve used: I looked at glowing dots as musical notes played, and a successful chime when it all worked.
A list of apps as they would appear inside of the Apple Vision Pro headset.
Apple
From there, the interface was surprisingly fluid. Looking at icons or interface options slightly enlarges them, or changes their boldness. Tapping with my fingers while looking at something opens an app up.
I’ve used tons of hand tracking technology on headsets like the Hololens 2 and Meta Quest 2 and Pro, and usually there’s a lot of hand motion. Here, I could be really lazy. I pinched to open icons even as my hand was resting in my lap, and it worked.
Scrolling involves pinching and pulling with my fingers, again pretty easy to do. I resized windows by moving my hand to throw a window across the room or pin it closer to me. I opened multiple apps at once, including Safari, Messages, and Photos. It was easy enough to scroll around, although sometimes my eye tracking needed a bit of extra concentration to pull off.
I don’t know how the Vision Pro will work with keyboards and trackpads, since I didn’t get to demo the headset that way. But it works with Apple’s Magic Keyboard and Magic Trackpad, and Macs. But, not iPhone and iPad or Watch touchscreens…not now, at least.
Dialing in reality
I scrolled through some photos in Apple’s preset photo album, plus a few 3D photos and video clips shot with the Vision Pro’s 3D camera. All the images looked really crisp, and a panoramic photo that spread around me looked almost like it was a window on a landscape that extended just beyond the room I was in.
Apple has volumetric 3D landscapes on the Vision Pro that are immersive backgrounds like 3D wallpaper, but looking at one really shows off how nice that Micro OLED display looks. A lake looked like it was rolling up to a rocky shore that ended right where the real coffee table in front of me was.
Apple/Screenshot by James Martin/CNET
Raising my hands to my face, I saw how the headset separates my hands out from VR, a trick that’s already in ARKit. It’s a little rough around the edges but good enough. Similarly, there’s a wild new trick where anyone else in the room can ghost into view if you look at them, a fuzzy halo with their real passthrough video image slowly materializing. It’s meant to help create meaningful contact with people while wearing the headset. I also wondered how you could turn that off or tune it to be less present, but it’s a very new idea in mixed reality.
Apple’s digital crown, a small dial borrowed from the Apple Watch, handles reality blend. I could turn the dial to slowly extend the 3D panorama until it surrounded me everywhere, or dial it back so it just emerged a little bit like a 3D window.
Cinematic fidelity that wowed me
The cinema demo was what really shocked me, though. I played a 3D clip of Avatar: The Way of Water in-headset, on a screen in various viewing modes including a cinema. Apple’s mixed reality passthrough can also dim the rest of the world down a bit, in a way like the Magic Leap 2 does with its AR. But the scenes of Way of Water sent little chills through me. It was vivid. This felt like a movie experience. I don’t feel that way in other VR headsets.
Avatar: The Way of Water looked great in Vision Pro.
20th Century Studios
Apple also demonstrated its Immersive Video format that’s coming as an extension to Apple TV Plus. It’s a 180-degree video format, similar to what I’ve seen before in concept, but with really strong resolution and video quality. A splash demo reel of Alisha Keys singing, Apple Sports events, documentary footage, and more reeled off in front of me, a teaser of what’s to come. 180-degree video is never quite as crisp to me as big-screen film content, but the sports clips I saw made me wonder how good virtual Jets games could be in the future. Things have come a long way.
Would I pay $3,499 for a head-worn cinema? No, but it’s clearly one of this device’s greatest unique strengths. The resolution and brightness of the display was surprising.
Convincing avatars (I mean personas)
Apple’s Personas are 3D-scanned avatars generated by using the Vision Pro to scan your face, making a version of yourself that shows up in FaceTime chats if you want, or also on the outside of the Vision Pro’s curved OLED display to show whether you’re “present” or in an app. I didn’t see how that outer display worked, but I had a FaceTime with someone in their Persona form, and it was good. Again, it looked surprisingly good.
I’ve seen Meta’s ultra-realistic Codec Avatars, which aim for realistic representations of people in VR. Those are stunning, and I’ve also seen Meta’s phone-scanned step-down version in an early form last year, where a talking head spoke to me in VR. Apple’s Persona looked better than Meta’s phone-scanned avatar, although a bit fuzzy around the edges, like a dream. The woman whose Persona was scanned appeared in her own window, not in a full-screen form.
And I wondered how expressive the emotions are with the Vision Pro’s scanning cameras. The Pro has an ability to scan jaw movement similar to the Quest Pro, and the Persona I chatted with was friendly and smiling. How would it look for someone I know, like my mom? Here, it was good enough that I forgot it was a scan.
We demoed a bit of Apple’s Freeform app, where a collaboration window opened up while my Persona friend chatted in another window. 3D objects popped up in the Freeform app, a full home scan. It looked realistic enough.
Dinosaurs in my world
The final demo was an app experience called Encounter Dinosaurs, which reminded me of early VR app demos I had way back: an experience emphasizing just the immersive wow factor of dinosaurs appearing in a 3D window that seemed to open up in the back wall of my demo room. Creatures that looked like carnotauruses slowly walked through the window and into my space.
All my demos were seated except for this one, where I stood up and walked around a bit. This sounds like it wouldn’t be an impressive demo, but again, the quality of the visuals and how they looked in relation to the room’s passthrough video capture was what made it feel so great. As the dinosaur snapped at my hand, it felt pretty real. And so did a butterfly that danced through the room and tried to land on my extended finger.
I smiled. But even more so, I was impressed when I took off the headset. My own everyday vision wasn’t that much sharper than what Apple’s passthrough cameras provided. The gap between the two was closer than I would have expected, and it’s what makes Apple’s take on mixed reality in VR work so well.
But, the battery pack. There’s a corded battery that’s needed to power the headset, instead of a built-in battery like most others have. That meant I had to make sure to grab the battery pack as I started to move around, which is probably a reason why so many of Apple’s demos were seated.
What about fitness, and everything else?
Apple didn’t emphasize fitness much at all, a surprise to me. VR is already a great platform for fitness, although no one’s finessed headset design for fitness comfort. Maybe having that battery pack right now will limit movement in active games and experiences. Maybe Apple will announce more plans here later. The only taste I got of health and wellness was a one-minute micro meditation, which was similar to the one on the Apple Watch. Pretty, and again a great showcase of the display quality, but I want more.
2024 is still a while away, and Apple’s headset is priced way out of range for most people. And, I have no idea how much this current headset will feel functional doing everyday work. But Apple did show off a display, and an interface, that are far better than I was ready for. If Apple can build on that, and Vision Pro finds ways of expanding its mixed reality capabilities, then who knows what else is possible?
This was only my speedy reaction to a quick set of demos one day in Cupertino. There are a lot more questions to come.
Apple’s WWDC keynote address on Monday put a spotlight on video games with a new gaming mode and a special guest.
Game mode is a feature coming to MacOS 14 Sonoma, the latest operating system for the company’s desktops and MacBooks. The new mode prioritizes using CPU and GPU cycles while gaming and lowers controller and speaker latency by doubling the Bluetooth sampling rate. There will also be a new toolkit for developers allowing them to more easily port over their games to Mac.
Watch this: Apple Upgrades the Mac Pro with Silicon
Making a surprise appearance at Monday’s event was famed developer Hideo Kojima. He expressed his appreciation for Mac computers and revealed that his game Death Stranding: Director’s Cut will come to Macs later this year. Kojima also said his studio is working on future titles that will come to Apple’s platform.
WWDC is Apple’s annual event to show off its new software, including iOS, iPadOS and WatchOS. The company also shows off new hardware, which on Monday included a 15-inch MacBook Air.
Users of Apple’s Safari browser will soon be able to securely share their passwords and passkeys with each other.
At its WWDC 2023 keynote event, Apple said the feature being rolled out as part of MacOS 14 Sonoma will allow a group of users to add and edit passwords and passkeys, allowing everyone in the group to keep them up to date.
The feature uses iCloud Keychain and transfers are end-to-end encrypted, Apple said. That way if the data were to be intercepted by a cybercriminal, it would be scrambled and useless to them.
Apple also announced at the Monday event that it’s upgrading Safari’s private browsing feature to lock browsing windows when they’re not being used. Apple said the improvements will completely block known trackers from loading on pages and remove tracking from URLs that are being browsed.
Named after the famous Californian wine-making region, MacOS Sonoma offers a handful of key upgrades over MacOS 13 Ventura. Widgets are more customizable now and there’s a focus on gaming. Its new ‘Game mode’ prioritizes CPU and GPU usage for whatever game you’re playing to increase frame rates.
You’ll soon be able to use your iPhone’s Maps app offline with the release of iOS 17, Apple announced at its WWDC event Monday. This long-awaited feature has been available on Google Maps for years and will finally be available for iPhone users later this year.
The iPhone is getting offline maps for its Maps app this year. That means you’ll be able to access any map you’ve downloaded, even if you don’t have Wi-Fi or cellular signal. For instance, if you’re going on a trip, you can download the route and access it without using cellular data. This is helpful if you’re low on data or if your route takes you through an area with little to no signal that would cause the Maps app to stop navigating correctly, potentially causing you to veer off course.
What can you do with Apple Maps offline?
When iOS 17 becomes available later this year, you’ll be able to download designated areas and access turn-by-turn navigation while using Maps offline. Also, you’ll be able to see your estimated time of arrival and find places in Maps, among other things.
In addition, Maps will make it easier to find thousands of trails in parks across the US. The app will also support drivers of electric vehicles with real-time charging availability information, Apple said.
When will iPhone’s offline maps be available?
Offline maps will be available on iPhone with the launch of iOS 17, which is coming this fall (it usually arrives in late September with the new iPhone). You’ll want to make sure your iPhone is compatible with Apple’s latest software — if not, you won’t have access to this new Apple Maps feature.
Apple’s long-awaited Vision Pro headset will include a new authentication system specifically designed for the world of virtual reality.
Announced at Apple’s WWDC 2023 keynote event, Optic ID uses a person’s iris, which Apple says is always unique even when you’re talking about identical twins, to unlock the headset. Just like with Apple’s other biometric identification methods, like Face ID, Optic ID data is encrypted and never leaves the device.
The authentication system also is compatible with features like Apple Pay, app store purchases and password autofill, Apple said.
Meanwhile, Apple also said Monday that it engineered privacy and security into the mixed-reality headset by designing it to keep what a user is looking at private, noting that what a person chooses to look at has the potential to give away what they’re thinking about.
Apple said the data is isolated in a separate background process, so apps and websites can’t see what a user is looking at. It’s only when a user taps their fingers or enters a response on another Apple device that the data gets communicated and processed at the system level.
The Vision Pro is set to go on sale next year for $3,500.
Apple’s Messages is about to get an upgrade. With iOS 17, you’ll be able to turn pictures into stickers, transcribe voice memos, keep your friends and family notified on your way home and more.
News about the Messages update came Monday at Apple’s Worldwide Developers Conference, held at its Apple Park headquarters in Cupertino, California. Apple traditionally uses the annual event to unveil new devices, such as its mixed reality headset Apple Vision Pro, and give developers a preview of upcoming additions to its desktop and mobile software.
The update to Messages will be part of iOS 17 and include new sticker experiences, where people can take their photos and turn them into stickers they use in text conversations, alongside standard emojis, which can also be used as stickers. People can customize their stickers with effects, like shiny, puffy, comic and outline, and keep them in a new drawer in the keyboard for streamlined access, Apple said in a press release. Stickers will be available systemwide, including in third-party apps. Apple said iOS 17 will be shipped later this fall. Here’s which iPhones will be able to run the update.
To make a photo into a sticker, touch and hold an object in a photo. Then you can style your object with various effects, outline it or create animated Live Stickers with Live Photos. To use the sticker in Messages, add them in the bubble from the Tapback menu.
Watch this: Apple Reveals iOS 17
16:43
Search in Messages, Check In and more
Apple also debuted a refined search feature for what it called a more “powerful and precise” Messages search experience. People can apply additional filters to their Messages search to more quickly find the exact conversation they were looking for. Plus, when you’ve received lots of texts in a group chat, you can now use the catch-up arrow to locate where the conversation left off last.
iOS 17 Messages will also transcribe voice memos you receive, if you don’t have the time to listen to them. Apple additionally announced a new location sharing feature that lets you keep track of your friends by viewing their location in your text conversation.
Apple’s Check In feature through iOS 17.
Screenshot by CNET
Another location sharing feature Apple debuted is Check In. If you want to keep a friend or family member updated on your journey home, for example, you can use Check In, which notifies the person of your whereabouts and lets them know if you’re having trouble getting home. “If they are not making progress toward their destination, useful information will be temporarily shared with the selected contact, such as the device’s location, battery level, and cell service status,” Apple said in the press release. Check In will be end-to-end encrypted, so only you and the person you’re sharing this information with is privy to your location.
Developers can try out iOS 17 today, and everyone can try out the public beta in a month.
