Apple’s ‘mixed reality’ headset: What could the future look like through new VR glasses?
In a couple of weeks, at its annual Worldwide Developers Conference, Apple could be set to reveal one of its most important and risky products ever: a whole new way of seeing the world. The “mixed reality” headset is still a secret and a mystery. Though it has been strongly rumoured, it still might never arrive; it would certainly not be a surprise if it did not turn up at that WWDC event, though it would be something of a disappointment given how many whispers there have been. But whether it arrives now, later or never, Apple’s headset has been in the works for years. And clues to what it might look like – or what the world might look like through it – are already sprinkled through the company’s other products and apps. Rumours of how the headset will look have suggested it might be something like ski goggles, with cameras mounted on the outside and a precise screen on the inside, borrowing some of the design language of the Apple Watch; eventually, that is expected to morph into something less like a virtual reality headset, and more like glasses with a screen that will blend into normal life. We have a lot of clues about what the mixed reality experiences that Apple wants people to see through it will look like. That’s because Apple and its executives have frequently discussed the uses of augmented reality in public, even as the hardware has stayed a tightly protected secret. Apple’s work on a kind of headset is thought to have been ongoing since 2016, though what exactly that headset was rumoured to be has shifted over the years. The main rumours have coalesced since then into work on a “mixed reality” headset: something that would use cameras to show a picture of the real world inside a headset strapped to users face, and sensors and software to overlay virtual objects on that real world. In 2017, Tim Cook spoke to The Independentabout the importance of augmented reality. At that point, he was talking primarily about the iPhone and iPad, and how their cameras, sensors and screens could be used to layer virtual objects on top of the real world. It was clear even then that Apple really planned to include it in some sort of glasses or goggles, however. Asked at the time, Mr Cook pointed to “rumours and stuff about companies working on those” and declined to discuss Apple’s plans, but he said that the “technology itself doesn’t exist to do [devoted hardware] in a quality way”. “The display technology required, as well as putting enough stuff around your face – there’s huge challenges with that,” he said then. “The field of view, the quality of the display itself, it’s not there yet,” he added, saying that Apple doesn’t “give a rat’s about being first” and would not launch anything until it was satisfied. In the time since, Apple has seemingly been working very hard to get satisfied with that technology. It appears to be paying off: last week, virtual reality pioneer Palmer Luckey, who created Oculus and then sold it to Meta, suggested that he had seen an early version of the headset and that it was “so good”. Morsels of unclear and uncertain information like that are all we have to go on about the headset, which has not really been leaked in any definitive form even as rumours suggest it is just weeks from launch. But if the hardware is unknown, Apple’s plans are not so mysterious. That is because Apple may already have been quietly planning for the metaverse – or something like it, given that the company may be unlikely to adopt a term that has been soured both by the mixed reaction to “Web 3.0” and Facebook’s attempt to co-opt it by changing its name to Meta and re-orienting the company around it. Apple will probably avoid much of that branding, since it has quickly become attached to a kind of hype and boosterism that it tends not to associate itself with. It also usually likes to make up its own terms – and recent trademarks have included filings for “xrOS”, which may be the branding for the operating system that powers the headset. But those early experiments in the metaverse do already show some of the ways that Apple might be imagining us interacting with its new headset. The most obvious comparison is with the Oculus headsets that are now developed by Meta. Those have focused more on virtual reality than augmented reality; Meta has been interested in creating whole new digital worlds, rather than overlaying virtual objects on the real world, like Apple seems to be interested in. But the use cases may be the same, and Meta has focused on applications such as business meetings, where people can sit around a real table and discuss things, as well as VR games such as the hugely popular Beat Saber, where people try and strike objects with a sword in time to a beat. Apple has in recent years been more focused on the quality of interactions with devices, and has actually encouraged users to spend less time on their devices and more time being active. As such, it might not opt for mixed reality experiences that leave people cooped up inside the headset, and might instead be more outward-looking. As such, Apple might still focus on meetings, but would presumably use its augmented reality technology to add virtual people onto real rooms, rather than stuffing them in computer-designed spaces. And it might focus more on people’s interactions with the real environment by, for instance, allowing people to see their messages or directions as they move around, a version of which is already experienced by people who wear the Apple Watch. Apple has already offered a host of technologies aimed at making it easier for developers to include augmented reality in their iPhone and iPad apps. In 2017, when Cook made those tantalising comments about a possible headset, he was actually showing off uses of those frameworks: in the app Night Sky, for instance, which overlays virtual images of the constellations on top of real camera views of the stars. The company makes that technology possible with a range of systems, in both its hardware and software. That hardware includes the cameras, of course, but also the LiDAR sensor in some iPhones and iPads that allows for precise scanning of the environment; the software is most obvious in the form of ARKit, which does the heavy lifting of understanding the world around a user so that developers can just place their virtual objects into it. Since then, developers such as Ikea have used that to offer the option to drop virtual furniture into a real room to see how it might fit, for instance. Other apps such as 3D Scanner harness those sensors to allow people to easily create virtual views of those rooms as if they are in a video game. But the most telling way of guessing what Apple’s plans for the headset are can be found in its own technology. Apple has been quietly creating a whole world of apps that appear to be ready for mixed reality, hidden in plain view. One of them is Memoji, which are cartoon versions of people that can be used as stickers to react to messages or as profile pictures within messages. Apple has leaned on them heavily in recent years, using them as decorations in its presentations, for instance. At the moment, they are just a fun picture. But it’s very easy to imagine how they could instantly be used as avatars for people in virtual environments. If people are to participate in virtual meetings through their headsets, then other participants in that meeting will need to appear in some form, and current versions of those environments such as Meta’s Horizon Worlds rely on cartoonish drawings of people rather than realistic depictions. Apple already has those ready to go – many iPhone owners might already have created their virtual avatar, without even realising it. Aside from meetings, one of the most discussed use cases of mixed reality is in finding directions. A person might be walking up to junction, for instance, and see a virtual signal telling them to turn left overlaid on the real road that they need to start walking down. Apple has been putting the foundations of that kind of technology in place for years. It launched Apple Maps in 2012 and in the time since has been working to integrate it with the real world: collecting detailed 3D information about the world, for instance, so that it can show accurate and precise virtual models of real buildings, and a “Look Around” tool introduced in 2019 that works like Google Street View and lets people scroll around three dimensional panoramas. At the moment, those features are used to make people’s phone navigation look nice: as you drive into a city, for instance, the 3D models of buildings shift around, to make it feel like the virtual car on your phone is really driving along. But it takes very little imagination at all to see that the real purpose of those models may be to allow Apple to have a precise understanding of the real world, so that the headset will know where it is and help its wearer. Apple has also already been working on wearable products, which might themselves offer an insight into how the headset will work. The Apple Watch and AirPods already work by attaching themselves to people’s bodies and adding a layer of digital information – which, in a way, is exactly what the headset will aim to do. The AirPods, for instance, have found a way to lightly add information on top of the real world: using Siri to read out messages as they arrive, and adding transparency modes that allow the noises of the real world in as well as the sound coming through the earphones. And the Watch may be a glimpse at how Apple will encourage people to strap a computer to their body in a way that might look alarmingly sci-fi but has become accepted as relatively normal. Apple encouraged the Watch to become an acceptable accoutrement by focusing on personalisation, and designing in a way that brought in a sense of softness that did not make the hardware seem too much like a computer – it will probably do much the same with the headset. Apple’s new products are often described as if they have been magicked up from nowhere. But in truth all of its recent innovations have had their roots in previous products: the iPhone combined an iPod and a computer, and both the iPad and Apple Watch were bigger and smaller versions of that iPhone. The same thing appears to have been happening with Apple’s headset, which might look a lot more familiar than we are expecting. When the company takes to the stage to reveal its new products in a couple of weeks, we might realise that the product Apple wants us to strap to our faces has been developed right under our noses. Read More The 20 technologies that defined the first 20 years of the 21st Century Apple Watch 7 pre-order: How to buy the new smartwatch in the UK Apple introduces new version of Watch with complete redesign iPhone 13 - live: UK contract deals and prices for Apple, EE and O2
2023-05-23 02:20
Roberto Firmino FIFA 23: How to Complete the End of an Era SBC
Roberto Firmino FIFA 23 End of an Era SBC is now live. Here's how to complete the SBC during Ultimate Team of the Season.
2023-06-10 01:16
Disney 'investigating' footage that shows employees 'twerking' while dressed as characters
Disney is reportedly investigating footage that appears to show staff twerking while dressed in their family-friendly character uniform. In a viral video shared to a TikTok account called 'Illegal Disney,' the famed dog Pluto was spotted provocatively dancing to the popular audio that sings: "Here comes the hurricane b****". Another clip shows behind-the-scenes footage of the character heads in the dressing room. "Warning! Will ruin Disney magic. Disney backstage," the caption read. It has since been reported that Disney seniors are fuming about the clips. A source told The Sun that while it "looks silly," it is "absolutely paramount" to protect the integrity of the characters. "They’ve asked top investigators to shut down the feed and try to identify those responsible, who are in breach of their employment contracts," they continued. "They’re one of the most protective companies in the world because they know their biggest customers are young children who don’t want the illusion shattered. "Some of the clips show the characters dancing and twerking in their outfits — it’s just not on-message." @illegal.disney #disneyillegal #disney #fyp #viral It comes after a NSFW X/Twitter account posing as Disney Junior was verified earlier this year, sparking outrage on the platform. Elon Musk's blue tick subscription model meant anyone could gain verification if they paid per month. The owner of the profile was seemingly stunned by their newfound tick status. "No f**king way," they tweeted under the username @DisneyJuniorUK after spotting the gold badge – proof enough that this wasn't an account for kids. Indy100 reached out to Disney for comment. Sign up for our free Indy100 weekly newsletter Have your say in our news democracy. Click the upvote icon at the top of the page to help raise this article through the indy100 rankings.
2023-09-04 22:58
Spotify clarifies position on whether it will ban AI-powered music
The boss of Spotify has said he would not completely ban content generated by artificial intelligence from the music streaming service. Daniel Ek told the BBC he thought there were legitimate use cases for the technology in music, but that it should not be used to impersonate real artists without their consent. He said there were three “buckets” of AI use in music: tools such as auto-tune, which he said was acceptable; software which impersonated artists, which was not; and a more controversial middle ground where AI-generated music was inspired by a specific artist but did not directly mimic them. But he said the issue would likely be debated for “many, many years”. “You can imagine someone uploading a song, claiming to be Madonna, even if they’re not. We’ve seen pretty much everything in the history of Spotify at this point with people trying to game our system,” he said. “We have a very large team that is working on exactly these types of issues.” Spotify does not allow content from its platform to be used to train AI models. Last month, Irish singer Hozier said he would consider striking over the threat of AI to the music industry, and a number of other artists have spoken out about their concerns about the use of technology in creating music. Regulators worldwide are stepping up their scrutiny of AI, given its explosion into general use worldwide and fears over its impact on jobs, industry, copyright, the education sector and privacy – among many other areas. We've seen pretty much everything in the history of Spotify at this point with people trying to game our system Daniel Ek, Spotify The UK will host a safety summit on the potential opportunities and threats posed by AI in November. Read More Spotify makes AI voice clones of podcasters and uses them to speak other languages Spotify CEO Daniel Ek denies existence of alleged artist streaming scheme Streaming service Deezer signs Universal Music royalty deal to prioritise musicians over AI
2023-09-26 22:19
Amazon Loses Key Backer Four Years Into Plan to Eliminate Carbon Emissions
Four years into a plan to eliminate its carbon emissions, Amazon.com Inc. has lost a key endorsement from
2023-08-14 22:55
Elon Musk claims he is driving to Zuckerberg’s home so ‘fight’ breaks outs
Elon Musk says he will drive a Tesla to Mark Zuckerberg’s home in the hope that their on-again-off-again mixed martial arts fight will break out. Mr Musk took to X, the site formerly known as Twitter, to detail his latest plans to try and fight with the Facebook founder after Mr Zuckerberg cancelled it saying that his rival was not serious about the bout. “Knock, knock … challenge accepted … open the door @finkd,” tweeted Mr Musk on Monday. And he added: “For the Tesla FSD test drive in Palo Alto tonight, I will ask the car to drive to @finkd’s house. “Will also test latest X livestream video, so you can monitor our adventure in real-time! If we get lucky and Zuck...actually answers the door, the fight is on!” And in a follow-up post, he took more shots at his tech rival for ditching the contest. “(Zuck thread coming soon about how he would of course love to fight anytime, but blah blah UFC something something)” he wrote. Mr Zuckerberg announced that he was backing out of the fight on Sunday night because Mr Musk would not agree to a format and kept changing details for the bout. “I think we can all agree Elon isn’t serious and it’s time to move on,” Mr Zuckerberg wrote. “I offered a real date. Dana White offered to make this a legit competition for charity. Elon won’t confirm a date, then says he needs surgery, and now asks to do a practice round in my backyard instead. “If Elon ever gets serious about a real date and official event, he knows how to reach me. Otherwise, time to move on. I’m going to focus on competing with people who take the sport seriously.” Read More X: Elon Musk removes last parts of Twitter branding from website Mark Zuckerberg hits out at Elon Musk for wasting time over cage fight: ‘It’s time to move on’ Mark Zuckerberg plays down Elon Musk’s cage fight details ‘Gladiator’: Elon Musk reveals more details of fight with Mark Zuckerberg Musk vs Zuckerberg: UFC president meets Italy’s culture minister to discuss fight at Colosseum The last parts of Twitter are being removed Mark Zuckerberg hits out at Elon Musk for wasting time over cage fight Elon Musk reveals more dramatic details of fight against Mark Zuckerberg
2023-08-15 05:28
The Kindle (2022) is on sale for its lowest-ever price for Prime Day
TL;DR: The Kindle (2022) is on sale for $64.99 this Prime Day. This deal is
2023-07-11 17:56
Snag the Apple Watch Ultra at its lowest price ever
SAVE $100: As of August 22, you can get an Apple Watch Ultra on sale
2023-08-23 01:55
Critical Nursing Shortage Drives 117% Customer Spike for UbiSim Immersive Virtual Reality Simulation Training Platform
BOSTON & MONTREAL--(BUSINESS WIRE)--Sep 12, 2023--
2023-09-12 20:49
How to Update Google Chrome
Google Chrome has been praised for its clean interface and strong security features. And while
2023-08-17 02:59
Don't miss this week: Jack Harlow on screen, Kesha, Anna Nicole Smith doc and Scott brothers on HGTV
This week’s new entertainment releases include albums from Kesha and Dave Matthews Band, while rapper Jack Harlow stars in a remake of “White Men Can’t Jump” and wilderness expert Bear Grylls tests contestants on their survival skills, physicality and gross-out tolerance with "I Survived Bear Grylls.”
2023-05-15 23:16
Eyas™ Medical Imaging Brings State-of-the-Art MRI to NICUs, Revolutionizing Access for Fragile Newborns
CINCINNATI--(BUSINESS WIRE)--Jul 12, 2023--
2023-07-12 20:24
You Might Like...
Can You Pre-load Warhammer 40,000: Darktide?
Google added a few nifty features to Password Manager
Hands On: Microsoft Surface Laptop Studio 2 Gains AI Chip, Aluminum Body
The Hackett Value Matrix Quantifies the Value Realized From Purchase-to-Pay (P2P) Software Solutions Providers
Chandrayaan-3: India's lunar lander Vikram searches for safe Moon landing spot
GoTo Appoints New Chief People Officer and Chief Information Security Officer
Elon Musk reverses plan to get rid of 'light mode' on X
Internet slams Melissa Gorga as 'RHONJ' star promotes casino app in new video: 'Why are you promoting gambling?'
