I spent several hours trying Meta’s latest goggles, the Quest 3. The headset runs virtual reality games with a twist: while shooting a blaster gun, snatching bats from midair and controlling a robot, I could see the real world through built-in cameras.

This is what Meta — and Apple, which unveiled the $3,500 Vision Pro — call “mixed reality” or “spatial computing”, interchangeable terms to describe computers that blend digital data with the physical world.

These immersive computers, they said, could eventually become indispensable tools that change the way we live. Imagine reading a holographic recipe in the corner of your eye while cooking, for example, or staring at furniture parts with digital assembly instructions overlaid on them.

But for now, the devices are primarily used for playing games, and killer apps have yet to surface.

Meta’s $500 Quest 3 headset, arriving on October 10, has sharper graphics than its predecessor, the Quest 2. Its marquee new feature is a set of high-resolution, “pass-through” cameras for seeing the outside world in colour. They are a big improvement from the Quest 2’s weaker camera system.

After a two-hour session, I removed the goggles and asked Meta employees the $10 billion question (what the company invests annually in VR tech) about mixed reality: what’s the point?

Meta’s answer is vague. The ability to simultaneously interact with virtual and physical space, the company said, would make it easier for people to feel connected to one another. That could eventually be useful for collaborating on work tasks. What kind of work? Those apps are actively in development, a spokesperson said.

To market the Quest 3, Meta highlighted mixed-reality games. In First Encounters, a space game, I used a blaster gun to shoot a virtual wall, removing pieces of it brick by brick to see into the real world.

In Stranger Things VR, I took on the role of the show’s antagonist with telepathic powers. I could see virtual cracks embedded into the physical room; when I pointed at the cracks and spread my fingers outward to open them up, bats flew out of the chasms. I grabbed them to squish them dead.

In Bam! I could see other Quest 3 wearers in the room while we controlled miniature robots that battled each other inside a virtual arena. The game was fun, but seeing others flail around their motion controllers while donning the geeky goggles didn’t improve the game.

This reminded me of the LAN parties of the 1990s, when gamers carried bulky computers to one another’s homes to play together. It was a type of social gathering that feels antiquated now that Internet speeds are zippy enough to play games online from our own homes.

Some mixed-reality app developers offered more clarity about the tech’s benefits. Naer is a start-up working on a mixed-reality app for office goers to brainstorm ideas on virtual whiteboards and sticky notes. Developers there said being able to see into the real world while juggling virtual tasks would make it less jarring for professionals to wear headsets while working alongside colleagues in an office.

“When you’re fully closed off and somebody taps your shoulder, it’s very uncomfortable,” said Sondre Kvam of the Norway-based company. “But when you’re using mixed reality, you’re still a very much part of the real world — you’re no longer surprised.”

Peeking into the outside world might also make VR gaming more comfortable. Tommy Palm, the CEO of Resolution Games, said that in mixed reality, gamers would probably feel more confident playing games that involve fast movement.

In his game Blaston, where players shoot guns at each other in a virtual arena, people can crouch to avoid digital projectiles. Being able to see around you would help prevent collisions with objects in the room like furniture, he said.

Those examples sound convincing. But after spending a few hours with the Quest 3, my impression is that the outward-facing cameras won’t solve virtual reality’s most nagging problems with comfort, which will prevent it from becoming a mainstream hit.

Weighing about 1 pound, the headset felt heavy on my head after about 15 minutes, causing neck strain. The graphics were bright and intense on the eyes. Bending over, twisting around and swinging my arms eventually felt exhausting.

So the Quest 3 may be a fun toy to entertain house guests, but most gamers looking for a social experience will probably prefer the old-fashioned setup of sitting on their couch with a game controller.

NYTNS