Support NeoGAF

[ReasonBeing]

I posted this earlier but uploaded the videos from the wrong youtube account. Welcome to our dystopian future, at least it looks good. Scanned using my Quest 3 headset. EDIT: Youtube is really screwing up the quality of the video. In reality, the environment is slightly sharper than what you would see if you were walking around using the Quest 3's passthrough cameras. In other words, it looks legit real.

If you aren't aware what a Hyperscape environment is, it is a data point cloud that is created from the processing of videos, photo's, and sometimes depth sensor data. I walked around my kitchen for about 10 minutes and Meta was able to stitch all the data together to create this fully photo realistic rendering of my kitchen. To be clear, what you are seeing, when I turn it on, is not really there.

Yeah, I already know about my data being in the hands of greedy corporations... what's new. The fact of the matter is they can recreate 3D volumetric environments from photos and videos already on the internet, so unless you want to never post a video or pic from within your house, it could potentially be used to create something like this.

 

[AJUMP23]

So is this replacing the other thread? I am confused.

 

[thefool]

What does/can it do if you film another person?

 

[Kilau]

So is this replacing the other thread? I am confused.

This is a scan of the other thread.

 

[PSYGN]

Cool video (again lol), I can see this for real estate, but also imagine vr haunted house/zombie type game.

 

[ReasonBeing]

So is this replacing the other thread? I am confused.

Yeah, earlier i deleted the links i posted when I realized it was from an account that had a bunch of my personal info on it. I requested post deletion, but in the meantime I realized I could upload videos from a burner youtube account I had. I didn't anticipate it taking a few hours before the other thread would be deleted.

 

[ReasonBeing]

What does/can it do if you film another person?

If they stand really still, it captures them and blurs their face (at least in my testing, my wife never shuts up so that could have been the cause of the blur). The rest of them is incredibly detailed and realistic. If they are moving around, you get ghost like artifacts.

 

[ReasonBeing]

 

[jason10mm]

Is it possible to bolt VR glasses to my wif...errr, a womans head and put her PERMANENTLY into this "Clean universe"?

Asking for a friend

 

[ReasonBeing]

Is it possible to bolt VR glasses to my wif...errr, a womans head and put her PERMANENTLY into this "Clean universe"?

Asking for a friend

Tell "your friend" that feature should be available on future hardware. It is possible on the Quest 3, you just need a lot of duck tape.

 

[Trilobit]

Insanely cool. How does it even work? Looks like magic.

Thanks, I missed the video of your deep soothing breaths. Mmm...

 

[ReasonBeing]

Insanely cool. How does it even work? Looks like magic.


Thanks, I missed the video of your deep soothing breaths. Mmm...

It uses advanced image stitching and depth processing to build the "textures". If I understand the tech correctly, it builds a cloud of points and depending on which point in space you are located (within the recreated scene) and what points are within your fov, it knows which textures to display and which are occluded. As I mentioned, they could build this from static photos at different angles, but as expected, the more info it has, the better scene it can create.

What is really trippy is when you walk to a location within the scene, where it didn't have images from that particular pov. The illusion quickly breaks down and you are looking at a 3D volume of random nonsense. That's why I spent 10 minutes walking around my kitchen, ensuring that it had depth and image information from any pov that reasonably use when exploring the space.

You may have picked up on this already, but it may not be obvious due to how I'm showing it off; it reprojects the virtual environment everywhere. So I could be outside or in another room, pull up my kitchen and then explore the area.

 

[Trunx81]

Just to clarify, OP: What kind of software is needed for that? And is it processed inside the Quest 3 or do you need external hardware for that?
Could be a game changer for real estate.

 

[MrTroubleMaker]

That is cool!

 

[Stitch]

Just to clarify, OP: What kind of software is needed for that? And is it processed inside the Quest 3 or do you need external hardware for that?

This

Meta Horizon Hyperscape Capture (Beta) für Meta Quest | Quest VR-Games | Meta Store

We're gradually rolling out. Meta Horizon OS v81 is required to download. Hyperscape lets you capture your real-world space in just a few minutes, then creates an immersive, true-to-life digital replica that you can visit from anywhere.

www.meta.com

And you need to be on OS v81. The scans are sent to the meta cloud were it's processed for a few hours.

 

[AJUMP23]

WHy is it called hyperscape I would expect it to look cooler.

 

[Trilobit]

So basically if one walks around Sydney Sweeney and scans her you could just plop her into your apartment? Asking for a friend.

 

[Trunx81]

So basically if one walks around Sydney Sweeney and scans her you could just plop her into your apartment? Asking for a friend.

 

[p_xavier]

So basically if one walks around Sydney Sweeney and scans her you could just plop her into your apartment? Asking for a friend.

She already does that randomly.

 

[AJUMP23]

So basically if one walks around Sydney Sweeney and scans her you could just plop her into your apartment? Asking for a friend.

Are you saying this is a holodeck?

 

[Trunx81]

Are you saying this is a holodeck?

 

[ReasonBeing]

So basically if one walks around Sydney Sweeney and scans her you could just plop her into your apartment? Asking for a friend.

I've seen some demos of the tech used for adult purposes. It was pretty incredible, as you could place model in the room, just as one would expect AR adult software to work.

I'm normally pretty anti-corn (for my own wellbeing's sake) but in this case I went for the tech, and I ended up staying for the show.

Edit: 'Braindance' was the software. It was my first exposure to gaussian splatting. It's a free APK one could side load to the Quest headsets.

 

[ReasonBeing]

The very beginning stages of it, at least. I imagine it's not a leap to have AI generation of these data point clouds and textures for volumetric scenes.

 

[Trilobit]

I've seen some demos of the tech used for adult purposes. It was pretty incredible, as you could place model in the room, just as one would expect AR adult software to work.

I'm normally pretty anti-corn (for my own wellbeing's sake) but in this case I went for the tech, and I ended up staying for the show.

Edit: 'Braindance' was the software. It was my first exposure to gaussian splatting. It's a free APK one could side load to the Quest headsets.

Cool, hopefully there are non-corn usage too. I just want her to stare admiringly at me while I do my five pushups and eat a meal.

 

[ReasonBeing]

Cool, hopefully there are non-corn usage too. I just want her to stare admiringly at me while I do my five pushups and eat a meal.

You're such a tease

 

[Trunx81]

Cool, hopefully there are non-corn usage too. I just want her to stare admiringly at me while I do my five pushups and eat a meal.

and tell me she´s proud of me

 

[jason10mm]

With my luck there will be a "nagging wife" mod that forces me to take out the trash, bring up the laundry, feed the kids, and make school lunches while my actual wife sits in a chair that gives her a back rub by virtual Henry Cavill.

If the nagging wife is Sweeney in a bikini......damn some chores might just get done