• Hey Guest. Check out your NeoGAF Wrapped 2025 results here!

These AI Generated Interactive Environments Are Incredible

This is generated by Google's stupidity named AI model, it'll likely be able to generate fully playable games in the coming years.


"Why settle for 6x frame generation when you could have 100% frame generation?!"
Sipping Tea Time GIF
 
Last edited:
No, it won't.
It basically already can. In the discontinued demo, you could play at single-digit frames per second - but it was Quake 2, running without a game engine, entirely AI generated.

However, there's actually not much benefit to this type of experience. Where it becomes interesting is prompt frames rendered neurally. Instead of producing the entire game at once, you have a standard game engine running in locom that produces frames that then serve as input for AI rendering. These prompt frames appear primitive if viewed visually, as they only include basic information, like coloured surfaces to indicate what behaviour the AI needs to employ when rendering that surface, as well as motion information. The AI then renders out the final image, storing its output to speed up rendering the next frame, and so on.
This technique is being experimented with in various ways, but we'll likely see some version of this next generation if the consoles ship with dedicate NPUs. The most likely implementation will be AI generated portions of the final frame blended with traditionally rasterized sections. Sky rendering or grass rendering being incorporated in real time would be my first thoughts, but we'll likely also see it used to smooth out facial rendering.
 
Google already made huge steps forward by having a world that remembers your actions and stays coherent.



Probably this year they'll stop all hallucinations and also have much more flexibility. Their Titan architecture for going beyond LLMs will surely improve this rapidly.

It is absolutely the future. As much as neogaf will groan, It's just inevitable.

It doesn't have to be entirely a game on the shoulders of the AI, devs could make a very concept looking game with very basic assets but implement the game mechanics they want an the AI will paint the coat over it. You could change the style of visuals you want and so on.

It bypasses multiple generations, of how much processing power we would have been developing in the traditional rendering pipeline to achieve photorealistic graphics with life-like world physic simulations. AI doesn't need RT blocks for path tracing, it knows what its supposed to look like, and it can be fully dynamic. It knows how water is supposed to react. etc. You would not need a 7090 with 96 GB of VRAM and a 15590X3D, inference for these rendering in a few years will almost be in the palm of your hand, mostly with LPUs and SRAM where inference for a "game ecosystem/engine" will be highly optimized for that.

But also I believe we're a decade from now, we'll be asking AI to generate a game genre we want with parameters and it'll make on the fly a coherent and even competent game that will challenge even humans who spent years on it. Want naked Lara Croft in the game? No need for mods, just ask the AI agent.
 
Ain't that a bitch. Looking like a Robotic DeBarge, trying his mechanical hand at the culinary arts.

Procedural gen = fixed rules/math at load time, world never changes

AI here = neural net predicts every frame live as you pan camera, world gets invented in real-time from one pic

Not really the same is it?
I would want something for say Path of Exile 3 or Diablo 5(lol) Imagine areas that are either never the same or repeat so rarely, you'd be done with the game before seeing the same dungeon layout a second time. By done, I mean, you have 4 characters maxed out, doing end game grinds on the daily and finally just gave it up because you saw all there was to see, even if DLC is coming. Been there done that. :messenger_grinning_squinting:
 
Last edited:
Can someone please post the "AI made a gameplay footage video, it looks incredible" tweet?

Edit: Found it

 
Last edited:
This doesnt appear to be in Realtime?

It seems like he is giving it commands and waiting with significant levels of lag for a response. Like controlling the Mars Rover.
Hardly Interactive. Its not like there gonna give every gamer access to there own power plant or server farm just for themselves.
Seems like BS.
 
Stuff that looks beautiful takes a lot of efforts and tries to make
And average result is just shitty quality slop with tons, TONS of artifacts
So for now I really doubt it'll be "a fully interactive [not premade under heavy supervision]"
 
This doesnt appear to be in Realtime?

It seems like he is giving it commands and waiting with significant levels of lag for a response. Like controlling the Mars Rover.
Hardly Interactive. Its not like there gonna give every gamer access to there own power plant or server farm just for themselves.
Seems like BS.
It has to be real-time in certain situations the walking through the puddles and moving through the plants.
 
It is impressive tech, but I think fully AI playable games is still a long way off. What it's doing now looks more like stitching patterns together than actually understanding game logic, balance, or design. Useful as a tool for prototyping or assets, sure, but replacing real developers anytime soon feels very optimistic.:messenger_neutral:
 
Anyone that doesn't think that's impressive is making a fool out of themselves.

For something in it's infancy it's incredibly impressive and very realistic.

I don't understand some people's hatred for ai. Its as if them hating it and calling everything "AI slop" will make it the truth.

The genie isn't going back in the bottle so you might as well embrace it.
 
Last edited:
People are so ridiculous about this.

Developers aren't going to become obsolete. But this kind of tech is genuinely mind-blowing, and in the hands of talented devs, it can make more authentic, more interactive, and more varied environments - for cheap.

It's not a threat to the industry. It's a potential renaissance.
 
People are so ridiculous about this.

Developers aren't going to become obsolete. But this kind of tech is genuinely mind-blowing, and in the hands of talented devs, it can make more authentic, more interactive, and more varied environments - for cheap.

It's not a threat to the industry. It's a potential renaissance.
Yeah I'm hopeful too.

And AI could help out with character designs to get out of the ugliness era. This is made with usually very restricted Copilot when asking for a Lara Croft-like character.
O89ToZK.jpeg


Don't know how to post mp4 videos here but Grok animating this is… well… not bad!
 
My brother did a little test and made snake and pac man playable on the phone through ChatGPT without writing a single line of code.

Have fun playing snake then. What LLM program did there for you was copy / paste an existing code that it was trained on. Probably from some GitHub repository.
 
Anyone that doesn't think that's impressive is making a fool out of themselves.

For something in it's infancy it's incredibly impressive and very realistic.

I disagree. I find it geniunely unimpressive.

I see a bunch of blurry footage with insane smearing and no coherency. Even the tech behind it; It's just generating a terrible looking "playable" video. Not even the future implications sounds exciting to me as of now.

I don't understand some people's hatred for ai. Its as if them hating it and calling everything "AI slop" will make it the truth.

The genie isn't going back in the bottle so you might as well embrace it.

I feel like most hatred is coming from those who cannot cope with the fact that they're completely obsessed with something that doesn't look good in any shape or form to the majority of people.

Will it get better? Sure. And are there people hating for the sake of? Hell yeah. But it doesn't help that every time I see one of these threads it starts with "Holy shit guys this is the most amazing thing I've ever seen, better get ready to lose your jobs" before clicking on a video that looks like someone gave editing software to someone coming down from a week of binging cocaine
 


Part with the cars looks neat (timestamped it). What I think is more interesting is the fact that it's really just a video that is fully 3D and interactive. That's kind of cool to think about. Took a vacation at the beach, got some great video? Now you get to walk around in 3D and grab all the titties.
 
Interesting video. If current LLMs are at a 3DFX Voodoo 1 stage and the trajectory will go towards RTX 5090, then yeah LLMs are going to overtake everything.

But it is still unclear if it will scale effectively like that, considering HW and electricity requirements.

The video in OP algoed me towards this one, which is pretty fun. Generating 3D models so easily from 2D pictures, also generated...it is ridiculous. 100% of developers are going to be using this within the next two years.


Honestly, this would be an incredible way to make remasters which are basically the exact same game with updated sprites to look realistic with an A.I. filtering them. This could work amazingly well for games like the old 2D Mortal Kombat games, without the need to find new actors to photo-frame. Just use an A.I. to reproduce every single sprite and background and you are good to go. A classic game with a completely modern 4K sprite coat of paint.
 
That's why AI is used for this in the first place, no?

I'm guessing that's why most people seem to love AI generated art; all of a sudden they feel like an artist.

However, it's extremely evident they don't have any artistic background considering how wonky it looks 99% of the time.

I'm not even sure if an actual artist would be able to make use of AI generated art. As in it may not be as simple as making some minor edits, to make it look good, and may be easier to start from scratch.
 
Last edited:
Have fun playing snake then. What LLM program did there for you was copy / paste an existing code that it was trained on. Probably from some GitHub repository.
Nah that's not how it works, you can build whatever you want, change every detail, when you know how to use it. You aren't just telling the AI to go steal someone's game code for snake. Although I have no idea if that could also be done, or steal the SM64 source code, or whatever leaked from Ubisoft or any other thing out on the net.
 
Last edited:
Nah that's not how it works, you can build whatever you want, change every detail, when you know how to use it. You aren't just telling the AI to go steal someone's game code for snake. Although I have no idea if that could also be done, or steal the SM64 source code, or whatever leaked from Ubisoft or any other thing out on the net.

And as soon as you start requesting changes, it becomes more and more broken with each request. LLMs are amazing for short code snippets or troubleshooting. It is basically the Stack Overflow of the modern day.
 
Anyone that doesn't think that's impressive is making a fool out of themselves.

For something in it's infancy it's incredibly impressive and very realistic.

I don't understand some people's hatred for ai. Its as if them hating it and calling everything "AI slop" will make it the truth.

The genie isn't going back in the bottle so you might as well embrace it.
Current AI models are not in their infancy, they're in their inflection point. We're already at the stage where in order to improve you need to increase computational power and datasets beyond whats realistically feasible, and where they need to add crutches to the models as stopgap solutions to the LLMs most critical limitations.

I do think AI will have its uses going forward, but the stuff in the OP aint what that'll be.
 
And as soon as you start requesting changes, it becomes more and more broken with each request. LLMs are amazing for short code snippets or troubleshooting. It is basically the Stack Overflow of the modern day.
Seems to work great from what I can tell.

But for me personally there is a learning curve on coding with AI. I'm working on a Unity game and shoehorning AI into that mid project seems risky. I'm nervous just updating Unity. Seen stuff brake many times and giving AI full control of all files would be scary. But if it's set up correctly and if you can just explain what's not working and let it iterate all of it until it works as intended would be special. Some day I'll try it.
 
Last edited:
Top Bottom