-
Hey, guest user. Hope you're enjoying NeoGAF! Have you considered registering for an account? Come join us and add your take to the daily discourse.
Minecraft generated by AI
- Thread starter IbizaPocholo
- Start date
- Platform
Grildon Tundy
Member
To create this, did they go through the millions of hours of Minecraft footage and/or train it on the game itself? I went to their website to learn more, but it's got the hug-of-death right now.
Last edited:
Knightime_X
Member
AI used in this way has astronomical potential.
Imagine a game that starts out like Grand Theft Auto but with minecraft like tendencies.
Literally everything can be explored, destroyed \ created, fixed, and or randomized in real time.
But, gameplay can switch to call of duty, tekken 8, Gran turismo, final fantasy 7, or whatever was added and it all works effortlessly.
Or any combination at any given time.
A 2 billion dollar game that takes 20 years to make can now be created daily.
We are NOT READY for ai's real power.
With AI, don't look where it's at now, but there it's heading.
Imagine a game that starts out like Grand Theft Auto but with minecraft like tendencies.
Literally everything can be explored, destroyed \ created, fixed, and or randomized in real time.
But, gameplay can switch to call of duty, tekken 8, Gran turismo, final fantasy 7, or whatever was added and it all works effortlessly.
Or any combination at any given time.
A 2 billion dollar game that takes 20 years to make can now be created daily.
We are NOT READY for ai's real power.
With AI, don't look where it's at now, but there it's heading.
Last edited:
cyberheater
PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 Xbone PS4 PS4
And this is the worst completely generated A.I games will be. Every day they will get better. Game programmers days are number.
pasterpl
Member
It would take probably 20 years and more than 2bn USD to creat and train model like that
DownLikeBCPowder
Member
Pretty wild. The trailer makes it look very put together, but if you try it yourself you can quickly see the failings. Not that these won't be resolved in the future, but it makes for almost a psychedelic experience trying to play this right now. I walked around for a bit and it seemed fine, but then I tried to place a few blocks and it worked - but then you could see the AI mistake what should be where, suddenly many blocks of the same kind appeared far from me. Then when I turned around, everything on the ground that was cobblestone became this new texture of the block I had placed down. I walked further away and a minute or so later, started placing regular dirt on the block beneath me and jumping to make a tower of about 7 or 8 blocks - but before I finished, there was visual glitch and the whole thing was suddenly a stand stone structure much more complex (still simple) than what I was building, it's interesting how it fails to keep up with what should be where and generates random and interesting things out of nothing.
Knightime_X
Member
It's not going to be an overnight process.It would take probably 20 years and more than 2bn USD to creat and train model like that
Only took a short while to do something that was wildly impossible just a year before.
Once AI is able to train itself, its GGs.
We should revisit this post in a few years to see how well it aged.
pasterpl
Member
SI in gaming and development is such an interesting subject, so many possibilities. Watching this video we can assume that it create its own game engine to create this game, replicated all physics and destruction from training material etc. It is definitely something to watch as it develops. AGI and ASI looks like years away but I hope it is really possible.
GermanZepp
Member
Yes. I think in the future we will prompt games to the AI and we are gonna be able to play that. For example: teardown+gta+burnout paradise.
sachos
Member
2 years ago we barely were generating good AI images, now we are generating 20 images per second in a playable form that resemble a videogame.
I read people here and specially on Twitter talking about "it is just stealing from Minecraft" as if that was the true goal of this demo, researchers use Minecraft because it serves as a perfect test bed for their agentic/world model goals.
The true goal here is creating AI models good enough that they can have perfect world model representation, because if you can generate anything it means you understand everything.
I read people here and specially on Twitter talking about "it is just stealing from Minecraft" as if that was the true goal of this demo, researchers use Minecraft because it serves as a perfect test bed for their agentic/world model goals.
The true goal here is creating AI models good enough that they can have perfect world model representation, because if you can generate anything it means you understand everything.
Raven77
Member
You just don't get it at all.
It's not the fact that this game is supposed to be "impressive", it's the fact that it's running in real time, no engine, no code, etc...
The ramifications of this are what is meant to be, and very much is, impressive.
Right now you sound like a guy watching the first ever plane take flight and saying "It's flying pretty slow. Not impressed."
ReyBrujo
Member
It would take probably 20 years and more than 2bn USD to creat and train model like that
True, but suppose GTA6 is online, Rockstar would be able to train their model with the players' input for free. Not saying you would get a GTA7 completely AI generated but easily you could train NPCs based on the input of millions of players. For beta testing they could just place one or two NPCs with trained data in the map and see how they behave when with other players around.
pasterpl
Member
There are some serious data centres required if you want to train AI like you described, then it you want complex destruction physics for different materials and physics for impacts etc. It all need a lot of data and some serious processing power - datacentres - which at this scale are not cheap. So while some of the data will be free, the training itself wouldn’t be.
StueyDuck
Member
It's stitching together videoframes from many nodes while just learning Minecraft.
There isn't really any ramifications.
It's a clever way to steal Minecraft without stealing the source.
but it's not creating a game,
without Minecraft this wouldn't be anything, its literally flipping a game.
You sound like a guy who thinks Machine learning is some supreme intelligence, selling some snake oil.
No ones jobs are on the line because of this and no games are going to be made with this "tech", the amount of data and learning this will have to do with literally every game ever made would be staggering, it's not as simple as webscraping some text data.
Last edited:
kruis
Exposing the sinister cartel of retailers who allow companies to pay for advertising space.
You convinced me. There's no point in playing a game on a $500 PS5 anymore when you could have an AI cloud server with a $40,000 Nvidia AI chip generate every single image in real time each time you want to play a game. Big tech has invested billions of dollars in AI server farms ($90 billion just this year), but when it comes to AI they're suddenly not businesses but charities and they are going to make all that AI power available to the general public for almost free instead. ROI is so overrated!
Mattyp
Not the YouTuber
Last edited:
ResurrectedContrarian
Suffers with mild autism
It's exactly like the Holodeck from Star Trek... which I've always known to be the eventual future of gaming.
Instead of specific stacks of code for various games, you just have a supercomputer AI that is essentially a reality simulator. And it creates characters, rooms, stories, etc based on anything you'd like, rendering and building the world on the fly... which also means truly reactive characters and agendas everywhere.
Eventually, that will be the case. And "gaming" will be a radically different kind of thing.
Instead of specific stacks of code for various games, you just have a supercomputer AI that is essentially a reality simulator. And it creates characters, rooms, stories, etc based on anything you'd like, rendering and building the world on the fly... which also means truly reactive characters and agendas everywhere.
Eventually, that will be the case. And "gaming" will be a radically different kind of thing.
DownLikeBCPowder
Member
The goal of this isn't to "steal Minecraft". The goal is to display that it can create something akin to Minecraft in real time. This is significant, it seems to me.
Last edited:
Deerock71
Member
Guerilla Munch
Member
this is the tech that VR has been waiting for
the next decade is gonna get wild
the next decade is gonna get wild
Raven77
Member
Again, they are all stepping stones on the path. Innovations, and everything learned with this feed into other projects that build upon other ideas and learnings. This is how progress is made. It's how we broke out of 2D and into 3D games. Devs were "faking" 3D...
Doom was not just another 2D game that was faking being 3D. It was an important stepping stone.
Blank Space Invader
Gold Member
"Imagine a video game entirely generated by AI"
No thank you.
No thank you.
PSYGN
Member
Going to need a nuclear generator in my backyard
and a neighborhood committee to make sure everyone is maintaining their backyard nukes safely. We should be running the model not training it so we might be able to share a reactor for the block
cyberheater
PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 PS4 Xbone PS4 PS4
You don’t know what you’re talking about.
StueyDuck
Member
it literally doesn't work without minecraft existing.
all this talk sounds like the same "Web3" talk we got years ago.
ML is going to (and already does) help game development, but this tech is going to need an astronomical amount of data in order for you to say "Create GTA 6 but set in russia" and then you have a full massive 60 hour campaign, open world with physics simulations and ai and so on. The only applications i see of this is in something like real estate and warehouse planning where you can stitch together a virtual environment with photos.
and I'm sure you do
And this is why at some point in the future cloud gaming is probably gonna take over. What you will probably have is AI generated games that are played over cloud like you see in this video.
Couple of years ago AI couldn't generate a 2D image of a decent enough quality, yet just a short while later we already generating 2D game worlds. Give it 10 years+ and games will probably shift to AI scripting without any code input. Coding may still be ised for certain things though.
One of the things that should come iut of this is the ability of everyday Joe to AI script his own game with user generated videogames completely blowing the gaming market wide open. Whatever will be the end result, gaming is bound to change significantly as AI becomes more advanced.
Couple of years ago AI couldn't generate a 2D image of a decent enough quality, yet just a short while later we already generating 2D game worlds. Give it 10 years+ and games will probably shift to AI scripting without any code input. Coding may still be ised for certain things though.
One of the things that should come iut of this is the ability of everyday Joe to AI script his own game with user generated videogames completely blowing the gaming market wide open. Whatever will be the end result, gaming is bound to change significantly as AI becomes more advanced.
Last edited:
Eh, if the ai just responds to player urges then EVERY GAME is gonna be a porn game within 30 minutes
DownLikeBCPowder
Member
Neither do current technological advancements - everything builds upon what exists. Artists or Minecraft is also no different in this regard, there are always external factors attributed or not to development of anything effectively.
Crazily short sighted, IMO. The AI is recreating Minecraft, with physics, HP, etc systems functioning - but the only "application" you see is for realtors to make a video stitched from .. photographs?
Real time engine generation is coming. How long until that is effective is another thing entirely, but it is all coming. "GTA 6 but in Russia" is exactly the thing - granted this is a monumental ask, but that is exactly right in simplified terms.
ResurrectedContrarian
Suffers with mild autism
Eh, if the ai just responds to player urges then EVERY GAME is gonna be a porn game within 30 minutes
Last edited:
CuteFaceJay
Member
that's wild stuff.
Alexios
Cores, shaders and BIOS oh my!
Lol. Yeah okay, even if you can train the AI to take from any game to generate what the player wants mixing and matching elements of all freely (which you absolutely can't do, hence all this celebration for haphazardly copying a single game here), it's still gonna be dumb slop, like all the AI articles, it's not gonna have anything engaging that can cause any actual feelings to the player and people will most definitely recognize the patterns or the games it stole from every turn rather than truly feel they're experiencing something new, unless of course they haven't played any of the games it was trained on, but the ignorance on the part of the end user doesn't mean the output was of good quality. Even short AI articles can be recognisably awful and that's textbook text generation, not an attempt to have a video game with all its cinematic (or with scripted sequences) story beats that make a coherent and engaging whole alongside the actually playable parts. Like the AI NPCs we've seen in some games/mods none of which are engaging well written characters, at best info dumps without a personality and at worst sad attempts at the latter (in which case they're info dumps but with a sexy or whatever type of voice was selected as a "personality") and again that's just one very simple tiny element they have a long way to go before it can be truly ready to replace (even the bad quality) writing (unless the quality of the product doesn't matter of course, just the cost cutting).
Maybe you can use something like this in combination with actual designers, writers, artists, that will need to be super detailed and thorough in their inputs (a book's worth of design documents for every aspect, a ton of art for every side, pose, feeling experienced by all the specifically designed characters, objects, the world, every damn thing big or small, a ton of real dialogue written for the core character encounters and personalities that may be augmented with AI for info dump moments the player may decide to use - but probably won't, the game will be full of markers and pointers etc. the way things are going anyway - etc.) to the system rather than the simple promps folks use with image/video AI (or the simple instructions to the ST holodeck) that get wildly different results full of inconsistencies every time. Why are they even showing it to the public when it has all the dumb inconsistencies people point out in simple image or video sequences where everything is radically different just by turning around or every frame, lol, basic persistence should be the first thing they get right before thinking they have caught lightning in a bottle. At best this simply shows all the AIs do is remix what they've been fed and otherwise can't create shit worth a damn, if you first need to make a video game for the AI to copy (in a very dodgy manner) what's the point if not to steal other people's work like all the image AIs do (and some pretend they don't, lol).
Maybe you can use something like this in combination with actual designers, writers, artists, that will need to be super detailed and thorough in their inputs (a book's worth of design documents for every aspect, a ton of art for every side, pose, feeling experienced by all the specifically designed characters, objects, the world, every damn thing big or small, a ton of real dialogue written for the core character encounters and personalities that may be augmented with AI for info dump moments the player may decide to use - but probably won't, the game will be full of markers and pointers etc. the way things are going anyway - etc.) to the system rather than the simple promps folks use with image/video AI (or the simple instructions to the ST holodeck) that get wildly different results full of inconsistencies every time. Why are they even showing it to the public when it has all the dumb inconsistencies people point out in simple image or video sequences where everything is radically different just by turning around or every frame, lol, basic persistence should be the first thing they get right before thinking they have caught lightning in a bottle. At best this simply shows all the AIs do is remix what they've been fed and otherwise can't create shit worth a damn, if you first need to make a video game for the AI to copy (in a very dodgy manner) what's the point if not to steal other people's work like all the image AIs do (and some pretend they don't, lol).
Last edited:
StueyDuck
Member
Honestly this all reeks of the same web3 nonsense
This is not a real-time engine. Nor will it ever be, that is not what this is doing.
And an engine also doesn't need to be ai generated, it's literally the point of an engine, it's an environment both literally and development wise. Now an ai generated game using an engine would be interesting but so far what we have still requires a game prior before hand, ie like the doom ai generator.
If you think game developers are gonna get fired on 5 years because of an ai that just copies Screencaps of a game and puts it together then I've got a lovely bridge to sell you.
Trust me, as someone who has to deal with new hires "totally not copied chatgpt broken code" fairly regularly lately. We aren't there yet.
Last edited:
DownLikeBCPowder
Member
You are correct that this is not exactly a "real time engine", but it is much closer than ever. It is trained simply by watching videos of this game - the fact that it can come this far is beyond impressive to me. From videos of this game it can generate a playable environment emulating the engine rules as they exist in Minecraft, physics, as well as other game logics. Based on just observation of the game being played, not the back end. This is something noteworthy.
I never said that. I did say, however, real time engine generation is coming. It is. I'm not even the biggest fan of long term implications of AI - doesn't mean it's not coming. Sooner than most think IMO in various regards, but it's just speculation. I completely agree with you that we are not "there" yet, but surely you agree the leaps and strides made in the last few years are simply phenomenal? In terms of what kind if output we used to see versus what kind of output can be had now with similar size prompts, etc?
ResurrectedContrarian
Suffers with mild autism
This is purely just a "look how fast we can get it to live-render already" demo for fun, to be clear -- it's nowhere near the breakthroughs happening in AI today and wouldn't even quality for a serious paper. It's just a cool demo. But video models have shown preliminary "world simulator" capability, and this is a scaled-down realtime version of that -- sadly with very little context window however (probably to make it cheap/live online), which is why there's zero consistency.
But AI can absolutely approach the power of the holodeck in time. What you need is multiple systems:
- a powerful narrative LLM can construct the story, motivations, etc at a high level
- Then another model can generatively build an actual in-memory 3D model of environments for perfect consistency. Neural radiance fields already do this, creating actual 3-dimensional scene models that are like mental point-clouds which actually permit photorealistic rotation, position, relighting, shadows, etc all in one model, rather than merely drawing geometry and putting textures etc on top as game engines today do
- there are plenty of models that can also do powerful policy-based time series prediction and learning, for the game logic
It will take some years to assemble these, but it's absolutely where things will end up in time.
Just a tech demo. Mostly they are showing that they can actually open up this little experiment to random people online, so they are showcasing their hosting and so forth.
genesisblock
Member
So, what's the core gameplay loop on these things? When everything changes on a whim, how are you as a gamer adjusting to the different gameplay modes, controls, levels all the while shooting you with 50 different genres like a psychedelic Warioware game? And why does your AI scenario only makes current gen gaming experiences? That seems like astronomically waste of resources that can seemingly do anything.
Last edited:
Current AI has a huge potential for horror content. There was a clip i saw on
-chan where a dude body was folding into itself, it was great.Could you explain why?
Knightime_X
Member
You're only looking at the present and not the future.
I just listed known games to make it easier to comprehend.
As for gameplay, it won't be like that of the minecraft ai demo but far more intact and stable.
Knightime_X
Member
You've seen how hot ai can make people.Eh, if the ai just responds to player urges then EVERY GAME is gonna be a porn game within 30 minutes
Ngl, I'm 100% down for ai porn.
Especially when it gets much more advanced.
Having your own NPU that evaluates models deployed as games is the future and ironically, in time, the solution to ballooning costs of game development.
As a developer / publisher / console manufacturer you should be planning ahead, that’s for certain. Will be lots of losers when game development / animation / movie / etc / production becomes so democratized. Lots of new opportunities though!
As a developer / publisher / console manufacturer you should be planning ahead, that’s for certain. Will be lots of losers when game development / animation / movie / etc / production becomes so democratized. Lots of new opportunities though!
Last edited:
kurisu_1974
Banned
The issue is that the model probably has no idea what it is doing or why, so yeah it can recreate this very specific thing that it has seen a billion hours of... cool I guess? But not AI.
Similar threads
- Locked