Support NeoGAF

[Bernoulli]

By sachos https://openai.com/research/video-generation-models-as-world-simulators
Check out their more in depth technical report, the model is able to "Simulate digital worlds" and they show an example of a Minecraft "gameplay". They say "These capabilities suggest that continued scaling of video models is a promising path towards the development of highly-capable simulators of the physical and digital world, and the objects, animals and people that live within them."

They say the capabilities of the model keep improving with compute, if they manage to keep the trend going and make it faster one could imagine say Sora V4 running at 30FPS generating a videogame in real time. Its a world simulator, not just a video creator. Its insane.

Yesterday reveal of Sora combined with Gemini 1.5 with 1 to 10 million tokens of context length marks one of the biggest days in AI ever. I expected something the quality of Sora in 1.5 or 2 years, OpenAI keep raising the bar, they trully have the secret sauce.


Just look at how realistic this is
This is advancing so fast that i think games made by AI are just months away and it will make everything better and faster to make
Yes it sucks for artists but this is the best tech revolution in these last few years

 

[M1chl]

Umm, I understand its friday and probably evening or night

 

[DownLikeBCPowder]

Sure is. Only a matter of time.

 

[ManaByte]

Well at least Sweet Baby can’t ruin it.

 

[Bernoulli]

Sure is. Only a matter of time.

Just imagine all the possibilities, you can create anything without worrying about budget, scanning parts of the world to make your universe and all that

 

[Unknown Soldier]

Maybe with AI games they can make them faster and have smaller budgets so you don't need to sell 7 million copies to break even

 

[Carmen Winstead]

Ubisoft has been publishing games made by AI for years, what do you mean buddy?

 

[Shodai]

Games...several years. Movies and animation? That industry is going to get leveled in 2-4 years. Will be a very different world in a lot of ways.

 

[KimDongHwan]

Well at least Sweet Baby can’t ruin it.

Unluckily I think they still can current AIs are heavily influenced by DEI as can be seen through their responses. It will also be a matter of time that photo and video generated through the same will get the same treatment

 

[sachos]

Video generation models as world simulators

We explore large-scale training of generative models on video data. Specifically, we train text-conditional diffusion models jointly on videos and images of variable durations, resolutions and aspect ratios. We leverage a transformer architecture that operates on spacetime patches of video and...

openai.com

Check out their more in depth technical report, the model is able to "Simulate digital worlds" and they show an example of a Minecraft "gameplay". They say "These capabilities suggest that continued scaling of video models is a promising path towards the development of highly-capable simulators of the physical and digital world, and the objects, animals and people that live within them."

They say the capabilities of the model keep improving with compute, if they manage to keep the trend going and make it faster one could imagine say Sora V4 running at 30FPS generating a videogame in real time. Its a world simulator, not just a video creator. Its insane.

Yesterday reveal of Sora combined with Gemini 1.5 with 1 to 10 million tokens of context length marks one of the biggest days in AI ever. I expected something the quality of Sora in 1.5 or 2 years, OpenAI keep raising the bar, they trully have the secret sauce.

This was my favourite video https://cdn.openai.com/sora/videos/train-window.mp4 when the girl shows in the reflection i gasped. The jump in quality relative to existing models is staggering. 11 months ago we had the Will Smith eating spaghetti meme.

 

[Bernoulli]

Maybe with AI games they can make them faster and have smaller budgets so you don't need to sell 7 million copies to break even

Games could be made by one guy just narrating to the AI
And they could make real live generated games that change based on each user's choice to get infinite possibilities, not like the linear pre baked "choices"
Real alternatives that all give many endings and completly change the story that is written by AI based on what you do

 

[SidViscous]

AI generated video won't be "real-time" for at least another 5-6 years, and due to diminishing returns / moores law, probably won't ever be possible on a small home system without streaming it from somewhere else. It takes a few ms just to generate a 500x500 pixel image on a supercomputer, which is like 250,000 pixels, each being three points of data (rgb), 1080p is 6 million data points, plus the additional vector/s for movement across frames, and then you want that rendered in realtime at a minimum of 30fps. aint happening, just close your eyes and use your imagination.

 

[tmlDan]

I'm not sure how much validity this has, but i saw a thread where they were just copying Shutterstock and they showed the Shutterstock comparable.

This still needs a ton of work, I won't believe it until i use it myself. Right now its just stealing images, and putting them together in a puzzle-like way.

edit, this one:

 

[rofif]

It’s not really ai. It’s stealing and conversion algorithm as I like to call it

 

[SJRB]

Fundamental misunderstanding of both this AI technology and videogame development.

 

[Mortisfacio]

Unluckily I think they still can current AIs are heavily influenced by DEI as can be seen through their responses. It will also be a matter of time that photo and video generated through the same will get the same treatment

I'd like some of these well funded AIs to not have a clear bias and just answer simple prompts. Ask ChatGPT or Gemini the pros of left wing politics, you get a long list. Ask the same for right leaning, you get a short list followed by a list of negatives you didn't ask for. Concerns me where this leads.

edit: Last time I tried this was December. As of right now, ChatGPT is finally just giving me the "positives" of both that I asked for. Gemini (was Bard when I last tried) is still insisting on providing an included list of negatives for only one of these prompts.

 

[Zathalus]

AI already does the art, the code, the voice acting, and even writes the scripts. Still requires a human to put it all together but that is changing as well.

 

[Darsxx82]

I said it in the thread announcing the next Xbox NextGen....

Perhaps Sarah Bond is referring to advances in AI when she expects "the biggest generational leap."

Advances in generative AI have been happening for months, in 2027 the technology and its use will be in another dimension and in all the development tools of the Studios.

And yes, I expect a reduction in development costs, shorter development times, games with greater depth and new genres..... On the other hand, the employment of many artists and programmers is at total risk.

 

[Bernoulli]

I'm not sure how much validity this has, but i saw a thread where they were just copying Shutterstock and they showed the Shutterstock comparable.

This still needs a ton of work, I won't believe it until i use it myself. Right now its just stealing images, and putting them together in a puzzle-like way.

edit, this one:

If it has been trained on that kind of bird on only that video it makes sense that it looks close
But imagine if it's allowed to train on every existing video on the web

 

[SidViscous]

But imagine if it's allowed to train on every existing video on the web

Did you think this through? no matter what you told it to generate it would end up making a video of them having sex.

 

[april6e]

Everyone is pissed off about AI art and film and I think this is the most exciting technological advancement since the internet. Yeah, it will result in things that suck but it also will make so many fascinating things possible. A teacher instead of having to spend 5 minutes drawing boring notes on how gravity works like what I endured in the 00s and instead just entering a prompt and AI creates a short video of an apple and a car being dropped that looks photorealistic and shows gravity affecting them at the same rate.

 

[cash_longfellow]

Edit - also, good luck if you are looking for work and didn’t create the perfectly tailored resume to the position…you won’t even be considered for an interview even if you are the most qualified…AI is a fucking joke and if you support it now, good luck when you legitimately need to talk to a human being in about 10 years for literally anything from customer service to food ordering. It’s sad that we aren’t even standing up against this nonsense right now….you, me, all of us will seriously regret it.

 

[SirTerry-T]

I for one am looking forward to a future where all game characters have deformed hands and GUI menus make no sense whatsoever...

 

[Bernoulli]

AI already does the art, the code, the voice acting, and even writes the scripts. Still requires a human to put it all together but that is changing as well.

The fact that one human can do that makes making games cheaper for small devs, imagine now the AI can out all that in the game engine
Epic Games could pull it off with the right partner

 

[kungfuian]

In 5-10 years I could Imagine this tech leading to a revolution in game creation. For example imagine a AAA asymmetrical D&D style game where the dungeon master creates the world and scenarios by narrating, and the world changes for those playing in real time!

Shits gonna be crazy!

 

[sachos]

You can even use the video generated as input into a Gaussian Splatting AI https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/ to create 3D scenes. That means you have a text to 3D World system. Combine that with speech to text and an advanced VR headset and you have virtual worlds you create with your voice.

 

[Švejk]

Can't wait to see the game Tay makes. Lol

 

[SidViscous]

The fact that one human can do that makes making games cheaper for small devs, imagine now the AI can out all that in the game engine
Epic Games could pull it off with the right partner

I don't think AI will ever be able to write code by itself, at least not lower level stuff like C. If you fuck up a finger in a photo it's not a big deal, but if you forget to allocate memory for an object, it's crashing the game. Best bet would be to make an engine that has a very high level human readable style scripting language, and then let a GPT model write the scripts for it, so an ultra high level programming language designed specifically for AI to code in

 

[cash_longfellow]

In 5-10 years I could Imagine this tech leading to a revolution in game creation. For example imagine a AAA asymmetrical D&D style game where the dungeon master creates the world and scenarios by narrating, and the world changes for those playing in real time!

Shits gonna be crazy!

If you think this is a good thing…that’s on you. And not in a good way.

 

[Bernoulli]

I said it in the thread announcing the next Xbox NextGen....

Perhaps Sarah Bond is referring to advances in AI when she expects "the biggest generational leap."

Advances in generative AI have been happening for months, in 2027 the technology and its use will be in another dimension and in all the development tools of the Studios.

And yes, I expect a reduction in development costs, shorter development times, games with greater depth and new genres..... On the other hand, the employment of many artists and programmers is at total risk.

With their partnership with OpenAi they could be the first to do this

 

[Guerilla Munch]

imagine the galactic scale vr goon caves we can generate

 

[cash_longfellow]

I don't think AI will ever be able to write code by itself, at least not lower level stuff like C. If you fuck up a finger in a photo it's not a big deal, but if you forget to allocate memory for an object, it's crashing the game. Best bet would be to make an engine that has a very high level human readable style scripting language, and then let a GPT model write the scripts for it, so an ultra high level programming language designed specifically for AI to code in

You sure about that??

 

[Darsxx82]

In 5-10 years I could Imagine this tech leading to a revolution in game creation. For example imagine a AAA asymmetrical D&D style game where the dungeon master creates the world and scenarios by narrating, and the world changes for those playing in real time!

Shits gonna be crazy!

You can even use the video generated as input into a Gaussian Splatting AI https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/ to create 3D scenes. That means you have a text to 3D World system. Combine that with speech to text and an advanced VR headset and you have virtual worlds you create with your voice.

The possibilities are endless.

 

[Bernoulli]

I don't think AI will ever be able to write code by itself, at least not lower level stuff like C. If you fuck up a finger in a photo it's not a big deal, but if you forget to allocate memory for an object, it's crashing the game. Best bet would be to make an engine that has a very high level human readable style scripting language, and then let a GPT model write the scripts for it, so an ultra high level programming language designed specifically for AI to code in

If let's say Epic Games introduces a "translator" that can make it easier for AI to code without directly coding it could work

 

[Buggy Loop]

This was a year ago



This is Sora today

https://cdn.openai.com/tmp/s/simulation_5.mp4

1 year...

Anyone thinking that this won't be a paradigm shift in gaming is basically a caveman at this point.

This AI knows the physics and how the world should react and look like, it knows its presence in a physical world.

2025~26, first AI game will be made.

Now I wouldn't even be shocked if that is not what Microsoft was referring to.

 

[Tajaz2426]

Edit - also, good luck if you are looking for work and didn’t create the perfectly tailored resume to the position…you won’t even be considered for an interview even if you are the most qualified…AI is a fucking joke and if you support it now, good luck when you legitimately need to talk to a human being in about 10 years for literally anything from customer service to food ordering. It’s sad that we aren’t even standing up against this nonsense right now….you, me, all of us will seriously regret it.

I wonder what those coal miners are going to do. Right after they are told “learn to code”, they get comfy at their new job coding and bam, they get done in by AI. They are going to need another new career field.

 

[DownLikeBCPowder]

I don't think AI will ever be able to write code by itself, at least not lower level stuff like C. If you fuck up a finger in a photo it's not a big deal, but if you forget to allocate memory for an object, it's crashing the game. Best bet would be to make an engine that has a very high level human readable style scripting language, and then let a GPT model write the scripts for it, so an ultra high level programming language designed specifically for AI to code in

It can code simple games right now with just chatbots.. why wouldn't it be able to code more complex results ?

 

[SidViscous]

This AI knows the physics and how the world should react and look like, it knows its presence in a physical world.

The opposite is true, this is the main area they are struggling with, the white paper makes it clear that whilst they've now mostly solved persistence, physics and real world interactions are an abstract problem that's hard to teach a visually focused AI.

discussion_0.mp4

It can code simple games right now with just chatbots.. why wouldn't it be able to code more complex results ?

Simple games are based off simple examples of which many exist on the web for it to learn from, the more specific or elaborate you get, the worse the results become. Also all GPT models have a token length limitation, they can't "think" larger than a certain amount of code, so couldn't work on large projects without human intervention to piece things together.

 

[Bernoulli]

Games...several years. Movies and animation? That industry is going to get leveled in 2-4 years. Will be a very different world in a lot of ways.

This was a year ago



This is Sora today

https://cdn.openai.com/tmp/s/simulation_5.mp4

1 year...

Anyone thinking that this won't be a paradigm shift in gaming is basically a caveman at this point.

This AI knows the physics and how the world should react and look like, it knows its presence in a physical world.

2025~26, first AI game will be made.

Now I wouldn't even be shocked if that is not what Microsoft was referring to.

S Shodai this is why I'm saying just months
It's going exponentially fast, companies started investing billions just a few months ago to buy AI GPUs from AMD and Nvidia and look how far they are without even all that Hardware at full use yet

 

[ThisIsMyDog]

This AI knows the physics and how the world should react and look like, it knows its presence in a physical world.

2025~26, first AI game will be made.

Now I wouldn't even be shocked if that is not what Microsoft was referring to.

That's right Sora is more than just a video generator, the model also simulates the world and the correlations in it. One step closer to AGI.

Here is generating Minecraft: (no, its not a joke)





I think gaming industry as a whole will look nothing like today in 2030.

 

[BennyBlanco]

I feel like we are a few years away from entire text prompt generated videogames.

The videos from OpenAI kind of creep me out. I use stablediffusion pretty often and the body horror it generates sometimes doesn’t really irk but something about the videos makes me feel uneasy.

 

[Go_Ly_Dow]

Not sure about text prompt games, but shit like this will help speed up game development.



Although I worry about the quality of future games from an art direction perspective if the game world is largely designed by prompts over human input and artistry.

 

[kungfuian]

Wonder how long till we see this type of AI translate entire novels or screen plays into full movies. Throw in a few illustrations and instructions for additional reference and set it loose.

 

[kungfuian]

Imagine feeding a more advanced version of this AI a game's full code. Then the AI system acts like a crazy automated remix tool. It could kick out infinite variations and content for your favorite games.

Still think we are about 10 years away from this materializing, but it is coming, and gaming is going to be an entirely different animal when it does.

 

[Represent.]

Its going to be harder and harder to actually have a skill that makes you fucking money. AI just going to replace everything. Fucking ridiculous. You think its hard to make a living now, wait til AI eliminates every goddamn fucking job/hustle on the planet. I will not cheer about this.

 

[mitch1971]

Well at least Sweet Baby can’t ruin it.

Imagine they got involved in an A.I. game and even the A.I. told them to fuckoff.

 

[Buggy Loop]

Wonder how long till we see this type of AI translate entire novels or screen plays into full movies. Throw in a few illustrations and instructions for additional reference and set it loose.

Not long…

ChatGPT 5 is just around the corner

Sora is at version 0

It will be wild as fuck in the next decade

You could generate anything you want with the actors you want

Porn will be insane

Plug this into VR with basically infinite entertainment potential and an AI metaverse and you pretty much have the beginning of the matrix, an early version of it.

 

[Reizo Ryuu]

Lol months? You're high OP

 

[Holammer]

What a time to be alive!
I don't think it's going to go quite that fast, give it a full year or two. The AI is still a dreaming idiot God (i.e. it has no idea or concept of *what* it's doing).

 

[Buggy Loop]

Imagine feeding a more advanced version of this AI a game's full code. Then the AI system acts like a crazy automated remix tool. It could kick out infinite variations and content for your favorite games.

Still think we are about 10 years away from this materializing, but it is coming, and gaming is going to be an entirely different animal when it does.

This is probably 6 months to a year away from Nvidia I’m not even kidding. An AI remix on the fly.

edit : To add, as I was putting my kids to sleep and on phone, sucked to type..

I mean that the game being the equivalent to the a video for the AI, it would be very easy for them to change the look, just like this

https://cdn.openai.com/tmp/s/edit/base.mp4

A bit like Google's old ass GTA 5 AI filter but now much more sophisticated. To be seen.