Support NeoGAF

[mckmas8808]

Why not?
This site has the RTX 3060 Ti 8GB for example being capable.
Choosing the Right NVIDIA GPU for LLMs on the Ollama Platform


Tiny Models (100M - 2B parameters): These models can often run on consumer-grade GPUs with 2-4GB of VRAM.

Small Models (2B - 10B parameters): These models can often run on consumer-grade GPUs with 6-16GB of VRAM.

Medium Models (10B - 20B parameters): These models typically require 16-24GB of VRAM.

Large Models (20B - 70B parameters): These models need high-end GPUs with 24-48GB of VRAM.

Because it's nonsensical to have that running on a Video Game console. Taking up valuable resources. Why? For what? What application will it add being run locally on the console?

 

[Bojji]

It'll be a successful enough device if it can just play PS5 games without any patch. Remember that we're in 2025 and there are still PS4 games being released.

It won't be able to play PS5 games without patches.

It will have 0.5GPU power of PS5. "Low power mode" is happening for this exact reason but many games from 2020-2024 will require patches or simply refuse to work.

 

[Radical_3d]

It won't be able to play PS5 games without patches.

It will have 0.5GPU power of PS5. "Low power mode" is happening for this exact reason but many games from 2020-2024 will require patches or simply refuse to work.

Not if they implement a backwards compatibility similar to the wrapper the Xbox is using to upgrade older games to a higher resolution but the other way around.

 

[viveks86]

Because it's nonsensical to have that running on a Video Game console. Taking up valuable resources. Why? For what? What application will it add being run locally on the console?

Imagine a matrix game. And you can go to the Oracle and tell her absolutely anything through the in-built mic. She will have a personality, but also the entire world's knowledge at her fingertips. Tell her how Playstation Studios are starting to drop the ball with bleeding edge graphics tech. Tell her games are becoming too long so that companies endlessly farm your engagement, pushing the entire industry to the brink of collapse because no one buys new titles. Tell her the world has become too polarized and we need to find ways to reach across the aisle. Tell her wokeness has gone too far and we don't have to live in constant guilt for mistakes done by ancestors. Tell her all identity politics need to die so we can all just be human again. Tell her inflation is ruining us, greedy corporations need to stop buying up our land and the American dream is basically dead unless you are a DINK working in big tech or an OnlyFans superstar. Tell her we need to stop consuming palm oil because the industry is destroying the last remaining Orangutan habitat and nobody knows about it or gives a shit. Tell her about the endless wars that only serve the people in power.

She will listen patiently and understand. Without the frustrating, anxiety inducing latency of doing all this on the cloud, she will give you some pearls of regurgitated wisdom on why life is still worth living despite all the unrelenting shit thrown at you, directly from your PS6, powered by RDNA5, with a 10B LLM running on 40 Gigabytes of RAM. The path traced cookie she offers will make you feel as right as rain.

 

[Parazels]

I imagine many games won't need the power of the PS6 to be played.

This.
People are too focused on a few AAA games, whereas there are tons of good indie-games, classic titles, etc, that can run smoothly even on a little portable Ferrari.

 

[viveks86]

Not if they implement a backwards compatibility similar to the wrapper the Xbox is using to upgrade older games to a higher resolution but the other way around.

Would be unprecedented for Sony to suddenly use a software layer like that. They could have made every PS5 Pro game auto-enhanced by default, if this route was viable/desirable for them. They are extremely conservative about doing anything in software that impacts all games.

Also, I'm imagining UE5 games already running at 540p on base console. Would that be 360p on the handheld? *shudders*

 

[Bojji]

Would be unprecedented for Sony to suddenly use a software layer like that. They could have made every PS5 Pro game auto-enhanced by default, if this route was viable/desirable for them. They are extremely conservative about doing anything in software that impacts all games.

Also, I'm imagining UE5 games already running at 540p on base console. Would that be 360p on the handheld? *shudders*

Exactly, we don't have fucking 120Hz system wide with vrr and LFC (standard on Xbox and PC for over a decade).

There are also 30fps games on PS5, how they will run?

 

[DAHGAMING]

Dude you can't serve me these jokes on a silver platter, cmon

Who said anything about a joke, look at this shit, I have all the gear setup but instead look at that shit, some big geeza fucking weeping over some handmade mugs and plates ect, that shit goes on the big screen while im dragging myself through Vielguard at 720p on the Rog in my man corner, fuck.

 

[Loxus]

Because it's nonsensical to have that running on a Video Game console. Taking up valuable resources. Why? For what? What application will it add being run locally on the console?

PS6 with RDNA5 dual-issue should make it possible and each CU has 2 AI Accelerators.

Possibilities.
Dialogue & story generation, AI-intensive NPCs, companions, emergent behaviors, procedural world generation, dynamic world interactions. The list goes on.

I don't know why you are acting like it's some large scale thing that requires a super computer. These models are small, maybe ~6GB in size and can run on

RTX 3060 Ti.

It's ​

just a little something to make games feel more alive.

Dynamic Dialogue
NPCs no longer rely solely on pre-written dialogue trees. LLMs allow NPCs to generate natural language responses in real time, adapting to player input.

Example: If a player asks a unique question, the NPC can respond appropriately instead of repeating canned lines.

Procedural Behavior & Decisions
LLMs can influence decision-making logic for NPCs: where they move, how they react, or what goals they pursue.

NPCs can exhibit emergent behavior rather than scripted routines.

Context Awareness
LLMs maintain context buffers to remember interactions with the player or other NPCs.

This enables consistent personality and memory, so NPCs "remember" past events, choices, or conversations.

Quest & Story Integration
NPCs can generate side quests, hints, or dynamic storylines based on player actions.

LLMs allow NPCs to act as a dynamic storyteller or guide, adapting narrative flow on the fly.

Adaptive Tone & Accessibility
NPCs can adjust their tone, politeness, or language to match player preferences.

LLMs can also handle real-time localization, making dialogue natural across languages.

But if it makes you happy, next-gen wouldn't have it and we'll just continue to have PS5 games, just at a higher resolution and frame rate.

 

[mckmas8808]

PS6 with RDNA5 dual-issue should make it possible and each CU has 2 AI Accelerators.

Possibilities.
Dialogue & story generation, AI-intensive NPCs, companions, emergent behaviors, procedural world generation, dynamic world interactions. The list goes on.

I don't know why you are acting like it's some large scale thing that requires a super computer. These models are small, maybe ~6GB in size and can run on

RTX 3060 Ti.

It's ​

just a little something to make games feel more alive.

Dynamic Dialogue
NPCs no longer rely solely on pre-written dialogue trees. LLMs allow NPCs to generate natural language responses in real time, adapting to player input.

Example: If a player asks a unique question, the NPC can respond appropriately instead of repeating canned lines.

Procedural Behavior & Decisions
LLMs can influence decision-making logic for NPCs: where they move, how they react, or what goals they pursue.

NPCs can exhibit emergent behavior rather than scripted routines.

Context Awareness
LLMs maintain context buffers to remember interactions with the player or other NPCs.

This enables consistent personality and memory, so NPCs "remember" past events, choices, or conversations.

Quest & Story Integration
NPCs can generate side quests, hints, or dynamic storylines based on player actions.

LLMs allow NPCs to act as a dynamic storyteller or guide, adapting narrative flow on the fly.

Adaptive Tone & Accessibility
NPCs can adjust their tone, politeness, or language to match player preferences.

LLMs can also handle real-time localization, making dialogue natural across languages.

But if it makes you happy, next-gen wouldn't have it and we'll just continue to have PS5 games, just at a higher resolution and frame rate.

That's a lot of hardware dedicated to something most devs will never use though.

 

[Loxus]

That's a lot of hardware dedicated to something most devs will never use though.

What are is wrong with you?
It's literally the RDNA4 CU make up.

I swear to god if developers was to ever listen to you guys, we'll be still playing 2D games on the SNES.

 

[mckmas8808]

What are is wrong with you?
It's literally the RDNA4 CU make up.

I swear to god if developers was to ever listen to you guys, we'll be still playing 2D games on the SNES.

So how many GBs of RAM would be needed\allocated to allow a local LLM to work on the PS6?