Support NeoGAF

[SomeNorseGuy]

Now available through the Xbox Game Bar, Microsoft's new AI assistant reads your screen, tracks your play history, and offers real-time help.

Microsoft Gaming Copilot hits Windows in public beta — in-game AI overlay goes live for PC players

Now available through the Xbox Game Bar, Microsoft’s new AI assistant reads your screen, tracks your play history, and offers real-time help

www.tomshardware.com

Unlike past versions of Copilot integrated into Windows or Microsoft 365, Gaming Copilot is built with screen context and real-time game awareness. It reads from your Xbox account history, sees what you're playing, and can analyze screen content on demand to answer in-game questions. ​

Microsoft began rolling out its new Gaming Copilot assistant to Windows users as part of a public beta on September 19, following a previous rollout to Xbox Insiders in August. The feature, located within the Xbox Game Bar overlay, provides players with real-time in-game support using AI-driven context from their screen and Xbox account.

Unlike past versions of Copilot integrated into Windows or Microsoft 365, Gaming Copilot is built with screen context and real-time game awareness. It reads from your Xbox account history, sees what you're playing, and can analyze screen content on demand to answer in-game questions. Microsoft says it's designed to help players find achievements, plan builds, and navigate quests without needing to alt-tab to wikis or YouTube.

On paper, Gaming Copilot resembles third-party tools like Overwolf, but it operates at the system level within the Game Bar overlay, which provides more reliable full-screen behavior and compatibility with DirectX titles. Microsoft has also confirmed that the assistant can be pinned as a widget and activated with push-to-talk voice controls, two features already present in this early beta.

There is also no mention of NPU acceleration, which would matter for players using Snapdragon X laptops or hybrid-core CPUs with on-device AI blocks. This will be a key testing point, particularly as Microsoft has framed the Copilot experience as optimized for new handhelds like the ROG Ally X.​

The company has not disclosed whether any of the Copilot inference runs locally or if it's entirely cloud-based. There is also no mention of NPU acceleration, which would matter for players using Snapdragon X laptops or hybrid-core CPUs with on-device AI blocks. This will be a key testing point, particularly as Microsoft has framed the Copilot experience as optimized for new handhelds like the ROG Ally X.

Anti-cheat compatibility is another open question. Vendors like Easy Anti-Cheat and BattlEye generally whitelist Game Bar itself, but Copilot is a more complex overlay, and Microsoft hasn't clarified whether any specific protections are in place. With real-time screenshot analysis and persistent widgets, it's not clear how Copilot will behave in titles with aggressive DRM or competitive match enforcement.

Anti-cheat compatibility is another open question. Vendors like Easy Anti-Cheat and BattlEye generally whitelist Game Bar itself, but Copilot is a more complex overlay, and Microsoft hasn't clarified whether any specific protections are in place.​

With the release of Gaming Copilot, Microsoft appears to be making a concerted effort to make Windows feel more like a native gaming platform. Just days before the Copilot rollout, the company updated the Xbox app to serve as a unified launcher that aggregates titles from Steam, Epic, GOG, and others. Together, these changes transform Windows from a passive host OS to an active participant in the gaming experience.

Gaming Copilot is now available for players aged 18 and older, in all regions except mainland China.

---

I get that we all want to be somewhat efficient when gaming but wouldn't these resources be better used for:

Article:

"Automatic Super Resolution (Auto SR) seamlessly integrates with Windows on a Copilot+ PC with a Qualcomm Snapdragon X processor to automatically enhance a set of existing games by default, and boosts frame rates while maintaining detailed visuals," explains Microsoft.

"Auto SR functions by automatically lowering the game's rendering resolution to increase framerate, then employs sophisticated AI technology to provide enhanced high-definition visuals. This results in a smoother, more detailed gaming experience."

Source: https://www.neogaf.com/threads/this-copilot-pc-gaming-feature-promises-steam-deck-level-performance-on-snapdragon-x-pcs.1671046/

Spoiler

 

[RoadHazard]

Yuck.

 

[PauloRoberto]

Yep, papa nutella really wants to shove Copilot in every place possible (with double meaning, please), given that they literally bet everything on AI (which is still mainly a solution in search of a problem).

 

[Cert.in.Death]

Ah, intrusive in-game overlays.

Never change MS. This is why you lost.

 

[R3TRO]

No thanks

 

[willothedog]

Ah, intrusive in-game overlays.

Never change MS. This is why you lost.

Lost what? This is for Windows.

 

[StereoVsn]

Gamers: "We would like better system optimization, less bloat, less intrusive monitoring and telemetry."

MS: "Here is Clippy 2.0, its going to be simply Amazing!"

 

[Magic Carpet]

Is this where I get an AI to take over the controls?

 

[SomeNorseGuy]

Is this where I get an AI to take over the controls?

Self playing games, youtube must be sweating.

 

[Topher]

I use copilot when I'm stuck in a game and can't move forward. It's just a better google.

 

[Hero of Spielberg]

I'd like this for rpg builds

 

[Germuso]

Help me to sell your console.

 

[Fake]

Yikes.

 

[SomeNorseGuy]

I use copilot when I'm stuck in a game and can't move forward. It's just a better google.

I have no problem of this existing and can see use cases for help with builds/strategy/choices. But I hope that MS adds a "Super optimize" button in their Full Screen mode that let's you turn off all superfluous tasks to save resources/battery.

---

For anyone interested in reading a bit more in depth about Gaming CoPilot I found this article very informative:

Gaming Copilot: Microsoft's in game AI assistant in Xbox Game Bar beta

Microsoft has begun rolling out Gaming Copilot — a context‑aware, voice‑enabled AI assistant embedded in the Xbox Game Bar — to Windows PCs as a public beta, bringing real‑time, in‑overlay help for achievements, builds, quests and screenshot analysis to players while they stay in full‑screen...

windowsforum.com

 

[reinking]

I use copilot when I'm stuck in a game and can't move forward. It's just a better google.

Google has turned to . The AI summary is often way off and that is all they seem to want to push. I have pretty much stopped using it since even the non AI results are manipulated to a point that I have to dig a few pages back to find the information I was actually searching for.

 

[Cert.in.Death]

Lost what? This is for Windows.

Lost to Steam

 

[Gamer_By_Proxy]

I've never used the xbox or steam overlay on purpose in my life.

 

[FIREKNIGHT2029]

 

[Skifi28]

Can't open a pdf these days without some company trying to shove AI down your throat.

 

[Thebonehead]

I'm not sure if it's worth at this time.

Will give it a test with borderlands 4 and ask if I've specced Amon correctly and let you know the results

 

[Dacvak]

I haven't tried this out, so I'm gonna guess it's not the implementation I'd actually want, but I'm all for optional AI note keeping in games.

I'd love to be able to come back to game I set down for a few months and ask an AI "hey, what were the last few things I did? … Ah right, and who was that again? Why was that important at this point?"

I don't need an AI to give me hints, but it would be amazing for it to answer referential questions I have.

I've been using an AI notetaker in all of my work meetings for about 9 months now, and it's been an absolute game changer. It takes better notes than even my human assistant. It's the exact perfect use case for AI, and I wouldn't mind if that aspect were applied to games.

 

[TBiddy]

Give it a few years and it'll be named Microsoft Gaming Copilot 365 for Xbox Cloud. A few more years and it'll disappear again.

 

[SomeNorseGuy]

I haven't tried this out, so I'm gonna guess it's not the implementation I'd actually want, but I'm all for optional AI note keeping in games.

I'd love to be able to come back to game I set down for a few months and ask an AI "hey, what were the last few things I did? … Ah right, and who was that again? Why was that important at this point?"

I don't need an AI to give me hints, but it would be amazing for it to answer referential questions I have.

I've been using an AI notetaker in all of my work meetings for about 9 months now, and it's been an absolute game changer. It takes better notes than even my human assistant. It's the exact perfect use case for AI, and I wouldn't mind if that aspect were applied to games.

That's actually a good use case. I shudder to think how many game-corpses I've left at the wayside because it's been weeks since I last played them and have no idea what I was doing. Some games give you a summary/notes when you load up, but most games figure you play it non-stop.

 

[Soodanim]

People were in an uproar about the always on, always reading AI that wasn't able to determine when on sensitive pages like banks. There's not a chance in hell I would trust MS to safely implement something like this to only activate in game.

That's if I even wanted anything like this, which I absolutely don't.

Looking forward to the programs that disable this along with everything else undesirable.

 

[Three]

Lost what? This is for Windows.

Lost gaming obviously. Games for Windows died, MS store is getting trounced by Steam, and xbox is doing poorly. Nobody is talking about office or Internet explorer here. Nobody wants this shit spying on them for little to no benefit just like nobody wanted Kinect for little to no benefit.

 

[Bert Big Balls]

Copilot can't even do the most basic of tasks within Outlook or teams, so I expect this to be a pile of flaming shit too.

 

[Barakov]

Now available through the Xbox Game Bar, Microsoft's new AI assistant reads your screen, tracks your play history, and offers real-time help.

Microsoft Gaming Copilot hits Windows in public beta — in-game AI overlay goes live for PC players

Now available through the Xbox Game Bar, Microsoft’s new AI assistant reads your screen, tracks your play history, and offers real-time help

www.tomshardware.com

Unlike past versions of Copilot integrated into Windows or Microsoft 365, Gaming Copilot is built with screen context and real-time game awareness. It reads from your Xbox account history, sees what you're playing, and can analyze screen content on demand to answer in-game questions. ​

There is also no mention of NPU acceleration, which would matter for players using Snapdragon X laptops or hybrid-core CPUs with on-device AI blocks. This will be a key testing point, particularly as Microsoft has framed the Copilot experience as optimized for new handhelds like the ROG Ally X.​

Anti-cheat compatibility is another open question. Vendors like Easy Anti-Cheat and BattlEye generally whitelist Game Bar itself, but Copilot is a more complex overlay, and Microsoft hasn't clarified whether any specific protections are in place.​

Gaming Copilot is now available for players aged 18 and older, in all regions except mainland China.

---

I get that we all want to be somewhat efficient when gaming but wouldn't these resources be better used for:

Article:

"Automatic Super Resolution (Auto SR) seamlessly integrates with Windows on a Copilot+ PC with a Qualcomm Snapdragon X processor to automatically enhance a set of existing games by default, and boosts frame rates while maintaining detailed visuals," explains Microsoft.

"Auto SR functions by automatically lowering the game's rendering resolution to increase framerate, then employs sophisticated AI technology to provide enhanced high-definition visuals. This results in a smoother, more detailed gaming experience."

Source: https://www.neogaf.com/threads/this-copilot-pc-gaming-feature-promises-steam-deck-level-performance-on-snapdragon-x-pcs.1671046/

Spoiler

 

[Ellis]

Absolutely no thank you. I don't even have Steam Overlay enabled. I'm not interested in this kind of stuff on PC. On console it's always more streamlined and works as it is natively part of the OS. They always seem to cause issues on Windows, from my experience. Mostly uneven frame pacing.

A simple Rivatuner OSD bar for the top few pixels of my display is more than enough. Temp, usage, and FPS. All I really need.

 

[willothedog]

Lost gaming obviously. Games for Windows died, MS store is getting trounced by Steam, and xbox is doing poorly. Nobody is talking about office or Internet explorer here. Nobody wants this shit spying on them for little to no benefit just like nobody wanted Kinect for little to no benefit.

lost gaming? Windows is the most used gaming platform outside of mobile (Android).

 

[Guilty_AI]

Thanks for reminding me to disable game bar

 

[winjer]

No thanks. I don't need more bloatware and spyware from Microsoft.
It would be nice if they started focusing on fixing Windows and their updates, instead of adding more and more crap.

 

[PlayStaytion]

I want that to beat all ps2 games.

 

[notseqi]

Nope. Getting any sort of input by my OS is an egregious invasion on my time and focus. And by design of my privacy.

 

[I collect VHS tapes]

Ah, intrusive in-game overlays.

Never change MS. This is why you lost.

Pretty sure MS won when it comes to OS (which is what this thread is about)

Crazy people forget that Microsoft owns the most successful operating system by a long shot. It makes them ridiculous money

 

[I collect VHS tapes]

Lost gaming obviously. Games for Windows died, MS store is getting trounced by Steam, and xbox is doing poorly. Nobody is talking about office or Internet explorer here. Nobody wants this shit spying on them for little to no benefit just like nobody wanted Kinect for little to no benefit.

What?

What OS do you think people PC game on?

 

[notseqi]

What?

What OS do you think people PC game on?

only 95% on W11 & W10

edit: sauce: https://store.steampowered.com/hwsurvey/steam-hardware-software-survey-welcome-to-steam

 

[Sgt.Asher]

"I see you're playing Expedition 33, would you like to try Avowed and other similar games? Get Gamepass today!"

 

[BlackTron]

lost gaming? Windows is the most used gaming platform outside of mobile (Android).

Imagine if everyone were using Android, but buying the apps/games to run on it from Apple instead of Google Play Store.

That's Microsoft with Windows. They won in having the OS to sell/license, not the content. Except now Windows is free.

So MS won monetizing your personal information, not gaming.

 

[Det]

While Xbox fanboys dream of HZD on Xbox, MS forgets about Xbox to run Copilot

 

[digimaster7]

I'm really curious what their AI reaction will be to some of the more degenerate adult gameson steam. Probably got locked and sanitized with "I can't answer that" or something

 

[lastmessiah]

As far as gaming overlays go, the Game Bar is actually the best I've ever tried.

 

[I collect VHS tapes]

While Xbox fanboys dream of HZD on Xbox, MS forgets about Xbox to run Copilot

Fyi horizon is out on pc which is what the thread is about

I think people forget that it came out on PC because of how poorly it did

No one wants Sony fp games bro

Meanwhile MS games on PS top the charts

 

[lastmessiah]

While Xbox fanboys dream of HZD on Xbox, MS forgets about Xbox to run Copilot

lol ain't no one dreaming of HZD anywhere.

 

[Three]

What?

What OS do you think people PC game on?

Obviously Windows but this is like saying Samsung Store Apps are awesome because most phones are samsung. Most people don't use that for Apps even if they are ultimately using a Samsung.

 

[I collect VHS tapes]

Obviously Windows but this is like saying Samsung Store Apps are awesome because most phones are samsung. Most people don't use that for Apps even if they are ultimately using a Samsung.

I'm saying it's a stretch to say it lost, just like it's a stretch to say Samsung lost in your example

 

[lastmessiah]

I'm saying it's a stretch to say it lost, just like it's a stretch to say Samsung lost in your example

Not to mention that Microsoft publishes some of the top selling games on Steam and PS. I guess that's losing (or "loosing", in the parlance of our times).

 

[Three]

I'm saying it's a stretch to say it lost, just like it's a stretch to say Samsung lost in your example

It's a stretch to say it's winning in gaming because of windows. Samsung is not "winning in applications" just because the majority of phones are Samsung either. Google is winning in gaming on mobile due to the Play store just as Valve is winning due to Steam on PC.

 

[I collect VHS tapes]

It's a stretch to say it's winning in gaming because of windows. Samsung is not "winning in applications" just because the majority of phones are Samsung either. Google is winning in gaming on mobile due to the Play store just as Valve is winning due to Steam on PC.

I never said they were winning you however, said they lost, which is what I'm responding to

Are me and you having a conversation or are you having a conversation with an imaginary person?

 

[TheStam]

Amazing how such a huge company can greenlight this shit. Nobody asked for it. As long something is magical AI it will get introduced and described as a success in the next quarterly report. Does anyone use Meta AI? Slack AI? Just feels like bloat

 

[Three]

I never said they were winning you however, said they lost, which is what I'm responding to

Are me and you having a conversation or are you having a conversation with an imaginary person?

So if they're not winning, what is the opposite of that? I wasn't the original poster that used the word "lost" but if there is a winner what are the others? Obviously nobody is talking about financial losses but losing to competitors. If you agree they didn't "win" what did they do?