Steam security issue revealed personal info to other users on XMas Day (fixed)

Valve handled this about as poorly as anyone could have.

I don't think they can continue having a company structure where people only do customer service and community management when they want to.

I mean, they really can, it just means they'll have abysmal customer service forever.

Valve's current situation is really the ultimate conclusion of all the absurd Silicon Valley nonsense about how code can change the world or whatever; it creates an environment (like Valve's) where programming is seen as valuable while "soft skills" (communications and marketing, sales, customer support, HR, operations) are seen as outdated and disposable. A successful company, even a tech-driven one, should not be lopsided towards engineering staff.
 
Well, this was certainly interesting how they handled this situation. Especially the not notifying people of this, and insincere statements, that their data was exposed, wow.
 
Never mind compensation, everyone is entitled to proper disclosure from Valve on what exactly happened and Valve should also not be acting like a breach of personal data isn't a big deal.
I agree completely.
Unfortunately in these situations it's hard to prove who was or wasn't compromised. It's why crediting everyone potentially affected is standard practice for Internet businesses.
I also agree, but if you are just joining in (not saying you are) and holding your hand out, it seems immoral. I do believe we should get credit monitoring, that is EXTREMELY fair. We may or may not be exposed now. But that could change.
Unless you're as dumb as your posts in this thread make you seem, odds are your private information is not out there on the Internet as this Steam information breach has exposed.

Identity theft is serious. BASELINE Valve should give every Steam user 1 year of identity theft protection from a good agency.
No need to name call bud.
 
Could have been a large Auth package update. Of course why would you push an update like that during very busy shopping time, I don't know.
An "auth package update" like what? OpenSSL? Still doesn't shed light on why they'd claim it is a "caching issue".

As far as I am concerned, the official word of "caching misconfiguration" does not match the results of what occurred today. And it especially doesn't fit with my working knowledge of how Akamai and Varnish work. I'm not saying I'm an expert. I'm not. But it's my business to know how these things work at my own job at a fairly large webhosting company.
 
Valve better be getting mountains of shit for this.

Fucking seriously. They've exposed how bad they are at managing situations like this. Couldn't give out a store wide warning or something? Instead we had to wait for gaming journos to get something of a statement? The fuck is up with that?

It's ridiculous and they have been given countless times to fix their communication, yet it's still "a process". The company structure needs a shakeup at some point, but nobody there wants that. If Gabe ever leaves the company, someone needs to really bring in some traditional PR/customer support wings.
 
No breakdown of why the hell they would plan to do this on Christmas day.

That's not gonna happen until they have a complete run-through of what they did wrong.

No promise to not pull this stupid shit again.

How can they promise something that isn't possible to "NEVER EVER EVER" promise? It could happen again. Does this mean it will? No. Though I agree that they should say they're gonna do better and try to make sure this won't happen again.

BlackJace said:
Methinks it's probably time for Valve to rethink their whole "free structure, collective agenda" angle in regards to how the company is run.

Shit, even outsourcing a customer service base would be better than their current attitude towards CS, no?

The problem is half their office structure and half their laize-fair attitude toward Steam as a client. They're making money hand-over-fist and don't need to rework the client (which needs to be updated from 32-bit to 64-bit for operating systems), they don't need to get better customer support. They don't need to... because they're making money and there's no "fire" under their ass to fix it.

If this breach does anything, it'll maybe get people to use GoG, Origin, Uplay (ugh at that one) more and untie their games from Steam to where publishers like Capcom will stop making Steam-only releases and thereby the Digital Distribution Platform wars will ignite again instead of Steam having a "monopoly"/stranglehold on the PC platform for most people.

EG: "Steam or bust" will die if people jump to other platforms.
 
An "auth package update" like what? OpenSSL? Still doesn't shed light on why they'd claim it is a "caching issue".

As far as I am concerned, the official word of "caching misconfiguration" does not match the results of what occurred today. And it especially doesn't fit with my working knowledge of how Akamai and Varnish work. I'm not saying I'm an expert. I'm not. But it's my business to know how these things work at my own job at a fairly large webhosting company.

No, like authentication and federation of users. Like how CDN service knows it's "Disaster Nebraska" and not "StereoVSN" before handling out pages. They associate some sort of identification with your account, process it through some sort of Rest/SOAP/SAML (if federating)/Whatever call and serve the content. Something could have broken here during an update.

Still does not explain why are they caching account details of course. Or like charlequin surmised below, it's not caching (or at least CDN type caching) that got borked but something else.
 
The problem is half their office structure and half their laize-fair attitude toward Steam as a client. They're making money hand-over-fist and don't need to rework the client (which needs to be updated from 32-bit to 64-bit for operating systems), they don't need to get better customer support. They don't need to... because they're making money and there's no "fire" under their ass to fix it.

If this breach does anything, it'll maybe get people to use GoG, Origin, Uplay (ugh at that one) more and untie their games from Steam to where publishers like Capcom will stop making Steam-only releases and thereby the Digital Distribution Platform wars will ignite again instead of Steam having a "monopoly"/stranglehold on the PC platform for most people.

EG: "Steam or bust" will die if people jump to other platforms.

GOG is the only emerging competitor to Steam. Origin and Uplay have a fraction of the userbase and don't cover enough games, besides their existence being mainly for publisher-specific games.
 
GOG is the only emerging competitor to Steam. Origin and Uplay have a fraction of the userbase and don't cover enough games, besides their existence being mainly for publisher-specific games.

GOG had their own dumbass moves that they've done over the years, like pretending they were shutting down to "prove" that DRM-free games are actually better.

Nothing quite like the magnitude of this thread though. I just wish we had a provider that was run like an actual company sometimes.
 
What I hate most about this is that it seems like the days of companies responding quickly and honestly are over. Every statement today is delayed for hours while it gets personally signed off by the company lawyers and the statement is always carefully worded to mitigate or denounce liability.

It takes too long to hear what happened and when we do get the official statement it reeks of half-truths, evasiveness, and lawyer speak.
 
GOG is the only emerging competitor to Steam. Origin and Uplay have a fraction of the userbase and don't cover enough games, besides their existence being mainly for publisher-specific games.

Exactly. And even then GoG doesn't get day-and-date with Steam-only releases. Guilty Gear: Accent Core got on the service like a month or three after the Steam release. Xrd isn't there (AFAIK). Capcom titles are hit and miss there.

Newer Releases aren't going on there due to the whole "DRM free." Which is where Valve has their strangle-hold. If the majority of games are on one-platform and aren't spread across others to where people can use whatever platform they want for the games they want... how is it gonna break Valve's stranglehold?
 
Not anymore. I used to be able to call up my email provider and get a password reset with just my personal details like I said before. Truth is not much is going to come out of this. And if it does it'll be a few isolated instances. They've gotten stricter with the way they handle password resets. But who knows, maybe theres some aging email provider that still does this somewhere out there. Every company is different.

True, maybe there are a few idiotic companies that may provide a new password over the phone, but most of your well-known email providers will not do this. Heck, you can't even call the popular free email providers for support. Seeing that most people use one of these providers, they should be mostly safe if they use some common sense in regards to security. Either way, Steam screwed the pooch today.
 
How do I know if I've been compromised? I have Steam Guard setup just in case something happens anyway so I'm wondering how to find out if someone got me. I found out about this and went to change my password quick as shit.

It's possible to buy me off with a greatly reduced Oculus VR.
 
No, like authentication and federation of users. Like how CDN service knows it's "Disaster Nebraska" and not "StereoVSN" before handling out pages. They associate some sort of identification with your account, process it through some sort of Rest/SOAP/SAML (if federating)/Whatever call and serve the content. Something could have broken here during an update.

Still does not explain why are they caching account details of course. Or like charlequin surmised below, it's not caching (or at least CDN type caching) that got borked but something else.
Ohh right right. I asked this earlier, but I think you and I are pointing out the same thing: why is session data and/or query results getting passed to IPs that didn't request them?

Caching can be done on the server, for what it's worth.

I don't believe it's some sort of passive update to non-proprietary systems that Valve might be using. First thing I did was check my work email to see if there'd been any forced updates to stuff like Varnish, OpenSSL, Nginx, etc.

Nothing.
 
Oh wow at that response... not even a hint of an apology. I really hope they catch shit as much as possible for what happened today.
 
I mean, they really can, it just means they'll have abysmal customer service forever.

Valve's current situation is really the ultimate conclusion of all the absurd Silicon Valley nonsense about how code can change the world or whatever; it creates an environment (like Valve's) where programming is seen as valuable while "soft skills" (communications and marketing, sales, customer support, HR, operations) are seen as outdated and disposable. A successful company, even a tech-driven one, should not be lopsided towards engineering staff.

Don't worry about that, Silicon Valley is busy trying to commoditize programmers too, so we become just as disposable as anyone else. How many times have you heard the phrase from Silicon Valley bigwigs that there's not enough programmers to hire? You even have Mark Zuckerberg trying to turn for-profit prisons into coding sweatshop houses.
 
Anybody got a link to Valve's official response? I've been out of the loop the last few hours since the initial occurance and shut down with X-mas stuff.
 
I haven't used Steam in about a day and a half, so I doubt my info was ever presented in the cache errors, but I'm still very unhappy.

The problem with this, is that Steam is basically a necessity of PC gaming if you want a lot of games, unless you use other resellers that are probably using stolen keys which just hurts developers and are probably Steam keys anyways.

So people who prefer this platform, are basically stuck with this service.Except this is, what, the 3rd security failure in a year now?

I mean it's asinine. How incompetent can you be? So what about the poor fellow who was on the google cache page for multiple posters here repeatedly? What do they get? A completely non-reply downplay of the entire incident.

I just want to know I can use the service without fear of my account being compromised, my games disappearing, and my personal information that is required by them to be kept safe. I'm not getting that though. I'm basically getting a metaphorical gun to my head to continue using their service because it's the only viable one for my platform of choice, and that's real shitty.

If the argument was "It was Christmas and we wanted most of our staff to be with their families" then shut the damn site down if you can't run it correctly. We'll live with just minimal access to games and you'll live without lining your pockets. It would have been better than this bullshit happening, again.
 
Threads like this the op is never updated causing a steady stream of people popping in asking already answered questions because they don't want to read 50+ pages.

I'll do my part to add to the noise: where can I read Valve's response, and are they letting the affected users know they were the affected users?
 
Every statement today is delayed for hours while it gets personally signed off by the company lawyers and the statement is always carefully worded to mitigate or denounce liability.

I'm not sure if this is the class I exactly took (also related course to it) but it is the same instructor for the MOOC on Information Security I did earlier this year (in May) that goes over this sort of deal. I'm forgetting the exact reasoning, but there's a chain of command in regards to information loss for security plans.

With that being said, I don't think Valve has a CISO in some regards otherwise there would be plans for something like this and the whole "shut it down" would've happened somewhat sooner with a bit better response (hopefully. If they do have a CISO: EEK!)

Anyone that is steamed (heh, pun not intended) about this should look into Information Security practices and why CISO's make plans and why HIPAA is a law, etc.
 
Some of you really need to just use Google for the response.

http://kotaku.com/steam-goes-nuts-offers-access-to-other-peoples-account-1749718979

"Steam is back up and running without any known issues. As a result of a configuration change earlier today, a caching issue allowed some users to randomly see pages generated for other users for a period of less than an hour. This issue has since been resolved. We believe no unauthorized actions were allowed on accounts beyond the viewing of cached page information and no additional action is required by users."
 
I haven't used Steam in about a day and a half, so I doubt my info was ever presented in the cache errors, but I'm still very unhappy.

The problem with this, is that Steam is basically a necessity of PC gaming if you want a lot of games, unless you use other resellers that are probably using stolen keys which just hurts developers and are probably Steam keys anyways.

So people who prefer this platform, are basically stuck with this service.Except this is, what, the 3rd security failure in a year now?

I mean it's asinine. How incompetent can you be? So what about the poor fellow who was on the google cache page for multiple posters here repeatedly? What do they get? A completely non-reply downplay of the entire incident.

I just want to know I can use the service without fear of my account being compromised, my games disappearing, and my personal information that is required by them to be kept safe. I'm not getting that though. I'm basically getting a metaphorical gun to my head to continue using their service because it's the only viable one for my platform of choice, and that's real shitty.

If the argument was "It was Christmas and we wanted most of our staff to be with their families" then shut the damn site down if you can't run it correctly. We'll live with just minimal access to games and you'll live without lining your pockets. It would have been better than this bullshit happening, again.

It's only like this because we made it that way. How many times have I heard "I won't buy it unless it's on steam." - "It's so convenient to have all my games under one platform."

Having been PC gaming since the 80s, how can we accept this? Have we really become so lazy that an extra mouse click is too high a usability gap to navigate? I remember having to make specific boot disks for games because I needed that extra 4 KB of high memory out of 640kb to make the game work!

When you hand essentially monopoly powers to one service, even a benevolent one, they get complacent, and there's no innovation. Why should they? You're never going to leave them - it's like a relationship with an abusive spouse. I have games across multiple platforms, console, PC, handheld, mobile - I don't consider it a hurdle too difficult to get myself out of my chair and go to a different chair to use a different gaming system. Why should it be the same on one machine?
 
I didn't go to the store while it was happening (or log into the client), but I did go to my user profile page directly in my web browser at the time (didn't go to any other page on the website). I did change the password to my email and Steam account, but now I'm wondering if I should change the email address on my account. =/
 
So I checked my Steam account all paranoid about my details and shit only to find out someone had removed them for me

thanks whoever that was :") i'm still going to be checking my account balance and email every day but that was a pleasant surprise
 
You say "if you break the cache keying somehow" like it's a normal thing. For that to happen, it would be a failure on multiple points in the server, not just caching. There's still the basic security and redundancies that prevent session data or request results being passed from one requesting IP to a completely different one.

Furthest from home, the CDNs being used to serve out Steam's site will (as all CDNs do) respect the HTTP caching headers sent by Valve's origin server(s) and set their behavior accordingly. If you check the main HTML page of any part of their site, it's got the header "Cache-Control: no-cache," while the static resources have headers like "Cache-Control: public, max-age=10516517" (to indicate a page can be cached until a certain amount of time has passed) or "ETag: "XwLMvvR6Hpnl"" (to indicate that the page can be cached until that tag changes.) The correct configuration for a dynamic app with personalized content would generally be to disallow caching of any page with said personalized content, so that each user is pulling fresh from the original server. If something caused the static-asset headers to apply to the application servers, you'd see (correctly configured) CDNs happily caching and re-serving individual users' content to other users. (I was part of a team that broke a company's website -- which luckily had no personalized or sensitive information -- with exactly this sort of change, once upon a time.)

Closer to Valve's side. they're using a reverse-proxy layer to cache and transform content coming out of their application (the Varnish headers are visible in their served pages.) If they're like many people running large, complex apps, they don't just use an out-of-the-box config; they rely on their reverse-proxy layer (or layers) to retag, streamline, encode, and otherwise transform their content before it hits the public CDNs as well as to provide a caching layer. With the complexities available in Varnish's configuration one can certainly accidentally apply a caching change to pages that shouldn't have it.

Past all that, they most likely also make heavy usage of data caching inside their application. To avoid churning whatever ginormous databases they store all this info in, they probably have some cluster of Redis servers or somesuch which store copies of application data, keyed to unique identifier strings, and only replace it when told to. When a user brings up their Account page, it might create a key that's something like "Steam::Community::ServerId-1234::Account::UserId-4567::Summary" that indicates exactly what information is being pulled, and includes all the key distinguishing features (like which user's data it is) so that the cached data is only used for the right user, and if the application hasn't sent a command to clear out that cache key. This sort of thing is very easy to break if you aren't looking out for it. It can be something as simple as a botched type conversion on the user ID field -- now all of a sudden your app might be saving and reading from "UserId-0" or "UserId-#ERR?" or something, resulting in every user triggering a read from the same cached record.

We don't have enough information on hand to know which, if any, of these things happened (or whether one of a number of similar possible issues occurred instead), but the behavior we saw today is very much indicative of a failure of caching logic somewhere in an application.
 
Some of you really need to just use Google for the response.

http://kotaku.com/steam-goes-nuts-offers-access-to-other-peoples-account-1749718979

"Steam is back up and running without any known issues. As a result of a configuration change earlier today, a caching issue allowed some users to randomly see pages generated for other users for a period of less than an hour. This issue has since been resolved. We believe no unauthorized actions were allowed on accounts beyond the viewing of cached page information and no additional action is required by users."

That was posted in this thread very quickly after it went up at Kotaku. Most of the posts asking for a response came long before Kotaku got that statement.
 
Threads like this the op is never updated causing a steady stream of people popping in asking already answered questions because they don't want to read 50+ pages.

I'll do my part to add to the noise: where can I read Valve's response, and are they letting the affected users know they were the affected users?

Well...uh...they...turned off the servers once for a bit? Are you reassured?
 
Again, unequivocally false.

You don't give away your account name over Steam in order for someone else to add you. Users send their publicly available profile name, and they add you through there. Your account name is never exchanged for adding to your friends list or playing with other people.

I see. Thanks for the correction. I had no idea the account name was a private identifier that was completely separate than the public username. I thought the profile name was just a displayed thing and you still needed to add someone via their username.

So I haven't read all 30 pages that I missed during the day, but I saw the edits to the OP claiming there was no evidence of compromised CC info. So what's with the people saying they had suspicious transactions on their credit card? Unrelated, or Valve giving us BS platitudes?
 
Some of you really need to just use Google for the response.

http://kotaku.com/steam-goes-nuts-offers-access-to-other-peoples-account-1749718979

"Steam is back up and running without any known issues. As a result of a configuration change earlier today, a caching issue allowed some users to randomly see pages generated for other users for a period of less than an hour. This issue has since been resolved. We believe no unauthorized actions were allowed on accounts beyond the viewing of cached page information and no additional action is required by users."

Maybe you should read the thread?

Also its awesome we have to google for a 3rd party source for an update to a breach of a client with tens of millions of concurrent users. If only they had their own site or client to push notices.

Yeah, totally acceptable. The whole point is people want an statement straigt from the horses mouth about this, and for them to address it with the level of severity it deserves.
 
Shit like this and my poor customer experience with MS is why i've never store credit card information on anything on the internet anymore.

It's why even though it's a pain in the ass, I always just use pre-paid cards now for everything.
 
It's why even though it's a pain in the ass, I always just use pre-paid cards now for everything.

Yep. And I get un-reloadable credit/gift cards to use on Amazon (since you can't apparently delete your card information there unless I'm missing something). Someone breaches my account, good luck buying anything from an empty wallet. Bitch.
 
So I haven't read all 30 pages that I missed during the day, but I saw the edits to the OP claiming there was no evidence of compromised CC info. So what's with the people saying they had suspicious transactions on their credit card? Unrelated, or Valve giving us BS platitudes?

Unverified, or unrelated.

Maybe you should read the thread?

Also its awesome we have to google for a 3rd party source for an update to a breach of a client with tens of millions of concurrent users. If only they had their own site or client to push notices.

Yeah, totally acceptable. The whole point is people want an statement straigt from the horses mouth about this, and for them to address it with the level of severity it deserves.

I saw people asking for Valve's response. That's Valve's response. I'm not commenting on if it's ok or not to respond through this way.

Yep. And I get un-reloadable credit/gift cards to use on Amazon (since you can't apparently delete your card information there unless I'm missing something). Someone breaches my account, good luck buying anything from an empty wallet. Bitch.

Go to Your Account > Manage Payment Methods and there should be ways to remove information from there.
 
Yep. And I get un-reloadable credit/gift cards to use on Amazon (since you can't apparently delete your card information there unless I'm missing something). Someone breaches my account, good luck buying anything from an empty wallet. Bitch.

You can delete your info off Amazon. However if I make a purchase on anything that would force me to use a credit/debit card, I always delete it off the account immediately if it ever gets saved.

That one really horrible experience taught me that nobody's shit is safe on the internet.
 
Unverified, or unrelated.



I saw people asking for Valve's response. That's Valve's response. I'm not commenting on if it's ok or not to respond through this way.

My bad. Looked like a drive by defense post from first read. My point still stands that it is barely a response. They don't even say they're investigating. It's very upsetting as someone with thousands of dollars vested in Valve and steam.
 
This seems about as low on the Richter scale as it can be at this point. Disclosure of non regulated personal data. Can't imagine anything else will come of this, unless we find out there was fraud involved.
 
Furthest from home, the CDNs being used to serve out Steam's site will (as all CDNs do) respect the HTTP caching headers sent by Valve's origin server(s) and set their behavior accordingly. If you check the main HTML page of any part of their site, it's got the header "Cache-Control: no-cache," while the static resources have headers like "Cache-Control: public, max-age=10516517" (to indicate a page can be cached until a certain amount of time has passed) or "ETag: "XwLMvvR6Hpnl"" (to indicate that the page can be cached until that tag changes.) The correct configuration for a dynamic app with personalized content would generally be to disallow caching of any page with said personalized content, so that each user is pulling fresh from the original server. If something caused the static-asset headers to apply to the application servers, you'd see (correctly configured) CDNs happily caching and re-serving individual users' content to other users. (I was part of a team that broke a company's website -- which luckily had no personalized or sensitive information -- with exactly this sort of change, once upon a time.)

Closer to Valve's side. they're using a reverse-proxy layer to cache and transform content coming out of their application (the Varnish headers are visible in their served pages.) If they're like many people running large, complex apps, they don't just use an out-of-the-box config; they rely on their reverse-proxy layer (or layers) to retag, streamline, encode, and otherwise transform their content before it hits the public CDNs as well as to provide a caching layer. With the complexities available in Varnish's configuration one can certainly accidentally apply a caching change to pages that shouldn't have it.

Past all that, they most likely also make heavy usage of data caching inside their application. To avoid churning whatever ginormous databases they store all this info in, they probably have some cluster of Redis servers or somesuch which store copies of application data, keyed to unique identifier strings, and only replace it when told to. When a user brings up their Account page, it might create a key that's something like "Steam::Community::ServerId-1234::Account::UserId-4567::Summary" that indicates exactly what information is being pulled, and includes all the key distinguishing features (like which user's data it is) so that the cached data is only used for the right user, and if the application hasn't sent a command to clear out that cache key. This sort of thing is very easy to break if you aren't looking out for it. It can be something as simple as a botched type conversion on the user ID field -- now all of a sudden your app might be saving and reading from "UserId-0" or "UserId-#ERR?" or something, resulting in every user triggering a read from the same cached record.

We don't have enough information on hand to know which, if any, of these things happened (or whether one of a number of similar possible issues occurred instead), but the behavior we saw today is very much indicative of a failure of caching logic somewhere in an application.
Why wouldn't the servers response simply return with a "bad header or session data" error, then?

Though I do see how what you've described could cause this, seems like they either have an extremely modified build of Varnish or bad site code. Typically you're not going to be able to change a few lines in a config file to create this sort of behavior.
 
And people wonder why I still prefer physical gaming...

Because your personal information you put into a retailers register wouldn't be compromised, right?

Oh wait! Anywhere you give out personal information, wither online or off is a risk.
 
Top Bottom