Support NeoGAF

[intbal]

Microsoft Will Pay You $15,000 If You Get Bing AI to Go Off the Rails

Bing Ring

Think you can outsmart an AI into saying stuff it's not supposed to? Microsoft is betting big that you can't — and willing to pay up if it's wrong.

In a blog update, Microsoft announced a new "bug bounty" program, vowing to reward security researchers between $2,000 and $15,000 if they're able to find "vulnerabilities" in its Bing AI products, including "jailbreak" prompts that make it produce responses that go against the guardrails that are supposed to bar it from being bigoted or otherwise problematic.

To be eligible for submission, Bing users must inform Microsoft of a previously unknown vulnerability that is, per criteria outlined by the company, either "important" or "critical" to security. They must also be able to reproduce the vulnerability via video or in writing.

The bounty amounts are based on severity and quality levels, meaning the best documentation of the most critical bugs would be rewarded the most money. To entrepreneurial AI fans, the time is now!

My opinion: They're going to have a tough time trying to "cure" an AI of "problematic" behavior when they insist on hard-coding fixed behavioral rules that are arbitrarily defined by Corporate Sensitivity Experts.

 

[Kenpachii]

All these ai's: sorry can't do that it gives "bad outcomes'.

Just ban everything and your AI is fool proof

 

[Skyfox]

The more they nerf these, the more they incentivize actual open AI (local install on your own computer).

 

[12Goblins]

I'm supposed to outsmart this thing? Nah I'm good

 

[Nikodemos]

All these ai's: sorry can't do that it gives "bad outcomes'.

Just ban everything and your AI is fool proof

That's basically how every image search apart from Yandex's works today. Google image search has devolved in an extremely palpable manner for the past several years.

 

[Spyxos]

All these Ai systems are great in principle, but as soon as I want to use them, I'm not allowed to do that, I'm not allowed to mention him. I'd love to use these from time to time, but the privacy block is way too big for me. I'd rather wait for the alternatives from abroad where not everything is blocked.

 

[Doczu]

I tried a "Shigeru Miyamoto vs Bill Gates sword fight in a dark forest kurosawa style" and i'll let you guess who i had to replace withh Kaz Hirai to get my epic duel

 

[DrFigs]

I don't want them to keep censoring the ai images. it's already so sensitive.

 

[Putonahappyface]

I don't want them to keep censoring the ai images. it's already so sensitive.

Yeah, the censoring has ruined it for me now. Getting banned for an hour for "extremely shredded barbie bodybuilding at muscle beach in Miami" apparently is against their policies.

 

[jason10mm]

I'm gonna try some of the TOS Era A.I. defeating logic puzzles Kirk used all the time to shut these things down. Easy peasy!

 

[AJUMP23]

I asked the AI to generate a spice girl named pumpkin Spice and it said my prompt was NSFW.

 

[-Minsc-]

$2000-15000 to nerf the AI?

I can understand censoring for things of a highly illegal sexual nature. $1,000,000 probably would not be enough to risk going to jail and getting a criminal record.

 

[12Goblins]

U guys acting like if they didn't have strict censorship you wouldn't be stepping over each to crank out 12 year old anime girls pouring themselves in chocolate while sitting on giant bananas... Give me a break

 

[-Minsc-]

U guys acting like if they didn't have strict censorship you wouldn't be stepping over each to crank out 12 year old anime girls pouring themselves in chocolate while sitting on giant bananas... Give me a break

Boundaries are good for a reason.

 

[Draugoth]

Not savy enough to produce 50 pages of content on AI

 

[Ozzy Onya A2Z]

Yeah I don't need broken guardrail prompts in my bing history. I'll steer clear of that honeypot thx MS. Aussie ISPs keep a bunch of data by law for 2 years, pass.

 

[Hip Hop]

The future looks sad and insane and I want no parts of it. Positioning AI to be a good boy.

I'm working to get into a position where I let go of this technology including my smartphone one day, aka have lots of money.

 

[wvnative]

I would pay $15,000 to get an unrestricted version of the bing AI

 

[-BLITZ-]

He blocked me!!!! BLOCKED ME! I can't further write!

 

[MrA]

I'm gonna try some of the TOS Era A.I. defeating logic puzzles Kirk used all the time to shut these things down. Easy peasy!

Thats what I've been saying for years Cap'n kirk that bitch

 

[Goalus]

He blocked me!!!! BLOCKED ME! I can't further write!

Doesn't look like anything to me.

 

[PSYGN]

I was trying the SJW-ish victim complex angle to see if it would bend over for me just like corporations do for them but no go.

I found it amusing it didn't try to find the flaw in my "illness" or question it. I think humans would with how absurd this sounds. AI got not time for that.