Support NeoGAF

[IbizaPocholo]

Microsoft Patent Could Lead to AI-Composed Video Game Soundtracks

Microsoft files a patent for a highly ambitious AI system that can compose audio scores for movies, games, and more.

gamerant.com

Microsoft has filed a patent on WIPO IP Portal titled "ARTIFICIAL INTELLIGENCE MODELS FOR COMPOSING AUDIO SCORES." Microsoft is inventing an intelligent audio composing technology for creating sounds, music and other audio elements for all sorts of media like movies, TV shows, games, and even live recordings. The patent mentions dynamic moments in games, suggesting that it could create scores that change to fit in with the player's actions. The abstract for the patent states that parameters can be set using visual, audio, and textual features and prompts (collectively termed as 'Dataset') to instruct the multitude of AI models construct audio scores.

The recent advent of AI has been revolutionary and has crossed with multiple disciplines of art and media. Although more than a few AI tools for audio generation have been released already, Microsoft's latest patent seems to suggest that their proprietary AI model ecosystem will be the most comprehensive and advanced system of machine assisted audio creation till date.

The patent description goes into detail about the multitudes of AI engines which are tasked to perform the audio scores in accordance to the provided datasets. They can analyze human expressions and sentiments, collect location data, analyze the tone of the situation and much more. The AI can learn about pictures, videos, films, live events and produce a set of audio files that can layer the visuals with appropriate sound effects and music. This hi-tech AI can open up many exciting avenues for media creation. One can produce films, games, etc. with a huge library of every growing audio scores. Designing an epic orchestral piece for the hero's entrance, composing a melancholic tune for the passing of a pet, developing sound effects for gunfire and explosions; all of these can be entrusted to the AI's algorithm. As a side effect, the composers and sound designers might face some competition.

 

[adamsapple]

AI's can paint some gnarly shit, would be interesting to see how they work on generating audio.

 

[feynoob]

Can any of these companies chill out with these grim future patents?

 

[baphomet]

In case you weren't aware, ALL of the big boys are working towards AI generating as much of a game as possible.

 

[SlimeGooGoo]

.

 

[SlimeGooGoo]

.

 

[StreetsofBeige]

So would this be MS using the AI to create tunes for the game (which everyone gets the same music per siatuation), or the AI is smart enough to make it's own music on the fly and each gamer can get their own random AI music?

 

[baphomet]

So would this be MS using the AI to create tunes for the game (which everyone gets the same music per siatuation), or the AI is smart enough to make it's own music on the fly and each gamer can get their own random AI music?

They wouldn't put it in game without a human verifying the quality of the generated music beforehand.

 

[ShadowLag]

Patent? They're a little bit late to the party

 

[Punished Miku]

I would like to hear an AI push metal music to new heights of complexity.

 

[Tripolygon]

Patent? They're a little bit late to the party

There are several ways to do something. You can patent your own method of doing said thing.

 

[killatopak]

knowing how AI currently works. It'll just be a mishmash of popular tunes of the genre with wonky stuff that's a tell tale sign of AI creation.

 

[cyberheater]

In case you weren't aware, ALL of the big boys are working towards AI generating as much of a game as possible.

Yeah. A.I. is the future of content creation.

 

[StreetsofBeige]

Patent? They're a little bit late to the party

I dont listen to this kind of music, so I cant tell how good this is compared to musicians doing it, but from hearing the first 4 songs in the first 10 minutes, it seemed good enough for me.

 

[Mr Reasonable]

Ai music as noted has been on the way for a long time, it will be on something you play in the next ten years, I'm sure.

You can already license AI music for your advert, podcast, etc.

What's of concern is this:

seemed good enough for me

Good enough is one thing, but great is another and as time passes, will good enough become an aim for cost saving purposes for the media we consume?

On the other hand if it's good enough, we might never notice, I suppose.

Either way, good luck composers, get ready for some work to disappear and for pressure on your budgets to increase.

 

[PillsOff]

Modern soundtracks are mostly uninspired shit anyway

 

[Jet Set Willy]

Modern soundtracks are mostly uninspired shit anyway

Then play some indies!

Incredible soundtracks there in recent years, from Celeste to Hollow Knight to Tunic to Death's Door. Outside of Nier Automata, I think all my favourite soundtracks in the last decade are from indie games.

 

[Venom Snake]

This is a god-awful idea.

 

[Stare-Bear]

Yes, bring back Microsoft Songsmith!

 

[NeoIkaruGAF]

Can't wait for the Twitter shitstorm between id and the AI that makes the music for the next Doom.

 

[winjer]

I think EA is already using AI to make their soundtracks
Just listen to this crap.

 

[hyperbertha]

Ai written stories, ai modeled environments and characters, ai composed music. I wonder how many people would be willing to play this abomination? If my estimate of normies is any indication, plenty of them.

 

[deriks]

Can't see this going good, but that is kinda funny when you think the whole Mick Gordon stuff

 

[Banjo64]

I’m sure this will produce memorable soundtracks full of heart…

 

[BabyYoda]

Modern day AAA game ost are often so generic and uninspired nowadays, I doubt we'd notice the difference, the same for most big budget movies and tv shows.

 

[nial]

Western devs can't compose music, so whatever, same crap.

My japanese weaboo games wil remain with their superior music composed by actual humans.

both are below average all vidya ost is

 

[hyperbertha]

both are below average all vidya ost is

nah deus ex and nier soundtrack destroys.

 

[brian0057]

Western devs can't compose music

Michael McCann, Amon Tobin, Jesper Kyd, Sam Hulick, and Eric Brosius rank among the greatest composers in the history of the medium.

 

[Magic Carpet]

As long as they don't use the AI the Japanese Anime industry uses on Every anime opening the past decade or more. All anime opening music sounds the same.

 

[PontiusFeeb]

No. People have been trying to use AI to compose music for a while now, and none of it sounds good. Also, it’s terrible that any government would grant them a patent for such a generic idea.

 

[The_Mike]

Damn Mick Gordon has set on an avalanche lol.

I think EA is already using AI to make their soundtracks
Just listen to this crap.

Within the first few seconds it was like hearing that hideous Harry Potter flute meme.

Couldn't hear the rest because I was busy stabbing myself in the ears.

 

[TheDreadLord]

I think this is great. Many artists are over paid and it is leveling the whole industry to a lower standard. The real great artists will still have their space while the mediocre ones will need to fight for what is left.

 

[It's all in the wrist]

I think this is great. Many artists are over paid and it is leveling the whole industry to a lower standard. The real great artists will still have their space while the mediocre ones will need to fight for what is left.

It's only great if it doesn't sound like uninspired shit.

And since it's AI, it'll be uninspired shit.

 

[TheDreadLord]

It's only great if it doesn't sound like uninspired shit.

And since it's AI, it'll be uninspired shit.

Mediocre artists will also compose uninspired shit, so it is more efficient to no spend money on them.

 

[intbal]

Looking forward to the day when we can have AI-run corporations and all CEOs are put to work in the mail room.

 

[chromhound]

 

[Knightime_X]

This is a god-awful idea.

Not really.
AI will in inevitably blow the doors off anything a human can do.
AI is kinda like putting everyone's knowledge together and doing its own thing that can be steered.
If its not good now, wait and it'll be better than godlike later.
ai takes time

 

[adamsapple]

 

[Venom Snake]

Not really.
AI will in inevitably blow the doors off anything a human can do.
AI is kinda like putting everyone's knowledge together and doing its own thing that can be steered.
If its not good now, wait and it'll be better than godlike later.
ai takes time

...and we all gonna just sit and watch, i get it. We will unreflectively rely on artificial intelligence because ours will no longer be sufficient enough to create anything.

It's nice to hear slogans like "don't work harder, just smarter", but anyone with more than the minimum of life experience knows that this is not entirely true.
I come from an environment that values freedom of expression in the creative process. Yes, it takes time. Yes, it takes effort. But at the same time it gives meaning to what you do and who you are. As someone who loves music, i can't imagine the role of an artist being limited to creating mere audio banks, in a way that allows A.I. efficient editing possibilities.

There are better areas where such algorithms could help musicians in their work (mixing, detection and elimination of artifacts, more effective matching of sound parameters to room acoustics, etc.).

 

[rofif]

AI's can paint some gnarly shit, would be interesting to see how they work on generating audio.

Yeah ai paintings are crazy.
But at the same time there are tons of people who want and love to do this. Ai is still only based of these works

 

[StreetsofBeige]

I think EA is already using AI to make their soundtracks
Just listen to this crap.

I dont think the first music AI program in alpha mode version 1.0 with zero QA could produce music as bad as 2042. I'd bet my 10 year old nephew could put together something better on his electric keyboard with built in tempo and beats.

For good laughs gaffers, find thrh Angry Joe 2042 review where in the middle of it he listens to it.

 

[Knightime_X]

...and we all gonna just sit and watch, i get it. We will unreflectively rely on artificial intelligence because ours will no longer be sufficient enough to create anything.

It's nice to hear slogans like "don't work harder, just smarter", but anyone with more than the minimum of life experience knows that this is not entirely true.
I come from an environment that values freedom of expression in the creative process. Yes, it takes time. Yes, it takes effort. But at the same time it gives meaning to what you do and who you are. As someone who loves music, i can't imagine the role of an artist being limited to creating mere audio banks, in a way that allows A.I. efficient editing possibilities.

There are better areas where such algorithms could help musicians in their work (mixing, detection and elimination of artifacts, more effective matching of sound parameters to room acoustics, etc.).

You can always infuse ai with your own work as well.

 

[Venom Snake]

You can always infuse ai with your own work as well.

I don't think that -apart from pure curiosity or temporal lack of inspiration- i need any interference of something that does not have and will never have any idea what music means for a human being.

 

[SHA]

Can AI always match our tastes ? , I don't think so , see , the human element still there to understand our reactions , can't think of ai more than a bunch of short audio files for every object in the game , the boring part to be precise.

 

[recursive]

AI's can paint some gnarly shit, would be interesting to see how they work on generating audio.

It will be interesting but I can't help but think that the very best video game music is very often touched by emotion which will be a hard thing to replicate in AI. I suppose it will depend on the game.

 

[YukiOnna]

As long as this doesn't set foot in Japan, I'm good. I don't agree with this at all on a fundamental level though.

 

[Tg89]

Shit idea. But MS hasn't had a memorable soundtrack since Halo 1 anyhow.

 

[Knightime_X]

I don't think that -apart from pure curiosity or temporal lack of inspiration- i need any interference of something that does not have and will never have any idea what music means for a human being.

Ai doesn't know anything about art yet stable diffusion, dall-e , etc. Exists with incredible works.

Might not mean anything to you, but probably everything to someone who wants to express themselves but lack the talent, money, and means.

 

[Venom Snake]

Ai doesn't know anything about art yet stable diffusion, dall-e , etc. Exists with incredible works.

Might not mean anything to you, but probably everything to someone who wants to express themselves but lack the talent, money, and means.

I'm fine with it as long as it suits your need for expression. Sure, why not.

But if you want to sell a product and be absolutely sure that it will meet the required criteria - hire an artist. Quality never comes cheap and shouldn't come cheap.

 

[ScHlAuChi]

Microsoft even released a sample to demonstrate it: