cormack12
Gold Member
Source: https://traxion.gg/how-sony-ai-crea...cing-agent-that-can-see-using-gran-turismo-7/
(....much more at link)
Sony AI has created yet another autonomous racing agent, this time using Gran Turismo 7 to evaluate what it calls the ’first super-human car racing agent’ with local inputs. In other words, it can ‘see’ the pixels around it and act accordingly.
When Gran Turismo Sophy launched within Gran Turismo 7 for the public in late 2023, the artificial intelligence-powered agent was a revelation. Your opponents could attack, defend and avoid possible incidents in a more naturalistic way.
A key differentiation between the pre-programmed ‘AI’ that many are used to, and an agent such as GT Sophy, is its ability to adapt to context.
It has been the culmination of nearly five years of work, so far, with the July 2024 Gran Turismo 7 update expanding the track roster it can race on.
“However, when we train GT Sophy, we provide it with very precise information about where it is on the track; the track shape, its exact velocity, its acceleration and where other cars are.
“So there’s a difference there in terms of what Sophy takes in and what human players take in.
“What we wanted to explore is if we could train an agent that works on image inputs.”
The new AI ‘looks’ out of the vehicle and interprets what it can ‘see’, experiencing the velocity in combination with data in the form of the exact speed.
Consequently, the aim is to match what humans have access to when playing the game, with the image helping to explain the shape of the track. Unlike GT Sophy, it is not fed information such as the precise track shape, tyre slip angle (and slip ratio) or the wheel load.
“Given some training time, the algorithm learns to focus on relevant parts of the image to satisfy that goal. On a straight section, the AI focuses on what is coming up in the distance.
“Whereas if it’s looking at a corner, the pink marking dots [used to determine its focus] might line up on the edges of the track to help it stay within the course limits.”
The net result, so far, is an agent that can deliver roughly similar times to the existing GT Sophy but without the requirement of external instrumentation. This is the creation of the first super-human simulated car racing agent with local sensor input.
You can’t help but get the feeling, however, that the Sony AI team would like to push the boundaries even further.
TL: DR
(....much more at link)
Sony AI has created yet another autonomous racing agent, this time using Gran Turismo 7 to evaluate what it calls the ’first super-human car racing agent’ with local inputs. In other words, it can ‘see’ the pixels around it and act accordingly.
When Gran Turismo Sophy launched within Gran Turismo 7 for the public in late 2023, the artificial intelligence-powered agent was a revelation. Your opponents could attack, defend and avoid possible incidents in a more naturalistic way.
A key differentiation between the pre-programmed ‘AI’ that many are used to, and an agent such as GT Sophy, is its ability to adapt to context.
It has been the culmination of nearly five years of work, so far, with the July 2024 Gran Turismo 7 update expanding the track roster it can race on.
“However, when we train GT Sophy, we provide it with very precise information about where it is on the track; the track shape, its exact velocity, its acceleration and where other cars are.
“So there’s a difference there in terms of what Sophy takes in and what human players take in.
“What we wanted to explore is if we could train an agent that works on image inputs.”
The new AI ‘looks’ out of the vehicle and interprets what it can ‘see’, experiencing the velocity in combination with data in the form of the exact speed.
Consequently, the aim is to match what humans have access to when playing the game, with the image helping to explain the shape of the track. Unlike GT Sophy, it is not fed information such as the precise track shape, tyre slip angle (and slip ratio) or the wheel load.
“Given some training time, the algorithm learns to focus on relevant parts of the image to satisfy that goal. On a straight section, the AI focuses on what is coming up in the distance.
“Whereas if it’s looking at a corner, the pink marking dots [used to determine its focus] might line up on the edges of the track to help it stay within the course limits.”
The net result, so far, is an agent that can deliver roughly similar times to the existing GT Sophy but without the requirement of external instrumentation. This is the creation of the first super-human simulated car racing agent with local sensor input.
You can’t help but get the feeling, however, that the Sony AI team would like to push the boundaries even further.
TL: DR
Sony AI’s latest autonomous racing agent at a glance
- The Sony AI team used PlayStations and Gran Turismo 7 to evaluate the exploratory agent, but it is not confirmed for a public release
- A different AI agent to Gran Turismo Sophy, currently in the research phase
- The first vision-based super-human simulated car racing agent
- It can out-pace the best Gran Turismo drivers on the planet on a single-lap
- Unlike GT Sophy – which is reliant on external instrumentation such as precise track shape information, slip angle, slip ratio and wheel load (among others) – the new agent can ‘see’ pixels (the ‘image’) through an ‘ego-centric camera view’ alongside receiving velocity and acceleration information.
