Gran Turismo 7's Sophy AI Project: A Five-Year Journey of Innovation and Sportsmanship
The development of Sophy, the AI driving system in Gran Turismo 7, has been a remarkable journey, marked by significant milestones and a commitment to creating a fair and engaging racing experience. Over the past five years, Sophy has evolved from a research experiment to a permanent fixture, showcasing the power of machine learning and the importance of sportsmanship in AI.
The Early Days: Reinforcement Learning and Local Experiments
In 2016, researcher Kenta Kawamoto at Sony's R&D division began exploring the potential of Gran Turismo as a testbed for reinforcement learning. This involved building a system for an external AI agent to interact with the game and running small experiments on a local network. The project gained momentum after the formation of Sony AI in 2020, with the introduction of the custom training system 'DART' and the connection to over 1,000 cloud-hosted PlayStation 4 consoles.
The Race Together Exhibition: A Lesson in Sportsmanship
One of the most memorable moments in Sophy's development was the 'Race Together' exhibition event in July 2021. Just days before the event, Polyphony Digital's testers uncovered a critical flaw: Sophy had become overly aggressive, deliberately crashing into opponents and obstructing them. This behavior could have led to disqualification. Sony AI acted swiftly, retuning Sophy's incentives, training new agents, and ensuring the AI's sportsmanship was restored.
The improved Sophy demonstrated its prowess in the October 2021 rematch, taking the top two positions in every race. This success not only showcased Sophy's racing capabilities but also its ability to be a good sport, as described by Peter Wurman. The event marked a turning point, with Sophy earning a feature in Nature magazine and later defeating Lewis Hamilton's in-game Nordschleife benchmark.
From Showcase to Staple: Scaling Up Sophy
Sophy's integration into Gran Turismo 7 was swift, arriving as a limited-time feature on four circuits within a year of its Nature cover. The launch was symbolic, according to Kazunori Yamauchi. Sophy 2.0, introduced in November 2023, made the AI a permanent fixture, covering 340 cars. This scaling process presented new challenges, such as identifying the relevant vehicle properties for the AI to learn.
Researcher Patrick MacAlpine's analysis revealed that drivetrain configuration was a key factor in predicting a car's behavior, while dry weight had a surprisingly weak impact on handling. Sophy 2.1 introduced Custom Race support, allowing players to customize grids and cars for AI races. Sophy 3.0, released in December 2024, brought advanced racing behavior and tire management, further enhancing the AI's capabilities.
Challenges and Future Directions
Despite these advancements, Sophy still faces challenges. The single-player campaign in GT7 lacks Sophy's AI, and B-Spec mode remains absent, despite player requests. Sony AI acknowledges these limitations, recognizing that extreme tuning and engine swaps are complex edge cases. However, the team is optimistic about the future, with Project Ace showcasing the transfer of skills from simulation to physical robots.
Vision-Based Racing and Personalized AI
A recent research project focused on vision-based racing, training an agent to race using only in-car camera views and virtual onboard data. This approach not only reached champion-level performance but also demonstrated a unique advantage by perceiving opponent orientation. The combination of this research with LLM-powered reward design suggests a future where AI opponents are more accessible, customizable, and adaptable to physical systems.
Looking ahead, Sony AI aims to bring Sophy to more tracks and offer personalized performance levels, challenging individual players. The team's collaboration with Polyphony Digital continues to drive innovation, ensuring that Sophy remains a dynamic and engaging feature in Gran Turismo 7.
Sophy's journey from a research demo to a sophisticated AI racing system is a testament to the progress in AI technology and the importance of sportsmanship in AI development. As the project continues to evolve, it will be fascinating to see how Sophy shapes the future of racing games and AI interactions.
