Elon Musk says Tesla’s Digital Optimus AI can now get about halfway through Diablo’s campaign just by looking at the screen, the way a human player would.
Musk shared the update on X early Saturday, saying the agent’s skill at Counter-Strike and other fast games is also good, and that League of Legends is in training.
“We’re making interesting progress here.
Digital Optimus can play about halfway through the Diablo campaign so far just by looking at the screen like a human.
Skill at Counter-Strike and other fast games is good too.
League is also in training.
Goal is to generalize across all games.”
Musk revealed the information responding to a post on X about a new Tesla job listing for a Palo Alto machine learning engineer on Digital Optimus’s ‘Gaming Track’. According to the job posting, engineers will focus on improving the agent’s memory, planning and real-time decision-making, while testing whether skills learned in games can be applied to other software, and Tesla says the team will help integrate these agents into Full Self-Driving and the physical Optimus robot.
While teaching AI to play video games might seem like an unusual priority for Tesla, the technology being developed has applications well beyond gaming. Unlike systems that rely on direct access to a game’s internal data, Digital Optimus learns to navigate what is happening on screen, using keyboard and mouse inputs, an approach that could let the same AI run everyday software without special integrations.
First announced in March as a collaboration between Tesla and xAI, Digital Optimus is designed to handle computer-based tasks, from navigating websites to working with professional applications.
The system combines Tesla’s real-time AI capabilities with Grok’s reasoning abilities, allowing it to make decisions and carry out tasks.
Musk has previously said Digital Optimus could eventually operate using AI4 hardware installed in Tesla vehicles, allowing parked cars to perform computer-based work.
Related Articles:
- Elon Musk Reveals Tesla-xAI Project “Macrohard” Aimed at Disrupting Software Companies
- Tesla announces $2 billion investment in xAI — here’s how it differs from the shareholder vote
- Elon Musk announces Tesla AI4+ computer, reaffirms AI5 won’t power cars, yet
- Tesla makes progress converting former Model S/X line for Optimus production
Always get the latest - make Drive Tesla your preferred source on Google
Are you buying a Tesla? If you enjoy our content and we helped in your decision, use our referral link to get three months of Full Self-Driving (FSD).Drive Tesla uses affiliate links, which means we may earn a commission if you make a purchase through them, at no additional cost to you. Thank you for your support.
