Elon Musk provided a sneak peek into “Cortex”, Tesla’s new AI training center that has been under construction for quite a while at Giga Texas.
Previously, we saw some shots of the new wing for the massive water-cooled supercomputer cluster at Giga Texas, which was being built at the southern end of the Gigafactory.
AI4 Training
Cortex appears to be the name of the supercomputer cluster, and we can assume that it will be referred to that way from now on. Cortex will primarily focus on exploring and expanding FSD’s performance envelope to include AI4, which will begin to diverge from HW3 sometime soon. Tesla hasn’t yet unlocked the full potential of AI4, as it still runs HW3 in emulation mode, but with a few extra tricks that HW3 doesn’t have access to. These are mostly hardware compiler changes, but they make a significant difference in the speed of processing the AI model.
Tesla intends to continue supporting HW3, but it's already apparent that the FSD model for HW3 is smaller than the model for AI4. However, Ashok Elluswamy, Tesla’s Autopilot program director, expects performance to be similar for the most part.
One other thing that Cortex will likely be tackling is not just FSD in cars – but FSD in Optimus. Optimus uses the same principal technology behind FSD for movement, as well as understanding and learning tasks, so we can expect to see plenty of improvements as Tesla is now getting Cortex online.
Video of the inside of Cortex today, the giant new AI training supercluster being built at Tesla HQ in Austin to solve real-world AI pic.twitter.com/DwJVUWUrb5
— Elon Musk (@elonmusk) August 26, 2024
Cortex, Not Dojo
What’s most interesting is that this new supercomputer cluster isn’t Tesla’s Dojo Supercomputers. Instead, this Cortex cluster is instead based on Nvidia’s H100 GPUs. Dojo was supposed to be Tesla’s in-house designed and specialized AI GPUs, meant to focus on optimizing FSD.
Dojo isn’t dead – but delayed from the sounds of it. We’re excited to see where Cortex takes Tesla in the future, and when Dojo shows up to join the party.
