GOOGLE parent Alphabet on Tuesday (May 14) unveiled a product called Trillium in its artificial intelligence (AI) data centre chip family that it says is nearly five times as fast as its prior version.
“Industry demand for (machine learning) computer has grown by a factor of one million in the last six years, roughly increasing 10-fold every year,” Alphabet CEO Sundar Pichai said. “I think Google was built for this moment, we have been pioneering (AI chips) for more than a decade.”
Alphabet’s effort to build custom chips for AI data centres represents one of the few viable alternatives to Nvidia’s top-of-the-line processors that dominate the market. Together with the software that is closely tied to Google’s tensor processing units (TPUs), the chips have allowed the company to take a significant share of the market.
Nvidia commands roughly 80 per cent of the AI data centre chip market, and the vast majority of the remaining 20 per cent is various versions of Google’s TPUs. The company does not sell the chip itself, but rents access through its cloud computing platform.
The sixth-generation Trillium chip will achieve 4.7 times better computing performance compared with the TPU v5e, according to Google, a chip designed to power the tech that generates text and other media from large models. The Trillium processor is 67 per cent more energy efficient than the v5e.
The new chip will be available to its cloud customers in “late 2024”, the company said.
GET BT IN YOUR INBOX DAILY
Start and end each day with the latest news stories and analyses delivered straight to your inbox.
Google’s engineers achieved additional performance gains by increasing the amount of high-bandwidth memory capacity and overall bandwidth. AI models require enormous amounts of advanced memory, which has been a bottleneck to further boosting performance.
The company designed the chips to be deployed in pods of 256 chips that can be scaled to hundreds of pods. REUTERS
