Meta Publicizes New Particulars on Information Facilities for AI Initiatives

Meta Platforms on Thursday shared new particulars on tasks it was pursuing to make its information facilities higher suited to supporting synthetic intelligence work, together with a customized chip “family” that it stated it was growing in-house.

The Facebook and Instagram proprietor stated in a collection of weblog posts that it designed a first-generation chip in 2020 as a part of the Meta Training and Inference Accelerator (MTIA) program, which was aimed toward bettering effectivity for the suggestions fashions it makes use of to serve adverts and different content material in information feeds.

Reuters beforehand reported that the corporate was not planning to deploy its first in-house AI chip broadly and was already engaged on a successor. The weblog posts portrayed the primary MTIA chip as a studying alternative.

“From this initial program, we have learned invaluable lessons that we are incorporating into our roadmap,” it wrote.

The first MTIA chip was centered solely on an AI course of known as inference, through which algorithms skilled on big quantities of knowledge make judgments about whether or not to indicate, say, a dance video or a cat meme as the subsequent publish in a consumer’s feed, the posts stated.

A Meta spokesperson declined to touch upon deployment timelines or elaborate on the corporate’s plans to develop chips that would practice the fashions as effectively.

Meta has been engaged in a large venture to improve its AI infrastructure this previous 12 months, after executives realized it lacked the {hardware} and software program wanted to assist demand from product groups constructing AI-powered options.

As a part of that, the corporate scrapped plans for a large-scale rollout of an in-house inference chip and began work on a extra bold chip able to performing each coaching and inference, in keeping with the Reuters reporting.

Meta acknowledged in its weblog posts that its first MTIA chip stumbled with high-complexity AI fashions, though it stated the chip dealt with low- and medium-complexity fashions extra effectively than competitor chips.

The MTIA chip additionally used solely 25 watts of energy — a fraction of what market-leading chips from suppliers equivalent to Nvidia devour — and used an open-source chip structure known as RISC-V, Meta stated. 

In addition to detailing its chip work, Meta offered an replace on plans to revamp its information facilities round extra fashionable AI-oriented networking and cooling techniques, saying it could break floor on its first such facility this 12 months.

The new design could be 31 % cheaper and could possibly be constructed twice as rapidly as the corporate’s present information facilities, an worker stated in a video explaining the adjustments.

© Thomson Reuters 2023