Meta rolls out its next generation infrastructure for AI
By MYBRANDBOOK
The parent company of Facebook, Instagram and WhatsApp, Meta has come up with the next generation of Meta Training and Inference Accelerator (MTIA). This step of Meta indicates that the company is committed to enhance AI-driven experiences across its products and services.
The next generation of MTIA is part of a broader full-stack development program for custom, domain-specific silicon that addresses Meta’s unique workloads and systems. This new version of MTIA more than doubles the compute and memory bandwidth of its previous solution while maintaining close tie-in to workloads. It is designed to efficiently serve the ranking and recommendation models that provide high-quality recommendations to users.
year, Meta rolled out the first-generation AI inference accelerator, Meta Training and Inference Accelerator (MTIA) v1 which was designed in-house with Meta’s AI workloads in mind.
According to Meta, “MTIA is a long-term bet to provide the most efficient architecture for Meta’s unique workloads. As AI workloads become increasingly important to our products and services, this efficiency will be central to our ability to provide the best experiences for our users around the world. MTIA v1 was an important step in improving the compute efficiency of our infrastructure and better supporting our software developers as they build AI models that will facilitate new and better user experiences.”
The new chip’s architecture is fundamentally focused on providing the right balance of compute, memory bandwidth and memory capacity for serving ranking and recommendation models.
MTIA has been deployed in Meta’s data centers and is now serving models in production. The company is already seeing the positive results of this program as it is allowing to dedicate and invest in more compute power for more intensive AI workloads.
The results so far show that this MTIA chip can handle both low complexity and high complexity ranking and recommendation models which are key components of Meta’s products.
Legal Battle Over IT Act Intensifies Amid Musk’s India Plans
The outcome of the legal dispute between X Corp and the Indian government c...
Wipro inks 10-year deal with Phoenix Group's ReAssure UK worth
The agreement, executed through Wipro and its 100% subsidiary,...
Centre announces that DPDP Rules nearing Finalisation by April
The government seeks to refine the rules for robust data protection, ensuri...
Home Ministry cracks down on PoS agents in digital arrest scam
Digital arrest scams are a growing cybercrime where victims are coerced or ...
Icons Of India : PRATIVA MOHAPATRA
Prativa is a transformational leader with an incredible breadth of exp...
Icons Of India : MUKESH D. AMBANI
Mukesh Dhirubhai Ambani is an Indian businessman and the chairman and ...
Icons Of India : Dr. Sanjay Bahl
Dr. Sanjay Bahl has around four decades of experience in the ICT indus...
GeM - Government e Marketplace
GeM is to facilitate the procurement of goods and services by various ...
C-DOT - Center of Development of Telematics
India’s premier research and development center focused on telecommu...
ECIL - Electronics Corporation of India Limited
ECIL is distinguished by its diverse technological capabilities and it...
Indian Tech Talent Excelling The Tech World - Dheeraj Pandey, CEO, DevRev
Dheeraj Pandey, Co-founder and CEO at DevRev , has a remarkable journe...
Indian Tech Talent Excelling The Tech World - JAY CHAUDHRY, CEO – Zscaler
Jay Chaudhry, an Indian-American technology entrepreneur, is the CEO a...
Indian Tech Talent Excelling The Tech World - Aneel Bhusri, CEO, Workday
Aneel Bhusri, Co-Founder and Executive Chair at Workday, has been a le...