Nvidia, VMware partner to offer virtualized GPUs
By MYBRANDBOOK
Nvidia and VMwareannounced a new software product that lets customers virtualize GPUs, either on premise or as part of VMware Cloud on AWS. With this the companies can offer it's the first hybrid cloud that lets enterprises use GPUs to accelerate AI, machine learning or deep learning workloads.
A virtual graphics processing unit (GPU)is a computer processor that renders graphics on a virtual machine's (VM's) host server rather than on a physical endpoint device and the vGPU technology enables every virtual machine (VM) to get GPU performance just like a physical desktop. Work that was previously done by the CPU is now offloaded to the GPU, providing users with a better experience.
As the machine learning and AI are being an increasingly indispensable part of modern computing, they have spearheaded their effort to be a prominent force in the server business forging partnerships with multiple tech companies. "In a modern data center, organizations are going to be using GPUs to power AI, deep learning, analytics," John Fanelli, VP of product management for Nvidia, said. "And due to the scale of those types of workloads, they're going to be doing some processing on premise in data centers, some processing in clouds and continually iterating between them."
The new offering starts with the enterprise data center product - Nvidia's new Virtual Compute Server (vComputeServer) software. It's optimized for VMware's vSphere and will be available from all major OEMs, including Cisco, Dell, HPE, Lenovo and Supermicro.
"We're now able to bring AI to the data center in a way that data center IT admins run and design their data centers - namely, in a virtualized environment," Fanelli said.
vComputeServer provides support for Rapids, and it supports containers. Additionally, it supports GPU sharing, as well as GPU aggregation by a single user for larger jobs.
The technology will be licensed on a per-GPU basis. Virtualization typically results in less than a 5 percent performance impact, Fanelli said, though it will depend on the workload. It's a trade-off, he said, that customers should be willing to make for the benefits of virtualization such as manageability and flexibility.
Key Highlights of vComputeServer :
GPU Performance: Up to 50x faster deep learning training than CPU-only, similar performance to running GPU on bare metal.
Advanced compute: Error-correcting code and dynamic page retirement prevent against data corruption for high-accuracy workloads.
Live migration: GPU-enabled virtual machines can be migrated with minimal disruption or downtime.
Increased security: Enterprises can extend security benefits of server virtualization to GPU clusters.
Multi-tenant isolation: Workloads can be isolated to securely support multiple users on a single infrastructure.
Management and monitoring: Admins can use the same hypervisor virtualization tools to manage GPU servers, with visibility at the host, virtual machine and app level.
Broad Range of Supported GPUs: vComputeServer is supported on NVIDIA T4 or V100 GPUs, as well as Quadro RTX 8000 and 6000 GPUs, and prior generations of Pascal-architecture P40, P100 and P60 GPUs.
Meanwhile, VMware is planning on making this vComputeServer available on VMware Cloud on AWS, which (as the name suggests) runs VMware's SDDC on the Amazon Web Services cloud. VMware Cloud on AWS allows customers to run any application across public, private or hybrid cloud environments. The service is optimized to run on dedicated, bare metal AWS infrastructure.
Singapore to remove One-Time Passwords from Bank Accounts
According to the Monetary Authority of Singapore, clients who utilise secur...
Is 375 million Airtel subscribers database breached?
When a hacker claims to have accessed and put up for sale a customer databa...
The government of India intends to construct a single portal f
A single portal will be launched by the Indian government to list all of it...
OpenAI offers GPT-4o, a faster model available to all users at
GPT-4o, a faster and more sophisticated AI model, is made available to all...
ICONS OF INDIA : SACHIN BANSAL
Sachin Bansal is an Indian entrepreneur. He is best known as the found...
Icons Of India : Dr. Sanjay Bahl
Dr. Sanjay Bahl has around four decades of experience in the ICT indus...
Icons Of India : Kumar Mangalam Birla
Aditya Birla Group chairman Kumar Mangalam Birla recently made a comeb...
IOCL - Indian Oil Corporation Ltd.
IOCL is India’s largest oil refining and marketing company ...
TCIL - Telecommunications Consultants India Limited
TCIL is a government-owned engineering and consultancy company...
IFFCO - Indian Farmers Fertiliser Cooperative
IFFCO operates as a cooperative society owned and controlled by its fa...
Indian Tech Talent Excelling The Tech World - NIKESH ARORA, Chairman CEO - Palo Alto Networks
Nikesh Arora, the Chairman and CEO of Palo Alto Networks, is steering ...
Indian Tech Talent Excelling The Tech World - Soni Jiandani, Co-Founder- Pensando Systems
Soni Jiandani, Co-Founder of Pensando Systems, is a tech visionary ren...
Indian Tech Talent Excelling The Tech World - Lal Karsanbhai, President & CEO, Emerson
Lal Karsanbhai, President and CEO of Emerson, assumed the leadership i...