cnvrg.io AI OS Delivers Accelerated ML Workloads of All Sizes with Native Support of NVIDIA A100 Multi-Instance GPU to its ML Platform

San Francisco - cnvrg.io AI OS for machine learning today announces native integration of NVIDIA multi-instance GPU (MIG) technology to its data science platform. cnvrg.io is the first ML platform to integrate MIG - a groundbreaking new feature that can partition each NVIDIA A100 GPU into as many as seven accelerators for optimal utilization, effectively expanding access to every user and application. This integration follows the release of the NVIDIA A100 Tensor Core GPU and NVIDIA DGX™ A100 system, and cnvrg.io’s certification for the NVIDIA DGX-Ready Software program as an AI workflow solution.

NVIDIA GPUs are the powerhouse of machine learning and deep learning workloads. The new NVIDIA A100 Tensor Core GPU delivers unprecedented acceleration at every scale for AI, data analytics, and HPC workloads to tackle the world’s toughest computing challenges. As the engine of the NVIDIA data center platform, A100 can efficiently scale up to thousands of GPUs, and with MIG, it can be partitioned into seven isolated GPU instances to accelerate AI workloads of all sizes.

With such immense variability, resource management is essential. Infrastructure teams require MLOps, as well as a way to assign, schedule, share, and monitor utilization of the MIG resources. This is where cnvrg.io data science platform was quick to evolve and offer MIG integration with self-service resource management, meta-scheduling and MLOps capabilities.

cnvrg.io is amongst the first ML platforms to integrate NVIDIA’s new MIG feature, which expands the performance and value of each NVIDIA A100 Tensor Core GPU across one or more DGX A100 systems. Each MIG instance is fully isolated with its own high-bandwidth memory, cache, and compute cores. Now administrators can support every workload, from the smallest to the largest, offering a right-sized GPU with guaranteed quality of service (QoS) for every job, optimizing utilization and extending the reach of accelerated computing resources to every user. Paired with cnvrg.io’s industry-leading resource management and MLOps capabilities for IT and AI teams, MIG instances can now be utilized in one click by any data scientist performing any ML job. cnvrg.io’s integration of NVIDIA MIG delivers AI teams:

• On-demand MIG instance availability in one click
• Customized compute templates for simplified MIG allocation and utilization
• Access to NVIDIA A100 processing power for any data scientist to run any ML job
• Advanced meta-scheduling capabilities for MIG pool management

“As data scientists, we understand that the MIG capability has the power to transform how data scientists work, and opens the possibilities for a significantly wider access to utilization of NVIDIA GPU technology,” says Yochay Ettun, CEO and co-founder of cnvrg.io. “Working closely with NVIDIA, we are helping make it easier for organizations to leverage MIG in A100 in their AI workflows, and deliver agility and productivity to AI teams.”

“The MIG capability in the A100 GPU allows users to pack dozens of completely separate jobs in parallel on DGX A100 systems with outstanding performance,” said John Barco, senior director of product management at NVIDIA. “Complementing this tremendous technological innovation with enterprise-grade AI workflow management and MLOps software from cnvrg.io helps customers maximize their GPU utilization and get the most from their AI investment.”

AI teams can drastically improve utilization of their A100 GPUs with NVIDIA MIG and cnvrg.io. If you’re looking to optimize the usage of your DGX A100 systems with A100 GPUs, cnvrg.io now delivers the tools to quickly utilize the MIG feature in A100 for ML workloads and improve performance with advanced resource management and MLOps.

Learn more about cnvrg.io MIG integration and advanced resource management of ML workloads here.

About cnvrg.io:

cnvrg.io is an AI OS, transforming the way enterprises manage, scale and accelerate AI and data science development from research to production. The code-first platform is built by data scientists, for data scientists and offers unrivaled flexibility to run on-premise or cloud.