← Back
AWS ML Blog

Share GPU clusters across teams with isolation and fairness using Amazon SageMaker HyperPod

•31 min read•
#compute#amazon
✦TL;DR

The article outlines a reference architecture that lets multiple teams share a single Amazon SageMaker HyperPod EKS cluster while maintaining strict isolation and fairness. By leveraging AWS IAM Identity Center for authentication, assigning each team its own SageMaker Domain and Kubernetes namespace, and enabling HyperPod Task Governance, the design guarantees that workloads are isolated, scheduled fairly, and billed accurately at the namespace level. This approach reduces cluster fragmentation and simplifies cost tracking for large multi‑tenant AI workloads.

⚡ Key Takeaways

  • A single SageMaker HyperPod EKS cluster can be partitioned across teams using per‑team SageMaker Domains and Kubernetes namespaces.
  • AWS IAM Identity Center is used to authenticate users and map them to the correct domain and namespace.
  • HyperPod Task Governance enforces workload fairness and prevents any single team from monopolizing GPU resources.
  • Namespace‑level cost allocation tags automatically attribute GPU usage to the owning

Want the full story? Read the original article.

Read on AWS ML Blog ↗

More like this

Lambda Boosts AI Factory Resiliency and Efficiency With NVIDIA Photonics

NVIDIA Blog•#compute

Hamed Karimi wins ECML PKDD Test-of-Time Award

Amazon Science•#llm

NVIDIA Expands Slurm to Bring Quantum Computing Into Supercomputing

NVIDIA Blog•#compute

NVIDIA Sweeps MLPerf Training and Endpoints as Vera Rubin Debuts With Leading Performance

NVIDIA Blog•#llm

EXPLORE AI NEWS

Daily hand-picked stories on LLMs, RAG, agents and production AI — curated for engineers who ship.

BROWSE NEWS

GET THE WEEKLY DIGEST

Join engineers getting the Monday signal-over-noise AI breakdown. No spam, unsubscribe anytime.

LEARN AI ENGINEERING

Curated courses, research papers, repos and tutorials built for engineers leveling up in AI.

START LEARNING