Remote Position
[Remote] Head of Data Center Operations – GPU & AI Infrastructure
🌍 Remote · United States
💼 Full-time
Note: The job is a remote job and is open to candidates in USA. Programming.com is seeking an experienced infrastructure leader to manage and scale large-scale GPU and AI data center operations. The role oversees GPU clusters, infrastructure reliability, capacity planning, incident management, and 24/7 technical operations teams.
Responsibilities
- Lead end-to-end operations of large-scale GPU clusters, AI infrastructure, and data center IT environments
- Manage GPU server deployment, monitoring, troubleshooting, maintenance, and hardware lifecycle
- Ensure high availability, performance, and reliability of AI training and inference infrastructure
- Oversee multi-site data center operations, infrastructure expansion, and capacity planning
- Lead major incident management, RCA, operational governance, and SLA/SLO performance
- Build and manage 24/7 technical operations teams, engineering managers, and site leaders
- Drive automation, GPU fleet monitoring, operational efficiency, and infrastructure scaling
- Collaborate with engineering teams, hardware vendors, and executive leadership
Skills
- 15+ years in Infrastructure Engineering, Data Center Operations, GPU Cloud, or HPC environments
- 7+ years of leadership experience managing large-scale production infrastructure operations
- Direct experience managing production NVIDIA GPU clusters is mandatory
- Strong knowledge of NVIDIA H100/H200/B200/GB200, DGX/HGX, NVLink, and NVSwitch or comparable GPU infrastructure
- Experience with InfiniBand, RDMA, high-speed networking, Linux, and GPU hardware troubleshooting
- Familiarity with Slurm, Kubernetes, NVIDIA DCGM, Prometheus, and Grafana
- Experience managing multi-site operations, vendors, infrastructure deployments, and technical teams
- Strong leadership, operational strategy, and executive stakeholder management capabilities
- Experience managing thousands of GPUs, hyperscale AI infrastructure, NVIDIA DGX SuperPOD, or GPU cloud platforms
Company Overview