Remote Position

[Remote] Product Manager - GPUaaS and OE Telemetry

๐ŸŒ Remote ยท United States ๐Ÿ’ผ Full-time

Note: The job is a remote job and is open to candidates in USA. GMI Cloud is hiring a Product Manager to lead the strategy, roadmap, and execution of its GPU-as-a-Service and Observability Telemetry platforms. The role defines customer-facing GPU infrastructure capabilities and observability tools, partnering with engineering and operations teams to improve reliability, scalability, and operational experience.

Responsibilities

  • Drive the product strategy and roadmap for the GPUaaS and OE Telemetry platform in collaboration with the Infrastructure Engineering team
  • Translate customer and engineering requirements into prioritized product roadmaps
  • Define product requirements, user stories, acceptance criteria, and success metrics
  • Lead product planning, roadmap reviews, and release planning
  • Measure product adoption, operational impact, and business outcomes using data-driven KPIs
  • Define capabilities requirements for GPU provisioning, lifecycle management, scheduling, orchestration, self-service portal, APIs, multi-tenancy, billing, metering, quotas, and access management
  • Define telemetry and observability capabilities requirements across GPU, compute, storage, networking, Kubernetes, Slurm, AI workloads, and supporting infrastructure
  • Drive capabilities adoption including (but not limited to):
  • Metrics, logs, traces, and events collection
  • OpenTelemetry adoption and instrumentation
  • Real-time dashboards and visualization
  • Intelligent alerting and incident detection
  • Service health and dependency mapping
  • Distributed tracing
  • Root cause analysis
  • Utilization analytics
  • AI-driven anomaly detection and predictive insights
  • SLO/SLI measurement and reliability reporting
  • Partner with Infra Engineering teams, SRE, Platform Developers, Data Center Operations to improve observability, reliability, scalability and operation experience for GPUaaS platform

Skills

  • Bachelor's degree in Computer Science, Engineering, or a related technical field
  • 5+ years of Product Management experience in cloud infrastructure, AI infrastructure, or enterprise platforms
  • Strong understanding of GPU computing (NVIDIA H100/H200/B200/B300 or equivalent), Kubernetes, Slurm, Linux, Cloud infrastructure, APIs, Telemetry and observability platforms
  • Experience with monitoring technologies such as Prometheus, Grafana, OpenTelemetry, Elasticsearch/OpenSearch, or similar
  • Experience translating customer requirements into technical product specifications
  • Strong analytical and communication skills
  • Experience building AI cloud or GPU cloud platforms
  • Knowledge of NVIDIA AI Enterprise and related software ecosystems NVSentinel, Fleet Intelligence, etc
  • Experience with multi-tenant IaaS platforms
  • Experience with Agile/Scrum product development

Benefits

  • Preferred Location: Remote, USA.

Company Overview

  • GMI Cloud provides cloud infrastructure for AI workloads, including GPU computing, model inference, and AI agent runtime services. It was founded in 2023, and is headquartered in Mountain View, California, USA, with a workforce of 51-200 employees. Its website is https://www.gmicloud.ai.
  • Company H1B Sponsorship

  • GMI Cloud has a track record of offering H1B sponsorships, with 11 in 2026, 2 in 2025. Please note that this does not guarantee sponsorship for this specific role.
  • Apply Now โ†’

    More Open Positions

    Explore similar remote opportunities