[Remote] Staff AI Scheduling & Orchestration Engineer

Note: The job is a remote job and is open to candidates in USA. Bitdeer is a technology company focused on AI and Bitcoin mining infrastructure. The company is seeking a Staff AI Scheduling & Orchestration Engineer to lead workload placement logic for its AI-native NeoCloud platform, designing scalable scheduling, admission control, queueing, topology-aware placement, GPU sharing, and multi-tenancy solutions. The role also involves improving reliability, collaborating with GPU Systems and Storage teams, and mentoring engineers.

Responsibilities

• Design and implement advanced batch scheduling architectures using frameworks like Volcano or YuniKorn to support multi-node gang scheduling
• Develop and manage cluster-wide admission control and sophisticated job queueing mechanisms utilizing Kueue to manage high-volume AI workload traffic
• Leverage Kubernetes Dynamic Resource Allocation (DRA) and custom scheduler plugins to manage complex accelerator requests natively
• Architect topology-aware pod placement strategies that optimize for low-latency communication via NVLink and InfiniBand fabrics
• Implement automated GPU sharing technologies (e.g., MIG, time-slicing) and multi-tenancy isolation policies to maximize cluster-wide utilization
• Collaborate with the GPU Systems and Storage teams to ensure the scheduling layer is tightly integrated with bare-metal hardware and storage I/O patterns
• Drive the reliability and scalability of the scheduling stack, resolving resource contention and deadlock scenarios in large-scale HPC environments
• Mentor junior engineers and conduct design reviews to maintain architectural excellence in our orchestration layer

Skills

• Bachelor's or Master's degree in Computer Science, Electrical Engineering, or a related field
• 6+ years of distributed systems engineering, with deep, hands-on expertise in Kubernetes scheduling frameworks and orchestrators
• Extensive experience with AI workload execution patterns and distributed training frameworks (e.g., PyTorch Distributed, Ray, MPI)
• Proven track record of operating, debugging, and scaling scheduling stacks in high-performance computing (HPC) or large-scale production cloud environments
• Strong knowledge of GPU hardware architectures and the specific scheduling challenges related to distributed AI training and inference
• Experience with infrastructure automation and infrastructure-as-code (e.g., Terraform, Go-based Operators)
• Excellent technical communication and leadership skills; ability to influence cross-functional teams and align architectural goals
• Ability to work in a high-velocity engineering environment and translate complex, ambiguous requirements into concrete, scalable engineering solutions

Company Overview