[Remote] Engineering Manager, Online Serving and Inference, AI Platform

Note: The job is a remote job and is open to candidates in USA. Netflix is hiring an Engineering Manager to lead development of its next-generation online serving and inference platform. The role oversees architecture, design, development, and launch of scalable AI/ML infrastructure, while partnering across teams, driving platform adoption, and hiring and developing engineers.

Responsibilities

• Partner with Applied Research and backend application teams to understand their needs and gather and iterate on the platform's requirements
• Drive the architecture, design, build vs. buy evaluation, and execution of the online serving and inference platform. Strive for extensibility and ensure the platform can scale to meet the needs of the evolving AI landscape
• Build a roadmap focused on incremental delivery. Define success metrics, align on migration goals, and drive the platform's adoption
• Communicate progress to stakeholders, customers, and senior leadership
• Maintain existing platform offerings, balancing immediate needs in current systems while prioritizing the development of the next-gen platform
• Hire and grow diverse, highly talented engineers while maintaining and fostering an inclusive team culture

Skills

• 10+ years of software engineering experience and 3+ years of management experience
• Experience leading teams responsible for building high-traffic distributed systems and ML infrastructure
• Experience with containerization and orchestration technologies to support data preparation, processing, and inference for large-scale AI/ML models, such as Kubernetes
• Industry experience working with GPU based mode inference, and serving optimization (batching, latency, cost per request) in large scale computing environments
• Modern Foundation Model, such as LLM, serving and inference stacks such as vLLM, Nvidia Triton, TensorRT LLM, or SGLang
• Strong technical acumen and can act as a credible technical advisor to the team, set and enforce a high-quality bar for code and system design, and be a mentor for the team
• A passion for translating the needs of ML practitioners into infrastructure offerings with an eye toward automated and self-serve capabilities
• Strong communication and collaboration skills and ability to build strong relationships with internal customers and external partners
• A demonstrated ability to develop, drive, and execute a technical vision and roadmap
• A track record of attracting top talent and leading and growing high-performance, diverse, and highly talented senior and staff level engineers to maximize their impact and deliver results in a fast-paced and dynamic environment
• Experience managing a hybrid team with partners and team members distributed across (US) geographies & time zones

Benefits

• Health Plans
• Mental Health support
• A 401(k) Retirement Plan with employer match
• Stock Option Program
• Disability Programs
• Health Savings and Flexible Spending Accounts
• Family-forming benefits
• Life and Serious Injury Benefits
• Paid leave of absence programs
• Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off.
• Full-time salaried employees are immediately entitled to flexible time off.

Company Overview

Company H1B Sponsorship