[Remote] Data and Platform Engineer

Note: The job is a remote job and is open to candidates in USA. NVIDIA’s DGX Cloud organization develops the data foundation supporting fleet health, capacity, utilization, cost, reliability, and operational decision-making across large GPU fleets. The Senior Data Engineer will lead a major area of the Navigator data platform, owning architecture, technical delivery, data pipelines, production operations, quality standards, and technical leadership across teams.

Responsibilities

• You will own a major platform component and its roadmap. For example, define its architecture, interfaces, technical goals, and evolution. Anticipate capacity, compatibility, and operational needs over a multi-year horizon, and translate them into achievable breakthroughs that balance immediate delivery with long-term maintainability
• Lead technical delivery across teams. Work with customers and interested parties to clarify vague requirements. Break down design and implementation work for contributing engineers. Establish release turning points and manage dependencies and delivery risks. Guide the work process, revise plans when requirements shift, and keep management and partner teams informed and aligned
• Build data pipelines and products. Plan and carry out batch and streaming ingestion, transformation, reconciliation, and serving processes for fleet, capacity, utilization, cost, scheduling, and operational telemetry. Establish data models and agreements that remain stable as sources, consumers, and scale progress
• Develop shared platform capabilities. Direct the creation and adoption of libraries, workflow and DAG or comparable experience abstractions, deployment tools, and standard implementation approaches. Partner with related teams to solve shared challenges and evaluate progress in onboarding time, engineering effort, reliability, and cost
• Lead complex production investigations. Serve as the technical point of accountability for issues spanning pipelines, applications, SQL engines, Spark, storage, networks, and cloud services. Coordinate investigations across owners, drive resolution of release blockers and critical issues from partners, and implement preventive measures
• Define quality, security, and operational expectations. Establish and implement testing, data-quality, reconciliation, lineage, SLO, and release-readiness standards for your platform area. Partner with security and infrastructure teams on trust boundaries, service identities, least privilege, secrets, environment isolation, and auditability, and drive adoption across contributing teams
• Make trusted data usable. Deliver well-modeled tables, APIs, automation, dashboards, and focused internal applications. Align with consumers on semantics, access patterns, freshness, compatibility, and ownership so that shared capabilities support dependable operational decisions
• Provide technical leadership through others. Guide design reviews, mentor engineers taking on larger ownership, and resolve technical disagreements using evidence and clear tradeoffs. Partner with leadership on priorities and explain how technical investments support DGXC objectives

Skills

• BS or MS in Computer Science, Engineering, or a related field (or equivalent experience), and at least 12+ years of equivalent experience
• A sustained record of building and operating production software, data platforms, databases, or distributed systems. This includes owning a major component or complex project from requirements and architecture through release and ongoing operation
• Proven ability to outline a component's technical plan, establish objectives for engineers, assign design and implementation tasks, and guide delivery within your team and nearby teams with little supervision
• Extensive practical experience in one or more of these areas: distributed processing using Spark or a similar system; relational, distributed, or analytical databases; production ETL, change-data capture, streaming, or event handling; or backend and cloud platforms managing large data volumes. You must grasp the interfaces and failure modes of nearby layers thoroughly to inform solid architectural choices
• Strong software-engineering fundamentals and production proficiency in Python or another backend or systems language, with the ability and willingness to work primarily in Python and SQL. Experience designing reusable abstractions, reviewing substantial changes, and personally implementing and debugging critical code paths
• Strong SQL and data-modeling skills, with practical depth in query execution, incremental processing, schema evolution, consistency, and analytical consumption. Ability to reason about idempotency, replay, late-arriving data, partial failure, and correctness across system boundaries
• Experience leading complex investigations involving multiple components and teams. Ability to use logs, metrics, traces, query plans, profiles, and controlled experiments to establish root cause, coordinate resolution, and prevent recurrence
• Demonstrated architectural judgment: evaluating alternatives, anticipating future requirements, and balancing reliability, performance, cost, security, compatibility, and maintainability. Experience leading significant migrations or architectural changes while preserving production service
• Experience establishing production quality and operational practices that other engineers adopt, including testing, CI/CD, monitoring, alerting, rollback, incident response, and secure deployment
• Proven success in influencing technical decisions without official authority, advising engineers outside your immediate project, and advancing workflow improvements across closely related teams. Ability to simplify complex issues, offer a course of action, and communicate decisions and delivery risks clearly
• Proven expertise in building, refining, and running Databricks, Apache Spark, PySpark, Spark SQL, Delta Lake, or Unity Catalog workloads along with shared platform features
• Experience designing and operating Kafka or comparable streaming systems, including partitioning, consumer behavior, offset management, backpressure, replay, and schema compatibility
• Experience scaling, migrating, or tuning relational, distributed, time-series, object-storage, or information retrieval systems, including Elasticsearch or OpenSearch
• Background operating compute or GPU clusters, or working with Kubernetes, Slurm, cloud infrastructure, and fleet telemetry across AWS, Azure, GCP, or other providers
• Experience building production agentic systems or agent harnesses, including tool integration, context management, evaluation, permissions, observability, and failure recovery. Evidence of measurable improvements in engineering productivity or operational outcomes

Benefits

• Equity
• Employee benefits

Company Overview

Company H1B Sponsorship