[Remote] Senior Databricks Data Engineer, Digital Thread Modeling

Note: The job is a remote job and is open to candidates in USA. Lumenalta partners with global enterprises to design and build large-scale data platforms that support core business products and operations. The Senior Databricks Data Engineer will build governed Gold data products for a digital thread by modeling and relating engineering artifacts, implementing Silver-to-Gold transformations, and documenting data models, business rules, and lineage.

Responsibilities

• Implement the v1 program-agnostic digital thread schema in Databricks, including artifact attributes and the relationships between them
• Map existing traceability relationships across requirements, system models, parts, and revisions into the new schema for each MVP capability
• Implement part and revision keying across multiple source systems to support a program-specialized bill of materials
• Build Silver-to-Gold transformations in Databricks declarative pipelines, with data quality expectations on keys, relationships, and completeness
• Publish Gold tables as governed data products in Unity Catalog, with documentation, tags, and ownership
• Work with source system SMEs to resolve how Cameo, Teamcenter, and Capital represent the same engineering concepts differently
• Design the Gold layer so it can serve the digital thread and digital twin use cases
• Document data models, business rules, and lineage for handoff

Skills

• 6+ years in data engineering, including production data modeling on Databricks or a comparable lakehouse
• Strong data modeling skills, including relationship-heavy or graph-like models and entity resolution across systems
• Experience keying the same entity across multiple source systems, such as part number plus revision
• Working fluency in PLM and MBSE concepts and vocabulary, such as parts, BOMs, revisions, change objects, SysML model elements, and requirements traceability
• Hands-on experience with data from at least one of Teamcenter, Cameo, or Siemens Capital
• Experience with Databricks declarative pipelines or Delta Live Tables, including data quality expectations
• Experience publishing governed tables in Unity Catalog with documentation and tags
• Strong PySpark and SQL, and experience with Delta Lake and medallion architecture
• Experience working directly with engineering stakeholders to define data definitions and business rules
• This position supports a U.S. Government contract that requires all personnel to possess U.S. Citizenship
• Familiarity with digital thread or digital twin reference architectures
• Experience with SLICwave or logistics support analysis data
• Prior work in a defense, aerospace, or FedRAMP environment, or with CUI or ITAR-controlled data
• Databricks Data Engineer Professional certification

Benefits

• 100% dedicated to one project at a time so that you can innovate and grow.
• Be a part of a team of talented and friendly senior-level developers.
• Work on projects that allow you to use leading tech.
• Delivery Partner Program qualification, sponsored by Lumenalta, which does not expire once granted.
• Databricks Champion path, including a dedicated Databricks solutions architect as your mentor, access to product teams, confidential roadmap briefings, and an invitation to the internal Tech Summit.
• The exam fee is covered for any Databricks certification you want to take.
• Fully remote position.

Company Overview