Databricks Data Engineer

Databricks Data Engineer

Remote | Full-Time | $135K-$150K | Active DoD Secret Clearance Required

Louisiana Technology Group (LATG) is seeking a Databricks Data Engineer to help design, build, and optimize modern data platforms supporting a major U.S. Navy mod`ernization initiative. In this role, you will develop scalable data pipelines, migrate legacy workloads, and deliver trusted data products that power enterprise analytics, reporting, and mission-critical operations.

What You'll Do

• Design, build, and maintain enterprise data pipelines within the Databricks Lakehouse Platform.
• Develop Bronze, Silver, and Gold data layers using Medallion Architecture.
• Build ETL/ELT processes using PySpark, Spark SQL, Delta Lake, and modern data engineering practices.
• Implement batch, incremental, and streaming data ingestion solutions.
• Migrate data and business logic from legacy platforms to cloud-based environments.
• Optimize data pipelines for performance, scalability, reliability, and data quality.
• Collaborate with architects, stakeholders, and development teams to deliver secure and scalable data solutions.
• Participate in Agile planning, technical reviews, and modernization initiatives.
• Support production operations, troubleshooting, incident resolution, and continuous improvement.
• Maintain technical documentation, workflows, and engineering standards.

Education & Experience

• 5+ years of experience in data engineering, ETL/ELT development, data warehousing, or related disciplines.
• Experience building and supporting enterprise-scale data pipelines.
• Experience delivering cloud-based analytics and data solutions.
• Experience working in Agile environments.

Technical Skills

• Databricks Lakehouse Platform
• PySpark and Spark SQL
• Advanced SQL development
• ETL/ELT development
• Data warehousing
• Medallion Architecture
• Delta Lake
• Batch, incremental, and streaming processing
• Data integration and transformation
• Pipeline optimization and data quality management

Professional Skills

• Strong analytical, troubleshooting, and problem-solving abilities.
• Ability to manage multiple priorities and deadlines.
• Strong written and verbal communication skills.
• Ability to collaborate with technical and non-technical stakeholders.
• Ability to work independently in a remote environment.

Preferred Qualifications

• Databricks certification.
• Experience operating Databricks production environments.
• Department of Defense or U.S. Navy experience.
• Federal government contracting experience.
• AWS GovCloud experience.
• Experience supporting production operations and incident resolution.
• Experience migrating data between accredited and non-accredited environments.

Clearance Requirements

• S. Citizenship required and Active DoD Secret Clearance.

Why LATG?

At LATG, you'll work alongside experienced engineers and architects delivering solutions that directly support national defense missions. We offer the opportunity to influence enterprise architecture decisions, work with modern cloud data technologies, and make a measurable impact on critical government programs

5+ years data engineering experience; Databricks Lakehouse, PySpark, Spark SQL, Delta Lake, ETL/ELT; U.S. citizenship and active DoD Secret clearance required.

Key Responsibilities

• designing data pipelines
• migrating legacy workloads
• optimizing data quality

Skills & Tools

Databricks Lakehouse Platform, PySpark, Spark SQL, Delta Lake, AWS GovCloud

Job Details

• Category: Data and Analytics
• Seniority: Senior Level
• Commitment: Full Time
• Workplace: Remote — United States
• Salary: USD 135,000 – 150,000 / year
• Languages: English

About Louisiana Technology Group Inc

An IT company delivering data platforms and cloud solutions for government programs. — Industry: Information Technology