Remote Position
[Remote] Senior Data Engineer
π Remote Β· United States
πΌ Full-time
Note: The job is a remote job and is open to candidates in USA. Health-E Commerce is seeking an experienced Senior Data Engineer to join its growing Data & Analytics team. The role focuses on designing, developing, and maintaining scalable data pipelines and infrastructure, implementing data governance and quality practices, and supporting data warehousing and analytics through Azure technologies, Apache Spark, Python, and ETL processes.
Responsibilities
- Design, develop, and maintain robust data pipelines and infrastructure to support data integration, processing, and storage
- Collaborate with analysts and other stakeholders to understand data requirements and translate them into technical solutions
- Implement best practices for data governance, security, and quality assurance to ensure the reliability and accuracy of data
- Explore and evaluate new technologies and tools to enhance our data infrastructure and capabilities
- Design and implement complex data models on Azure Synapse Analytics to support data warehousing Utilize Azure DevOps for continuous integration, continuous delivery, and agile project management
- Manage and optimize Apache Spark pools for high-performance data processing tasks
- Develop and maintain ETL processes and data pipelines using Python scripting
- Ensure data quality and integrity across all platforms and systems
- Collaborate with cross-functional teams to translate business needs into technical specifications
- Stay current with industry trends and advancements in Azure data services
Skills
- Bachelor's degree in Computer Science, Engineering, or related field
- Minimum of 5+ years experience in data engineering roles, with a strong focus on building and maintaining data pipelines and infrastructure
- Strong proficiency in Azure Synapse Analytics, Azure DevOps, and Apache Spark pools
- Expertise in Python scripting and other programming languages such as SQL and Java
- Senior level knowledge of data modeling, processes, and data warehouse concepts
- Strong communication skills and ability to effectively communicate technical concepts to non-technical stakeholders
- Experience with data modeling, warehousing, and building ETL pipelines
- Familiarity with Azure Data Factory, Azure Data Lake Storage, and other Azure data services
- 100% remote within the United States
- Must be able to work EST hours
Benefits
- Discretionary Annual Bonus Eligibility: Up to 10%
- Medical, Dental, Vision, and 401K with a company match
- Dependent Care, FSA & HSA accounts
- Paid Parental & Bonding Leave
- Flexible PTO & office closure on all major holidays
- Monthly wellness & internet reimbursements
- Professional development including certification support & leadership coaching
- Mental Health resources
- 100% remote within the United States
Company Overview
Company H1B Sponsorship