Data Engineer
Job Summary We are seeking a dynamic and innovative Data Engineer to join our forward-thinking data team. In this role, you will be responsible for designing, developing, and maintaining scalable data pipelines and architectures that support advanced analytics and business intelligence initiatives. Your expertise will enable the organization to harness the power of big data systems, cloud platforms, and data modeling techniques to drive strategic decision-making. If you thrive in a fast-paced environment and are passionate about transforming complex data into actionable insights, this opportunity is perfect for you!
Responsibilities
Develop and optimize ETL (Extract, Transform, Load) pipelines using tools like Talend, Informatica, and custom scripting in Python or Bash to ensure efficient data flow across systems. Design and implement robust data models and schemas for data warehouses using dimensional modeling principles to support business intelligence tools such as Looker. Manage large-scale big data systems utilizing Hadoop, Apache Hive, Spark, and Azure Data Lake to process vast datasets with speed and precision. Integrate data from multiple sources including SQL databases (Microsoft SQL Server, Oracle), cloud databases (AWS, Azure), and linked data sources to create comprehensive datasets for analysis. Collaborate with cross-functional teams using Agile methodologies to develop scalable solutions aligned with business needs while maintaining high standards of data quality and security. Build and maintain RESTful APIs for seamless data access and integration across applications. Support model training, analysis activities, and query management tasks to facilitate insightful reporting through business intelligence tools like Looker.
Qualifications
Proven experience in software development with proficiency in Java, Python, SQL, VBA, Bash (Unix shell), and Shell Scripting for automation and pipeline development. Strong understanding of big data systems such as Hadoop ecosystem components (HDFS, Hive, Spark) and cloud platforms including AWS (Amazon Web Services), Azure (Azure Data Lake), or similar public cloud environments. Expertise in data management integration techniques including ETL pipeline development, database design, data warehousing design, and dimensional modeling. Hands-on experience with SQL databases like Microsoft SQL Server, Oracle, and cloud-based databases; familiarity with query management is essential. Knowledge of business intelligence tools such as Looker or equivalent platforms for visualization and reporting purposes. Ability to design scalable data architectures supporting analytics initiatives with a focus on data warehousing design and cloud database solutions. Strong analysis skills with a focus on data modeling, model training processes, and analytics-driven decision making. Familiarity with Agile development practices to ensure iterative progress on complex projects involving big data systems. Join us to leverage your expertise in data engineering—transform raw information into powerful insights that shape the future of our organization! Pay: $107,007.35 - $128,869.06 per year Work Location: Remote