Data Engineer

Job Title: Azure Cloud Data Engineer Location: Remote/WFH Duration: 7 months+ contract Number of Positions: 4 roles Description: We are looking for a contract Data Engineer for a client engagement. This Data Engineer will possess strong experience with Python and / or PySpark needed along with Azure Data Lake, ETL, ELT, and DataFlow. Responsibilities: Work with architects, other data engineers and analysts to identify, engage, and integrate data sources for discovery and profiling and, where necessary and define data services that empower business processes. Design, build, and scale data pipelines across a variety of source systems and streams (internal, third-party, as well as cloud-based), distributed / elastic environments, and downstream applications and/or self-service solutions. Develop solutions combining data blending, profiling, mining, statistical analysis, and machine learning, to better define and curate models, test hypothesis, and deliver key insights. Collaborate in establishing and evolving development, testing, and documentation standards, as well as related code reviews. Partner with business analysts, application engineers, data scientists, leveraging the appropriate tools, solutions, and/or processes as part of their data mining, profiling, blending, and analytical activities. Collaborate in establishing and evolving development, testing, and documentation standards, as well as related code reviews. Qualifications: 2-5 years of progressive data application development experience. Strong Experience with Python and / or PySpark needed. Experience working in large scale/distributed SQL, NoSQL, and/or Hadoop environments. 2+ years of experience modeling and implementing ETL / ELT on columnar MPP database technologies. Experience with streaming architectures e.g. Kafka, Stream, PubSub. Best Regards, ------- David Roy | #LI-DR1 Accounts Manager – US Staffing | Charter Global Inc. |