SENIOR DATA ENGINEER
```html Senior Data Engineer Join our dynamic team as a Senior Data Engineer, where you will play a pivotal role in shaping our data infrastructure and strategy. In this position, you will be responsible for designing, implementing, and maintaining our data architecture on Google Cloud Platform (Google Cloud Platform). You will work closely with data scientists, analysts, and other stakeholders to ensure data is accessible, reliable, and scalable. Your expertise in Python and PySpark will be crucial in developing efficient data pipelines and performing complex data transformations.
Responsibilities
Design and implement scalable data architectures on Google Cloud Platform. Develop, deploy, and maintain data pipelines using Python and PySpark. Collaborate with data scientists and analysts to understand their data needs and provide solutions. Ensure data quality, integrity, and security across all data systems. Optimize data storage solutions and manage data lifecycle processes. Mentor junior data engineers and contribute to the overall team knowledge base. Stay updated with the latest trends and technologies in data engineering and big data. Requirements <>Required SkillsProven experience as a Data Engineer with a strong background in Google Cloud Platform. Proficiency in Python and PySpark for data processing and analysis. Experience with data warehousing solutions and SQL databases. Strong understanding of data modeling and ETL processes. Ability to write clean, efficient, and well-documented code. Excellent problem-solving skills and attention to detail. Strong communication skills and ability to work in a collaborative environment. <>Preferred SkillsExperience with other cloud platforms such as AWS or Azure. Knowledge of containerization technologies like Docker and Kubernetes. Familiarity with data visualization tools such as Tableau or Power BI. Experience with machine learning frameworks and libraries. Background in DevOps practices and CI/CD pipelines. Experience with big data technologies such as Apache Hadoop or Apache Kafka. ``` This job description provides a comprehensive overview of the Senior Data Engineer role, highlighting the key responsibilities and required and preferred skills. It is structured to attract qualified candidates who are passionate about data engineering and have the necessary expertise to contribute to the team.