Remote Position
[Remote] Sr Data Engineer (Google Cloud Platform)
π Remote Β· United States
πΌ Full-time
Note: The job is a remote job and is open to candidates in USA. K&K Global Talent Solutions Inc. is an international recruiting agency providing technical resources in the United States and Canada. The company is seeking a Senior Data Engineer to design, build, govern, and optimize scalable data platforms, ETL/ELT pipelines, and integrations using Google Cloud Platform, PySpark, Airflow, Hive, and Kafka.
Responsibilities
- Design, build, and maintain scalable ETL/ELT pipelines
- Automate data ingestion from multiple data sources
- Ensure reliable, high-performance, and scalable data movement
- Develop and optimize PySpark-based data processing frameworks
- Build and manage Airflow workflows and orchestration pipelines
- Work with Hive and Kafka-based batch and streaming data solutions
- Implement data quality, monitoring, governance, and operational controls
- Support production incidents, performance tuning, and continuous improvement initiatives
- The Data Engineer will be responsible for designing, building, governing, and optimizing data platforms, pipelines, and integrations to ensure secure, reliable, and scalable data availability for analytics, reporting, AI/ML, and business operations
Skills
- Google Cloud Platform (Google Cloud Platform)
- PySpark
- Python
- Airflow
- Hive
- Kafka
- Strong Functional Knowledge in Retail (Search & Personalization)
- Strong experience with large-scale Google Cloud Platform Data Engineering solutions
- Hands-on experience with Airflow DAG development and support
- Experience building and optimizing Spark/PySpark data pipelines
- Exposure to Hive-based data processing and Kafka-driven ingestion frameworks
- Experience supporting analytics, personalization, recommendation, or search platforms
Benefits
- Remote work arrangement
Company Overview
Company H1B Sponsorship