Data Engineer with Golang
Job Title: Senior Data Engineer / Staff Software Engineer (Go, GCP, Kafka) Location: Remote Duration: 12+ Months/ W2 Job Overview Our client is seeking a highly skilled Senior Data Engineer / Staff Software Engineer to join a cutting-edge data engineering team focused on building scalable analytics and software solutions for large-scale scientific and enterprise datasets. This role involves designing distributed systems, developing high-performance APIs, leading technical initiatives, and mentoring engineers while working in a cloud-native environment.
Key Responsibilities
Design and develop scalable data platforms and distributed processing solutions. Build and maintain high-performance RESTful APIs using Go (Golang). Develop and optimize large-scale data processing pipelines. Work with Apache Kafka for streaming and real-time data processing. Design, deploy, and support cloud-native applications on Google Cloud Platform (GCP). Build and maintain containerized applications using Docker and Kubernetes. Model and manage large-scale relational and NoSQL databases. Lead technical initiatives and provide mentorship to engineering teams. Collaborate with cross-functional teams to deliver innovative data-driven solutions. Participate in architecture reviews, code reviews, and best practice initiatives. Required Skills Strong software engineering experience with Go (Golang). Experience building and maintaining RESTful APIs. Hands-on experience with Apache Kafka. Strong understanding of data structures, algorithms, and software design principles. Experience with Docker and Kubernetes. Experience deploying solutions on AWS, Azure, or Google Cloud Platform. Expertise in large-scale database design, data modeling, and optimization. Experience with unit testing and Test-Driven Development (TDD). Strong communication and stakeholder management skills.
Preferred Qualifications
Experience with Google Cloud Platform (GCP), Dataflow, Apache Beam, and Google Kubernetes Engine (GKE). Knowledge of gRPC and Protocol Buffers. Experience working with large scientific, analytics, or research datasets. Bioinformatics or data mining experience is a strong plus. Must-Have Skills Go (Golang) REST APIs Apache Kafka GCP / Cloud Platforms Kubernetes Docker Data Engineering Distributed Systems Database Design & Data Modeling Test-Driven Development (TDD)