Kafka Solution Architect
Greetings from Skysoft Job Title: Kafka Solution Architect With .NET Location: 100% Remote – USA Experience: 15+ Years Visa: Only US Citizen/ H1B’S and GC Holders
Job Description
We are seeking an experienced Kafka Solution Architect with a strong .NET/C# background to design and implement scalable, secure, event-driven enterprise solutions. The ideal candidate will have extensive experience with Apache Kafka, distributed systems, microservices architecture, API integration, and Microsoft .NET technologies. The candidate will be responsible for defining architecture, designing real-time data streaming solutions, integrating Kafka with .NET applications and enterprise APIs, and providing technical leadership throughout the development lifecycle. Key Responsibilities · Design and implement enterprise-grade event-driven architectures using Apache Kafka and the Microsoft .NET ecosystem. · Architect scalable, fault-tolerant, and highly available distributed systems using Kafka producers, consumers, topics, partitions, consumer groups, and replication. · Develop and integrate microservices using C#, .NET Core/.NET 6+, ASP.NET Core, and RESTful APIs. · Design asynchronous communication patterns and event-driven workflows between .NET applications and enterprise systems. · Implement Kafka-based messaging, event streaming, data integration, and real-time processing solutions. · Integrate Kafka with API gateways and enterprise integration platforms such as Apigee, Kong, MuleSoft, or AWS API Gateway. · Define event schemas, serialization standards, and schema evolution strategies using Avro, JSON, or Protobuf and Schema Registry. · Implement security controls, including OAuth 2.0, OpenID Connect, JWT, TLS/SSL, authentication, and authorization. · Design retry mechanisms, dead-letter queues, idempotent processing, error handling, and disaster recovery strategies. · Collaborate with application development, cloud, DevOps, security, and infrastructure teams to deliver production-ready solutions. · Establish architectural standards, conduct code and design reviews, and mentor development teams. · Support deployment and monitoring of Kafka and .NET applications in cloud environments using Docker, Kubernetes, and CI/CD pipelines. Required Technical Skills · 10+ years of overall experience in software engineering, solution architecture, or enterprise application development. · Strong hands-on experience with Apache Kafka, including Kafka producers, consumers, topics, partitions, consumer groups, replication, and performance tuning. · Strong background in C#, .NET Core/.NET 6+, ASP.NET Core, and REST API development. · Experience designing microservices and distributed applications using event-driven architecture. · Expertise in asynchronous messaging, event streaming, and system integration patterns. · Experience with Kafka Connect, Schema Registry, Kafka Streams, or equivalent stream-processing technologies. · Strong understanding of API design, API security, authentication, authorization, and enterprise integration. · Experience with SQL/NoSQL databases, distributed transactions, eventual consistency, and fault-tolerant systems. · Experience with Git, CI/CD pipelines, Docker, Kubernetes, and automated deployment practices. · Strong communication skills and the ability to translate business requirements into technical architecture. Preferred Skills · Experience with Confluent Platform or Confluent Cloud. · Cloud experience with Microsoft Azure, AWS, or Google Cloud Platform. · Azure Service Bus, Event Hubs, or other enterprise messaging technologies. · Experience with API gateways such as Apigee, Kong, MuleSoft, or AWS API Gateway. · Knowledge of observability tools, centralized logging, metrics, tracing, and production monitoring. · Experience modernizing legacy .NET applications into cloud-native microservices. · Familiarity with enterprise security, governance, high availability, scalability, and disaster recovery.