[Remote] Senior Software Engineer - Crawler

Note: The job is a remote job and is open to candidates in USA. ZoomInfo is a fast-moving company that empowers employees to make a significant impact through bold thinking and collaborative work. The Senior Software Engineer will build and operate large-scale web crawling, data extraction, and ETL/ELT infrastructure, writing production code and solving distributed systems challenges. The role also involves collaborating with product and data science teams while improving system reliability, observability, and operational excellence.

Responsibilities

• Design and implement components of scalable, fault-tolerant web crawling and extraction pipelines
• Write clean, production-grade code in Java and Python
• Build and operate ETL/ELT pipelines for large-scale data extraction and transformation
• Work with cloud infrastructure on GCP and AWS, primarily on GKE
• Improve observability, reliability, and operational excellence across the systems you contribute to
• Partner with product and data science teams to deliver impactful solutions
• Contribute to code reviews, documentation, and knowledge sharing across the team
• Stay current with evolving web technologies, anti-crawling mechanisms, and AI-powered extraction approaches

Skills

• * 5+ years of professional software engineering experience building production systems
• * Strong CS fundamentals: algorithms, data structures, concurrency, distributed systems
• * Proficiency in Java and/or Python
• * Track record of owning features end-to-end from design through deployment and operation
• * Comfortable making sound architectural decisions at the component level
• * Hands-on experience with cloud data warehouses such as BigQuery or Snowflake
• * Experience designing and operating large-scale ETL/ELT pipelines
• * Experience with orchestration tools such as Apache Airflow
• * Experience with streaming or event-driven systems such as Apache Kafka
• * Hands-on experience with Kubernetes (GKE/EKS) for distributed workloads
• * Familiarity with infrastructure-as-code tooling such as Terraform
• * Strong communicator who can explain technical decisions clearly
• * Comfortable operating in ambiguity and iterating quickly
• * Bias toward action and pragmatic problem solving
• * Self-starter who thrives in fast-paced, evolving environments
• * Experience with web crawling at scale (Scrapy or similar frameworks)
• * Familiarity with proxy infrastructure, rotation strategies, or anti-bot evasion techniques
• * Experience extracting structured and unstructured web data from diverse site architectures
• * Knowledge of SERP (Search Engine Results Page) extraction
• * Comfort with AI/LLM-based extraction approaches, applying language models to HTML at scale
• * Experience working in a B2B data company or data-as-a-product environment
• * 5+ years of software engineering experience
• * Experience operating systems that process meaningful volumes of data
• * Strong CS fundamentals (algorithms, data structures, distributed systems)
• * Excellent communicator who can explain complex ideas to diverse audiences
• * Passion for solving hard problems and building elegant, scalable systems
• * Self-starter who thrives in fast-paced, evolving environments
• * Experience working in a B2B data company or data-as-a-product environment is a strong plus
• * Production experience on GCP (preferred) or AWS; multi-cloud exposure is a plus

Benefits

• Comprehensive benefits
• Holistic mind, body and lifestyle programs designed for overall well-being
• Additional compensation such as Bonus, Commission, Equity and other benefits may also apply.

Company Overview

Company H1B Sponsorship