[Remote] Lead Software Engineer, Search (Semantic Platform)

Note: The job is a remote job and is open to candidates in USA. Commerce is hiring a Lead Software Engineer to build and scale semantic hybrid search on OpenSearch as a foundational platform capability. The role leads search architecture, relevance optimization, indexing pipelines, technical direction, and production reliability.

Responsibilities

• Architect the Future of Search: Lead the design and implementation of semantic search capabilities, utilizing OpenSearch to build a robust, hybrid search (BM25 + vector) capability from the ground up
• Iterate & Optimize: Continuously evaluate, benchmark, and fine-tune search relevance, ranking models, and k-NN/neural search configurations within OpenSearch
• Own the Indexing Pipeline: Maintain, scale, and evolve our core data ingestion and indexing pipelines (built on MySQL, Kafka/RabbitMQ, and backend microservices) to seamlessly support dense vector ingestion and de-duplicated, resilient synchronization
• Technical Leadership: Guide the technical roadmap for the Search team, establish engineering best practices, and mentor senior and mid-level engineers through complex architectural decisions
• Production Excellence: Ensure the search platform meets ultra-low latency requirements and high-availability SLAs under massive, concurrent traffic loads while participating in the team's on-call rotation

Skills

• 7+ years of professional software development experience, with a proven track record in a technical leadership or staff-level capacity
• Deep hands-on experience building, scaling, and fine-tuning OpenSearch (or Elasticsearch) clusters at scale
• Proven experience implementing semantic search, working with text embeddings, vector databases, and configuring hybrid search scoring models
• High proficiency in a strongly typed language like GoLang, Scala, or Java, alongside experience with languages like PHP
• Strong experience with relational databases (MySQL), schema design, and distributed messaging tools (Kafka or RabbitMQ) for heavy data mutation and indexing
• Familiarity with the OpenSearch Neural Search plugin, k-NN search, or Learning to Rank (LTR)
• Experience migrating large-scale search infrastructure from traditional Elasticsearch configurations to advanced OpenSearch semantic implementations
• Experience setting up automated search quality measurement frameworks (e.g., NDCG, MRR)
• Familiarity with containerization and orchestration (Docker, Kubernetes) in a cloud environment

Benefits

• Remote work in the United States
• Where applicable, this role may also be eligible for variable compensation (such as bonus or commission)
• Where applicable, this role may also be eligible for equity

Company Overview

Company H1B Sponsorship