[Remote] Content Pipeline Engineer

Note: The job is a remote job and is open to candidates in USA. Black Canyon Consulting LLC is seeking a Content Pipeline Engineer to build reusable systems for processing, indexing, and retrieving unstructured documents and map-related content. The role develops OCR and multimodal extraction, semantic retrieval, and agentic workflows, while supporting downstream applications and AI services.

Responsibilities

• Design and implement reusable ingestion and processing pipelines for PDFs, scanned documents, images, forms, maps, and other unstructured content
• Implement OCR and multimodal document-processing workflows for both standard documents and map-related materials
• Extract text, tables, metadata, identifiers, and domain-specific attributes from source documents
• Support extraction of information from plats and survey drawings, including legal descriptions, labels, bearings, distances, and other spatially relevant information
• Develop document parsing, classification, normalization, chunking, and metadata-enrichment processes
• Maintain linkage and provenance between extracted information, source documents, originating systems, and related business records
• Build document and vector indexes using OpenSearch or comparable technologies
• Implement embeddings, semantic search, and retrieval pipelines
• Develop APIs and reusable interfaces enabling downstream applications and AI services to search and retrieve document content
• Implement agentic workflows for activities such as document classification, extraction strategy selection, validation, exception handling, and quality assurance
• Establish confidence thresholds and human-review processes for uncertain or ambiguous extractions
• Work with GIS engineers to connect map and document extraction results with georeferenced and vectorized geometry
• Work with Data Scientists to create evaluation datasets and measure OCR, extraction, retrieval, and classification quality
• Build automated testing, monitoring, and observability for document-processing pipelines
• Optimize processing for accuracy, throughput, repeatability, and cost

Skills

• Bachelor's degree in Computer Science, Software Engineering, Data Science, Information Systems, or a related technical field
• 5+ years of software engineering, data engineering, search, document-processing, or related experience
• Strong Python development experience and experience building production-grade data or content-processing pipelines
• Hands-on experience processing PDFs, images, scanned documents, and semi-structured content using OCR and document-extraction technologies
• Experience with document stores, search engines, or vector databases, including embeddings and semantic retrieval
• Experience with document parsing, classification, chunking, metadata enrichment, and preservation of source provenance
• Experience with LLM-enabled or agentic document-processing workflows, including extraction, validation, routing, or exception handling
• Experience building robust pipelines with automated testing, logging, monitoring, error handling, and quality controls
• Experience evaluating OCR and extraction quality using measurable criteria and confidence thresholds
• Strong problem-solving skills for working with complex and inconsistent document formats
• Experience with OpenSearch
• Experience with AWS document-processing, AI, or machine-learning services
• Experience with agentic frameworks such as LangChain, LangGraph, or similar orchestration frameworks
• Experience with multimodal models, vision-language models, or LLM-based document extraction
• Experience building RAG or enterprise semantic-search solutions
• Experience with maps, engineering drawings, plats, survey documents, or legal descriptions
• Experience extracting bearings, distances, coordinates, or other geospatial information from documents
• Experience working in the U.S. Federal Government space
• Experience with permitting, environmental, energy, land-management, or regulatory documents

Benefits

• Medical, dental, and vision coverage
• 401k plan with employer contribution
• Paid holidays
• Vacation
• Tuition reimbursement
• Remote position

Company Overview

Company H1B Sponsorship