[Remote] Agentic AI/LLM Engineer, Coverage Intelligence

Note: The job is a remote job and is open to candidates in USA. Bold Penguin hires an Agentic AI/LLM Engineer for its Coverage Intelligence team to build production AI systems that turn complex insurance documents into reliable, explainable coverage intelligence. The role owns document understanding and coverage-analysis workflows end to end, evaluates system accuracy, and partners with coverage and ontology specialists to guide technical development.

Responsibilities

• Design, build and own production AI systems for document understanding and coverage analysis
• Build agentic workflows that combine models, tools and human review, and recognize when a decision needs an expert
• Ground outputs in source documents and domain knowledge so every result is traceable and explainable
• Drive accuracy through evaluation, experimentation and error analysis against expert-labeled data
• Make sound trade-offs across models and providers on accuracy, cost and latency
• Partner with domain experts and engineers to turn expert judgment into durable system behavior
• Help set the team’s technical direction as LLM and agent capabilities evolve
• Other duties and responsibilities as assigned

Skills

• 5+ years' experience in software engineering or applied machine learning, including 2+ years building LLM applications in production
• Strong Python skills, including typed schemas for structured output (e.g., Pydantic)
• Hands-on experience extracting structured data from complex documents using PDF parsing, OCR and vision-language models
• Experience with agentic patterns such as tool use, multi-step workflows, self-verification and human-in-the-loop review
• Experience with retrieval-augmented generation, embeddings and source-grounded output
• A rigorous approach to evaluation: defining metrics, building test sets and doing systematic error analysis
• Excellent written and verbal communication skills, including working directly with domain experts
• Works autonomously with minimal direction, sets a clear path through ambiguity, and holds a high bar for quality
• Thrives on the energy of a start up: comfortable with pace, changing priorities, and building the function while running it
• Experience with insurance, legal, financial or other contract-heavy documents (strongly preferred)
• Experience with LangGraph or similar agent frameworks (preferred)
• Experience with LLM observability and evaluation tooling (preferred)

Benefits

• Fully remote role, with the exception of onboarding and optional in-office events.
• Travel costs are covered for New Hire Onboarding & Orientation in Dublin, Ohio (2 days, 2 nights).
• Medical, Dental, and Vision
• Flexible PTO Policy
• 401(k) with a company match
• Employee Assistance Program
• Parental Leave
• Disability and Life Benefits
• Slack channels for work and play
• Regular video conferences and all-hands “Waddles”
• Penguin-themed swag

Company Overview

Company H1B Sponsorship