[Remote] Domain Expert, AI Evaluation Task Writer: Sales (Contract, Remote)

Note: The job is a remote job and is open to candidates in USA. Patronus AI is hiring a Sales Domain Expert to create realistic sales tasks used as evaluation and training data for frontier AI models. The contractor will build scenario-based evidence files, write and solve tasks, define scoring criteria, test tasks against models, and review work for quality.

Responsibilities

• Build realistic evidence files from a provided scenario: CRM opportunity and activity exports, pipeline and forecast reports, lead lists and routing rules, prospect email threads and call notes, proposals and pricing sheets, quotes and order forms, discount approval requests, renewal schedules and usage reports, territory maps, quota plans and commission statements
• Write clear task requests that state what the deliverable is and how uncertainty and justified assumptions should be handled
• Solve each task end to end and document a reference solution with the reasoning behind every step
• Write explicit scoring criteria that let two independent graders reach the same verdict, including acceptable alternative answers and the limits of what the solver is authorized to offer or approve
• Run tasks against current models, find where and why they fail, and adjust difficulty
• Check your own and peers' tasks for ambiguity, errors, answers exposed in the materials and shortcuts that skip the intended reasoning
• Incorporate reviewer feedback within agreed turnaround times and flag guideline gaps or edge cases you run into

Skills

• 3+ years of hands-on experience in one or more of the four areas above, as an SDR or BDR, account executive, account manager or customer success manager, or a sales, revenue or deal desk operations analyst or manager. You need to have carried the number or run the process yourself, not only managed people who did
• Working command of the methods, rules and systems in your area (for example a qualification framework such as MEDDICC or SPICED, forecast categories and stage exit criteria, discount approval matrices and non-standard terms, commission plan mechanics and territory rules)
• Strong spreadsheet skills, and the habit of reconciling pipeline, quota and commission figures to their source
• Clear, precise writing in professional English
• Ability to work independently and asynchronously against deadlines
• Experience in B2B SaaS, enterprise or mid-market selling, across more than one motion (inbound, outbound, partner or product-led)
• Experience with the systems used in your area, such as Salesforce or HubSpot, Outreach or Salesloft, Gong or Chorus, Clari, Salesforce CPQ or DealHub, and CaptivateIQ or Xactly
• Sales enablement, training or onboarding experience, or having written playbooks, call scorecards or certification exams
• Prior experience writing or reviewing AI evaluation tasks, exam questions, case studies or training material
• Familiarity with how AI models fail (invented customer facts, miscalculated discounts or commissions, overconfident forecasts, generic objection handling)

Benefits

• Potential bonus for each accepted task
• Strong performers move up within that range or onto productivity-based pay
• The trial task is paid
• Independent contractor, fully remote, asynchronous

Company Overview

Company H1B Sponsorship