Robotic Manipulation Task Evaluator
Robotic Manipulation Task Evaluator is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the corrected behavior so the modeling team can train on it. Why this role matters Robotics review systems run in the physical world, where a confident-looking failure can hurt someone. AuraOne uses experienced robotics and operations reviewers to grade outputs against perception, motion, and safety constraints.
Responsibilities
- Review robotics review outputs against current safety standards and operating envelopes for Robotic Manipulation Task Evaluator assignments.
- Grade perception, motion, and decision logic on a structured rubric.
- Flag near-miss and unsafe trajectories with severity tags that match incident taxonomies.
- Capture the corrected behavior or reference trajectory so the modeling team can train on it.
- Adjudicate disputed cases against published standards or firm operating procedures.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Hands-on experience with robotic, autonomous, or teleoperated systems. Operating, supervising, or evaluating them for Robotic Manipulation Task Evaluator work.
- Comfort reasoning about perception, motion planning, and physical safety envelopes.
- Familiarity with structured incident taxonomies and severity scoring.
- Clear written reasoning that names the failure mode and the standard being applied.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Grade a robotics review model's chosen trajectory and flag any near-miss or unsafe motion.
- Score a perception output against ground-truth labels and rate the failure category.
- Adjudicate a disputed safety call between two reviewers using firm operating procedures.
- Audit a 25-trajectory batch for rubric consistency and report drift to the program lead.
Nice to have
- Background in robotics engineering, autonomy operations, or industrial safety.
- Prior experience reviewing AI-assisted robotics tooling and its failure modes.
- Familiarity with simulation environments and trajectory-replay tooling.
Skills
- Robotics evaluation
- Perception review
- Motion safety
- Incident taxonomy
- Robotics review
- Embodied AI
- Safety review
- Robotic
- Manipulation
Work model Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process. Application process Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.