Remote Data Labeling Specialist (Portland)
Remote Data Labeling Jobs in Portland Rex.zone is hiring a Remote Data Labeling Specialist (Portland) to create and evaluate training data for modern AI systems. You will label and review text, images, and multimodal content used in LLM evaluation , RLHF workflows, and computer vision annotation , collaborating asynchronously with QA leads and ML teams.
What You Will Do
Execute data labeling and data annotation across NLP and computer vision workflows (NER, classification, ranking, structured extraction) Support RLHF via preference labeling, rubric scoring, prompt evaluation, and response quality judgments Perform QA evaluation: audit labeled datasets, resolve edge cases, and enforce annotation guidelines compliance Contribute to content safety labeling (toxicity, self-harm, regulated topics) with policy-based tagging Document decisions, escalate ambiguous examples, and help refine instructions to improve training data quality Project Types You May Support LLM training pipelines: prompt/response grading, factuality checks, instruction-following evaluation RLHF: pairwise preference labeling, reward model data generation, disagreement resolution NLP: named entity recognition, intent classification, sentiment/stance labeling Computer vision: bounding boxes, polygons, keypoints, attribute tagging QA evaluation: sampling plans, inter-annotator agreement checks, targeted rework
Requirements
Mid-Senior experience in data labeling, data annotation, or QA evaluation for ML datasets Ability to follow complex annotation guidelines, handle edge cases, and maintain consistent quality Familiarity with NLP (e.g., named entity recognition) and/or computer vision annotation fundamentals LLM evaluation and prompt evaluation experience preferred; RLHF exposure is a plus Strong written communication and ability to collaborate asynchronously in a remote environment Work Model & Location This is a Remote , FULL_TIME role aligned to Portland, Oregon candidates or those seeking Portland-aligned remote opportunities. Work is performed online using secure annotation tools and task platforms. Pay $30–$50 per hour (hourly base pay range).