[Remote] Remote | Lawyer/Legal Writer — $90–$140/hour

Note: The job is a remote job and is open to candidates in USA. 24-MAG LLC offers an independent-contractor consulting engagement evaluating AI-generated legal and technical writing. The role reviews accuracy, reasoning, clarity, and audience suitability, applies structured scoring criteria, and documents assessments with written rationales; it does not involve legal advice or representation.

Responsibilities

• Evaluate and compare AI-generated responses to legal and technical prompts
• Assess clarity, tone, precision, completeness, and adherence to instructions
• Determine whether content is appropriately qualified for the subject matter
• Evaluate whether responses are suitable for legal, regulatory, client, or public audiences
• Apply consistent professional judgement across repeated evaluation tasks
• Identify unsupported claims, unwarranted overstatements, and weak legal reasoning
• Detect factual inaccuracies, ambiguities, and internal inconsistencies
• Assess whether authoritative-sounding content is adequately supported
• Review arguments for logical coherence and appropriate qualification
• Flag issues that could affect reliability, usability, or interpretation
• Apply defined evaluation criteria and project guidelines consistently
• Assign analytical quality scores to written responses
• Compare competing outputs and distinguish stronger from weaker reasoning
• Evaluate responses against standards for accuracy, usefulness, and audience fit
• Maintain objective and repeatable assessment practices across assignments
• Produce detailed written rationales explaining assessment decisions
• Clearly articulate why particular responses are accurate, incomplete, or problematic
• Document findings and observations thoroughly in digital review platforms
• Maintain clear records of scoring and evaluation decisions
• Communicate complex legal-writing judgements concisely and professionally
• Apply experience from drafting and reviewing briefs, motions, memoranda, opinions, or regulatory submissions
• Edit and assess written legal content for structure, clarity, and precision
• Collaborate asynchronously with project managers and reviewers
• Support consistent evaluation standards across project contributors
• Work independently while meeting assigned deadlines and quality expectations

Skills

• English as a first language or fully equivalent written fluency
• Qualifying law degree from a university in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand
• Demonstrated experience drafting briefs, motions, memoranda, legal opinions, regulatory submissions, or comparable legal materials
• Experience reviewing, editing, or supervising legal writing by junior lawyers, trainees, or paralegals
• Strong legal-writing, document-review, and content-evaluation skills
• Ability to assess whether writing is appropriately tailored for different audiences
• Exceptional attention to detail and critical-analysis ability
• Excellent written communication and editing skills
• Strong judgement around precision, qualification, and unsupported assertions
• Comfortable applying structured evaluation criteria and documenting decisions
• Experience with digital document-review platforms or annotation tools is desirable
• Familiarity with model evaluation, RLHF, or similar workflows

Benefits

• Fully remote

Company Overview