$45-$75/hr - Law Specialist - AI Prompt & Output Review

About the Role

We’re supporting an AI innovation initiative seeking practicing and non-practicing legal professionals to help evaluate and improve law-focused AI training data. In this role, you’ll apply your legal reasoning, analytical thinking, and subject-matter expertise to assess the accuracy and quality of AI outputs used to train next-generation generative AI systems.

This is a meaningful opportunity for legal professionals interested in technology, research, and the intersection of law and artificial intelligence. The role offers flexible scheduling, remote work, and the chance to directly influence the future of AI systems supporting legal workflows.

What You’ll Do

• Create and refine law-based prompts and test scenarios

• Evaluate AI-generated responses using structured rubrics and legal frameworks

• Review reasoning for accuracy, logical consistency, and compliance with legal standards

• Identify errors, risks, and opportunities for improvement in model outputs

• Provide clear written feedback and scoring based on your subject-matter expertise

• Collaborate with project teams and participate in weekly sync meetings

• Contribute to the development and improvement of evaluation rubrics

Ideal Candidate Profile

• Strong background in legal research, practice, academia, or consulting

• Precision-focused reviewer who can analyze complex legal reasoning

• Comfortable adapting to changing workloads and priorities

• Skilled written communicator who explains complex concepts clearly

• Experience working with LLMs or AI evaluation is a plus, but not required

Required Qualifications

• Bachelor’s degree or higher in Legal Studies, Criminal Justice, or related field
  (JD, paralegal certification, or recent legal practice strongly preferred)

• Strong command of written English and legal reasoning

• High attention to detail and consistency in evaluations

• Ability to commit to 10+ hours/week with flexibility

• U.S.-based and authorized to work in the United States

Preferred Qualifications

• Experience working with AI, machine learning, or digital content evaluation

• Background in legal academia, consulting, or specialty legal practice

• Interest in AI ethics, responsible innovation, or the future of legal technology

Compensation & Schedule

• Task based pay scale - $15 per accepted task

  • Expect 3-6 tasks per hour for an hourly rate of $45-$75/hr

• Variable weekly hours (average 5–20 hours; may peak at 40 based on workload)

• Fully remote role, U.S.-only

About Ami Arroyo Recruiting

Ami Arroyo Recruiting is committed to supporting candidates with transparency, respect, and personalized guidance. We take pride in connecting exceptional talent with innovative teams—ensuring every candidate feels supported throughout the process. We’re an Equal Opportunity Employer and welcome applicants from all backgrounds who are eligible to work in the U.S.