
Domain Contributor & AI Evaluation Specialist — 100% Remote AI Benchmark Specialist
As a seasoned practitioner in Domain depth, Source verification, Reasoning clarity, Evaluation expertise, your specialized judgment represents a rare and indispensable asset. Here at RemoteJob USA Staffing, we are proud to advocate for credentialed specialists like you. We are recruiting an experienced Domain Contributor & AI Evaluation Specialist — 100% Remote AI Benchmark Specialist earning $30 - $60/hour to collaborate on domain-specific LLM post-training. You will serve as the final authority on technical accuracy, clinical rigor, and ethical soundness in complex model outputs.
Clinical & Technical Focus Areas
- Document clear rationales for model shortcomings, specifying missed reasoning, source errors, or nuances.
- Apply detailed task guidelines and evaluation rubrics consistently to each submission.
- Submit completed deliverables independently on a rolling basis, meeting project requirements for written and verbal clarity.
- Design nuanced, domain-specific tasks that probe AI model limits and surface reasoning flaws.
- Author questions and scenarios demanding deep subject knowledge, beyond general understanding.
- Assess AI-generated outputs, validating accuracy against authoritative, primary sources in your area of expertise.
Domain Qualifications & Background
- Exceptional written and verbal communication skills to articulate findings and feedback.
- Demonstrated ability to precisely follow detailed instructions and evaluation frameworks.
- Background in adversarial or “stomp the model” task design is advantageous.
- Graduate-level research, experience at a Fortune 100 company, or professional fluency in a non-English language a plus.
- Proven hands-on experience with AI model training, annotation, RLHF, or evaluation.
- Deep expertise in a core domain: history, archival or library science, law (paralegal, legal academic, compliance), finance (equity research, PE/VC, forensic accounting), journalism, or technology/industry history.
- Advanced research skills with a track record of verifying complex claims against authoritative sources.
Contract Terms & Professional Remuneration
- Compensation Rate: $30 - $60/hour (verified contractor remuneration)
- Work Arrangement: 100% Remote / Work From Home
- Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
- Core Competencies: Domain depth, Source verification, Reasoning clarity, Evaluation expertise
- Hiring Lead: Dr. Rachel Adams (Academic & Clinical Sourcing Lead) at RemoteJob USA Staffing
Direct Application Process: Click the Apply button on this page to submit your profile directly for immediate evaluation.
Ready to Apply for Domain Contributor & AI Evaluation Specialist — 100% Remote AI Benchmark Specialist?
Applications are routed directly to our verified partner application portal for Domain Contributor & AI Evaluation Specialist — 100% Remote AI Benchmark Specialist ($30 - $60/hour).
Apply Now for This Position →