In-House Counsel (Japan) | $140-$150/hr Remote
Overview
This remote role puts your Japanese legal expertise to work in a unique way: helping evaluate how well AI systems handle real questions of Japanese law. As an expert reviewer, you'll run identical prompts through two different AI platforms, compare their responses, and score them against a precise rubric. Your feedback will directly influence the development of legal AI tools. It's a flexible, hourly engagement with an initial commitment of roughly 10 hours — perfect for experienced in-house counsel seeking a short-term, high-impact project.
What You'll Do4
- 1Execute a standardized set of prompts across two distinct AI language model platforms to generate legal answers.
- 2Compare the two outputs side by side, assessing their accuracy, completeness, and alignment with Japanese legal principles.
- 3Score each AI response against a defined rubric, ensuring consistent and objective evaluation.
- 4Submit clear, concise written feedback for every assessment, explaining the reasoning behind each score.
Requirements4
- 1A minimum of 5 years of experience as in-house legal counsel practicing in Japan.
- 2Strong command of Japanese commercial and contract law, with the ability to evaluate nuanced legal questions.
- 3Exceptional attention to detail and precise written communication skills.
- 4Ability to work independently, adhere strictly to a rubric, and meet deadlines without supervision.
Who Should Apply
You're a seasoned in-house lawyer in Japan with a genuine interest in the intersection of law and technology. You're comfortable working autonomously, have a talent for meticulous evaluation, and want to contribute to improving AI legal tools. If you can commit about 10 hours initially and thrive on structured, analytical tasks, this role is a great match.
Salary Insight
The position pays $140–$150 per hour on an hourly, remote basis.
Location
Required Skills
Application Tip
When applying, highlight any prior experience you have with AI tools or legal tech, and give specific examples of how you've applied objective criteria or rubrics in your work. Emphasize your ability to deliver fair, well-reasoned evaluations under tight deadlines.
Similar open positions
Explore active roles that match your skills and interests.
Mercor
VerifiedIn-House Counsel (United Kingdom) | $150-$160/hr Remote
Join a pioneering legal AI initiative as an expert reviewer, helping benchmark how well artificial intelligence handles real questions of UK law. You'll work remotely on an hourly basis, comparing responses from two AI platforms against a structured rubric. This is a unique chance to apply your in-house legal experience to shape the accuracy and reliability of AI in the legal sector. The role offers a flexible, short-term commitment with strong potential for extended work.
Mercor
VerifiedIn-House Counsel (Australia) | $100-$120/hr Remote
Mercor is looking for experienced Australian in-house counsel to partner with a leading legal AI company as expert reviewers. You'll evaluate how two AI systems answer real questions about Australian law by running identical prompts through both platforms. The job involves comparing outputs, scoring them against a predefined rubric, and providing concise written feedback. This is a flexible, remote opportunity starting at roughly 10 hours, with potential for more work if performance is strong.
Mercor
VerifiedIn-House Counsel (Germany) | $140-$150/hr Remote
Mercor is looking for experienced in-house counsel in Germany to help benchmark the legal accuracy of AI systems. You'll act as an expert reviewer, feeding identical prompts to two different large language models and evaluating their responses against a clear scoring guide. This is a remote, hourly role perfect for lawyers who want to shape how AI handles German law. The initial engagement is about 10 hours, with the possibility of more work down the line. All work is confidential and covered by an NDA.
Mercor
VerifiedIn-House Counsel (Spain) | $140-$150/hr Remote
Mercor is helping a legal AI company measure how well AI systems handle real questions about Spanish law. We're seeking experienced in-house counsel to act as expert reviewers. You'll run the same prompts through two different AI platforms, compare their responses, and score them against a standard rubric. This is a remote, hourly role—perfect for legal professionals who want to shape AI quality while earning a strong rate.
Mercor
VerifiedIn-House Counsel (France) | $150-$160/hr Remote
Mercor is looking for seasoned legal professionals in France to help assess the reliability of AI-generated answers on French law. You'll act as an expert reviewer, sending the same set of prompts through two different AI systems, then comparing and scoring their responses using a standardized scoring guide. This is a remote, hourly position that offers a high rate and a flexible entry commitment. Working directly with a leading legal AI company, you'll play a key role in benchmarking how well large language models understand and apply French jurisprudence.
Mercor
VerifiedLaw Experts | $110-$150/hr Remote
This is a remote, part-time opportunity for seasoned legal professionals to help train AI systems used by large enterprises. You'll design realistic legal scenarios, create reference answers, and build scoring rubrics that measure deep legal judgment rather than superficial responses. The work draws on your experience with Fortune 500 compliance, contracting, and risk challenges, and pays between $110 and $150 per hour. What sets this apart is the chance to shape AI evaluation standards while working flexibly with a paid onboarding program.