Russian Audio Generalist Evaluator Expert
Overview
Mercor connects elite creative and technical talent with leading AI research labs. This expert role focuses on evaluating Russian audio content for a San Francisco Bay Area position. The ideal candidate will establish evaluation standards and drive improvements in language model performance.
What You'll Do6
- 1Transcribe and optimize Russian audio and video content ensuring clarity and guideline adherence
- 2Produce high-quality written outputs in Russian and English capturing nuances and dialectal variations
- 3Establish evaluation standards and develop rubrics for Russian and English audio contexts
- 4Conduct model testing evaluate outputs and provide feedback to improve Russian task performance
- 5Support QA cycles to ensure dataset consistency and benchmark reliability
- 6Collaborate with project leads to resolve ambiguities and enhance task design
Requirements9
- 15+ years building ETL pipelines with Spark and Airflow
- 2Native or near-native fluency in Russian and professional fluency in English
- 3Familiarity with spoken Russian regional vocabulary and dialects
- 4Ability to transcribe and analyze Russian audio content
- 5Must be based in the San Francisco Bay Area available for 10–20 hours weekly
- 6Background in linguistics humanities social sciences journalism translation localization or technical disciplines
- 7Preference for college students or recent graduates
- 8Experience with transcription annotation localization evaluation or research workflows in Russian
- 9Interest in AI language models or applied research environments
Salary Insight
$50k per year
Location
Required Skills
Similar open positions
Explore active roles that match your skills and interests.
Mercor
VerifiedRussian Audio Generalist Evaluator Expert (San Francisco Bay Area) | $50/hr Remote
Mercor is looking for a Russian-speaking audio generalist to support an AI research project focused on improving language models. In this remote, part-time role, you'll transcribe, annotate, and evaluate Russian audio and video content, helping define quality standards and benchmark model outputs. This is a short-term, structured engagement for someone based in the San Francisco Bay Area, with occasional in-person collaboration possible. The role blends linguistic expertise with AI evaluation, offering $50/hour for 10-20 hours per week.
Mercor
VerifiedRussian Linguistics Specialist AI Trainer
You will own Russian audio evaluation and transcription for AI training data at Mercor. This role pairs Russian fluency with AI model testing, shaping outputs for top research labs. You will work with a small team of linguists and engineers, reporting to project leads. Unique in its focus on dialectal nuance and rubric development, this contract offers $50/hour and remote flexibility.
Mercor
VerifiedMusic Audio Expert - Russian | $9.92-$11.41 One-Time Remote
Mercor wants experienced music ears to assess the output of generative AI music models, collaborating with a top AI research lab. In this remote, task-based role, you'll compare AI-generated songs side by side and score them on musicality, creativity, vocal quality, and production polish. You'll work in Russian and English, using a structured taxonomy to annotate genres, song structure, and vocal/instrumental traits. It's a flexible, part-time project for up to six months, perfect for music pros who want to shape AI's understanding of sound.
Mercor
VerifiedMedia Evaluator Communications Expert AI Trainer
Mercor matches elite creative and technical talent with leading AI research labs. We evaluate AI-generated artifacts against domain-specific quality rubrics. This contract role involves independent asynchronous work to improve AI models through feedback.
Mercor
VerifiedMusic Audio Expert - Spanish (MX) | $3.72-$9.86 One-Time Remote
Mercor is partnering with a top AI lab to bring experienced music professionals into the loop for evaluating generative music models. This remote, task-based role focuses on assessing AI-generated tracks in Spanish and English, with an emphasis on Mexican Spanish-language music. Your ratings and annotations will directly shape how AI systems understand musicality, creativity, and production quality. The work is flexible — you can put in 10+ hours per week on a schedule that works for you, with pay tied to completed evaluations.
Mercor
VerifiedMusic Audio Expert - Korean | $9.92-$11.41 One-Time Remote
Mercor is looking for music professionals to help evaluate and improve generative music AI models. You'll listen to AI-generated tracks across many genres and rate them against detailed quality standards, working primarily in Korean and English. This remote, part-time role runs up to six months and pays per completed evaluation rather than per hour. It's a unique chance to put your musical ear and Korean language skills to work on cutting-edge AI technology.