Greek Speaking JSON Coding Expert for AI Audio Evaluation
Overview
You will evaluate AI-generated audio responses for an Enterprise client, owning the review of JSON structure, technical accuracy, and natural language quality. Work begins immediately and spans 2-3 months with potential extension. As an Operator, you will run live conversational scenarios, label transcripts, and score outputs using structured rubrics. You will work with JSON daily, identifying formatting issues and validating structure. This role suits a bilingual technical expert who speaks naturally and catches subtle errors in AI speech.
What You'll Do8
- 1Participate in live, real-time conversational scenarios with AI systems in Greek, speaking naturally and spontaneously.
- 2Review and label conversation transcripts for accuracy and quality.
- 3Evaluate AI-generated responses using structured rubrics, providing written justifications for scores.
- 4Assess responses for language quality, customer experience, technical accuracy, and JSON structure.
- 5Capture required session artifacts including recordings, Session IDs, and tool-call/console logs.
- 6Prepare your environment and verify tools before each session.
- 7Flag and document JSON formatting errors, structural issues, and troubleshooting steps.
- 8Maintain high attention to detail while evaluating both customer experience and technical correctness.
Requirements8
- 1C1/C2-level fluency in Greek, verified through a speaking/listening assessment.
- 2JSON fluency: read, validate, troubleshoot, and identify structural/formatting issues.
- 3Pass a 15-minute basic computational concepts assessment (JSON structures, function, general reasoning, and language proficiency).
- 4Basic computational knowledge: understanding of functions, reasoning, and logical structures.
- 5Strong attention to detail and written communication skills.
- 6Ability to evaluate customer experience and technical correctness of responses.
- 7Capable of producing clear audio quality with no background noise.
- 8Availability to start immediately and work for 2-3 months, with potential for extension.
Salary Insight
Salary not disclosed in listing
Location
Required Skills
Similar open positions
Explore active roles that match your skills and interests.
Mercor
VerifiedMusic Audio Expert - Greek | $3.43-$3.94 One-Time Remote
Mercor is partnering with a top AI research lab to bring experienced music professionals into a remote, task-based project evaluating generative music models. You'll listen to AI-generated tracks across genres and score them against detailed criteria, working in Greek and English. Your ear will directly shape how the next generation of music AI is trained and refined. This is a paid, part-time opportunity with flexible hours and immediate start.
Mercor
VerifiedAudio Engineer, Music & Voice AI (Greek Speaker)
You will evaluate AI-generated music, lyrics, and voice output for Mercor's AI research partners. You will score training data quality, write original Greek music, and collaborate with a remote team of specialists. This contract role pays $16/hour for 10+ hours/week and runs up to 6 months. You own the quality bar for Greek music output in a global AI initiative.
Mercor
VerifiedRussian Audio Generalist Evaluator Expert (San Francisco Bay Area) | $50/hr Remote
Mercor is looking for a Russian-speaking audio generalist to support an AI research project focused on improving language models. In this remote, part-time role, you'll transcribe, annotate, and evaluate Russian audio and video content, helping define quality standards and benchmark model outputs. This is a short-term, structured engagement for someone based in the San Francisco Bay Area, with occasional in-person collaboration possible. The role blends linguistic expertise with AI evaluation, offering $50/hour for 10-20 hours per week.
Mercor
VerifiedRussian Audio Generalist Evaluator Expert
Mercor connects elite creative and technical talent with leading AI research labs. This expert role focuses on evaluating Russian audio content for a San Francisco Bay Area position. The ideal candidate will establish evaluation standards and drive improvements in language model performance.
Mercor
VerifiedMusic Audio Expert - Russian | $9.92-$11.41 One-Time Remote
Mercor wants experienced music ears to assess the output of generative AI music models, collaborating with a top AI research lab. In this remote, task-based role, you'll compare AI-generated songs side by side and score them on musicality, creativity, vocal quality, and production polish. You'll work in Russian and English, using a structured taxonomy to annotate genres, song structure, and vocal/instrumental traits. It's a flexible, part-time project for up to six months, perfect for music pros who want to shape AI's understanding of sound.
Mercor
VerifiedRussian Linguistics Specialist AI Trainer
You will own Russian audio evaluation and transcription for AI training data at Mercor. This role pairs Russian fluency with AI model testing, shaping outputs for top research labs. You will work with a small team of linguists and engineers, reporting to project leads. Unique in its focus on dialectal nuance and rubric development, this contract offers $50/hour and remote flexibility.