We use AI to understand human ability and match talent with the opportunities they're best suited for
Software Engineer (Code QA)
Mercor is hiring experienced Software Engineers to support high-impact research collaborations with leading AI labs. Freelancers will contribute to building evaluation datasets that assess AI reasoning, explanation quality, and technical judgment in coding-related interactions.
This is a unique opportunity to apply your engineering expertise toward shaping the next generation of intelligent systems.
About the Project
This evaluation dataset is code question and answer data. This data is designed to assess natural-language reasoning, explanation quality, and technical judgment in coding-related interactions, rather than executable correctness. Tasks are structured as chat-pasteable prompts that reflect realistic developer questions and include all necessary context inline (e.g., code snippets, error messages, logs, or requirements)
Key Responsibilities
- Craft realistic developer prompts across multiple categories (code review, debugging, error diagnosis, configuration, and more)
- Source and adapt content from real PRs to create authentic scenarios
- Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality
Ideal Qualifications
- 2+ years of experience in software engineering, technical research, or educational content development
- Degree in Software Engineering, Computer Science, or a related field (Bachelorโs minimum; advanced degree preferred)
- Strong proficiency in languages like Python, JavaScript, Java, or C++
- Experience with debugging, testing, and validating code
- Comfortable with technical writing and attention to detail
Project Timeline
- Start Date: Immediate
- Duration: 1-2 months
- Commitment: Part-time (15โ25 hours/week, with flexibility up to 40 hours/week)
Application & Onboarding Process
- Upload your resume
- AI interview: A short, 15-minute conversational session to understand your background, experience, and interest in the role
- Follow-up communication within a few days with next steps and onboarding details
Apply today and leverage your software engineering expertise to help build the future of AI-driven systems!
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Contract and Payment Terms
- You will be engaged as an independent contractor.
- This is a fully remote role that can be completed on your own schedule.
- Projects can be extended, shortened, or concluded early depending on needs and performance.
- Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
- Payments are weekly on Stripe or Wise based on services rendered.
- Please note: We are unable to support H1-B or STEM OPT candidates at this time.
About Mercor
Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.
Location Requirements
- ๐ฌ๐ง United Kingdom
- ๐บ๐ธ United States
- ๐จ๐ฆ Canada
- ๐ฆ๐บ Australia
- ๐ณ๐ฟ New Zealand
- ๐ฆ๐น Austria
- ๐ง๐ช Belgium
- ๐ซ๐ท France
- ๐ฉ๐ช Germany
- ๐ฑ๐ฎ Liechtenstein
- ๐ฑ๐บ Luxembourg
- ๐ฒ๐จ Monaco
- ๐ณ๐ฑ Netherlands
- ๐จ๐ญ Switzerland
- ๐ง๐ฌ Bulgaria
- ๐จ๐ฟ Czech Republic
- ๐ญ๐บ Hungary
- ๐ฒ๐ฉ Moldova
- ๐ต๐ฑ Poland
- ๐ท๐ด Romania
- ๐ธ๐ฐ Slovakia
Please let Mercor know you found this position on NoDesk as a way to support us so we can keep providing you with quality remote jobs.
About Mercor
Company profile
View more jobs 11
People also viewed

Senior Software Engineer, Global Contractor
Jump

Software Engineer
Sticker Mule

Senior Full-Stack Software Engineer, Growth
Circle

Senior Software Engineer
Wikimedia Foundation

Support Engineer
Kinsta

Bilingual Content Editor (English/Spanish)
Siege Media

Blockchain Jobs / Cryptocurrency Jobs
Cryptocurrency Jobs

Senior Product Engineer (Frontend)
Buffer

Bilingual Content Editor (English/Japanese)
Siege Media

Senior Engineer - Growth Marketing
Buffer