Senior Software Engineer – AI Evaluation & Benchmarks

Coding · Remote · posted today
Pay$80–$100/hrAdvertised by the platform.
WhereRemote · Worldwide
Open toWorldwide
Compared with median+61% vs the $56/hr median
This is a referral link. We may earn a fee if you join; it never changes what Alignerr pays you.

About this role

Design and build coding benchmarks and data pipelines that test how well frontier AI models reason, debug and write production code. You will analyse AI-generated code for correctness and edge-case failures, and give detailed technical feedback.

Hourly contract, fully remote, about 3 months, full-time availability preferred.

You need 4+ years of professional software engineering, expert Python, experience with large codebases and Git, and experience designing LLM coding benchmarks or data pipelines. Strong written English required. Extra languages (JavaScript, Go, C++), CI/CD and testing experience are a plus.

Details come from Alignerr’s public posting and may change. Check the original before applying. Job ID 451eaa61a4.