Senior Python Engineer · $150/hr Remote

• Position: Senior Software Engineer Python/TypeScript
• Type: Contractor Assignment
• Compensation: $150/hr
• Location: Remote
• Commitment: Part-time(20 hours/week), with at least 4 hours overlap during PST business hours

Role Responsibilities

• Build and maintain pipelines and infrastructure supporting AI data generation, collection, and evaluation workflows.
• Design, refine, and iterate on rubrics and evaluation criteria for preference data.
• Review and label preference data while identifying subtle quality issues.
• Collaborate with researchers and engineers to translate qualitative judgment into scalable evaluation processes.
• Synthesize technical findings into clear, actionable write-ups, updates, and recommendations.

Requirements

• Hands-on experience with preference data collection and/or rubric creation.
• Experience navigating or contributing to large codebases; experience with codebases such as VSCode is a plus.
• Experience with AI/LLM evaluation or related engineering workflows is preferred.
• A LinkedIn profile is mandatory for review.
• Candidates should not currently be working with Microsoft.