Remote Data Labeling Specialist

Das ist der Job

Bachelor's Degree or relevant experience in Data Science, Technology, Linguistics, AI, or a related field.

Darum lohnt es sich

Rex.zone is seeking Remote Data Labeling Specialists in New York to support AI development projects by creating high-quality training data for advanced artificial intelligence systems. This role involves working on text, image, and conversational data annotation tasks that directly contribute to improving AI model performance.

The successful candidate will perform detailed labeling, quality evaluation, and guideline-based annotation while maintaining accuracy and consistency.

This opportunity is ideal for professionals who have strong attention to detail, enjoy working with AI-related projects, and can effectively manage structured evaluation workflows in a remote environment.

Key Responsibilities • Perform data labeling and annotation tasks for NLP and computer vision projects using assigned tools and guidelines. • Conduct quality assurance evaluations, including spot checks, review queues, agreement assessments, and error identification. • Complete RLHF evaluation tasks such as preference ranking, pairwise comparisons, and rubric-based scoring of AI responses. • Evaluate AI-generated content for instruction following, reasoning quality, safety, and overall performance. • Follow annotation guidelines, document decision-making processes, and elevate unclear cases when required. • Improve training data quality through consistency reviews, feedback loops, and taxonomy improvements. • Support project-based workstreams include entity recognition, data curation, and content classification.

Requirements • Professional experience in data labeling, annotation operations, or AI evaluation workflows. • Strong attention to detail with the ability to consistently apply guidelines and evaluation criteria. • Familiarity with quality assurance processes, sampling methods, and review procedures. • Ability to handle ambiguous cases and provide clear written explanations for decisions. • Capability to meet productivity and quality targets while following updated project guidelines. • Comfortable working independently in a remote environment.

Strong knowledge of • NLP & computer vision data annotation. • AI model evaluation, RLHF workflows, and quality assessment. • Data classification, labeling guidelines, and taxonomy management.