Technical Reviewer · $30/hr - Remote

• Position: Technical Reviewer – RL Environment Terminal Benchmarking (Agentic AI)
• Type: Hourly contract
• Compensation: $25–$30/hour
• Location: Remote (India)
• Commitment: Project-based (flexible hours)

Role Responsibilities

• Review reinforcement learning environments for correctness, robustness, and consistency.
• Evaluate terminal conditions, reward structures, and episode logic in RL benchmarks.
• Assess benchmarking pipelines for fairness, reproducibility, and methodological soundness.
• Review Python-based codebases and documentation for implementation accuracy.
• Validate experimental results across different runs, seeds, and configurations.
• Provide structured technical feedback on environment design and evaluation protocols.
• Collaborate with researchers to refine benchmarking standards and metrics.
• Document issues, edge cases, and recommended improvements clearly and precisely.

Requirements

• Background in reinforcement learning, computer science, or applied AI research.
• Hands‑on experience working with RL environments.
• Strong understanding of benchmarking methodologies and evaluation metrics for RL tasks.
• Comfort reviewing Python codebases (PyTorch or TensorFlow experience is a plus).
• High attention to detail with strong critical and analytical reasoning skills.
• Strong commitment to experimental rigor, reproducibility, and fairness.
• Ability to review both theoretical formulations and practical implementations.