Robot & Human Action Outcome Evaluator

Your work at IXO Evaluate robotics and human-activity footage for IXO action-understanding data.

Responsibilities

• Inspect the observed actions and outcomes against the written task and rubric.
• Label relevant objects, actions, events and transitions with consistent descriptions.
• Explain ambiguous cases and correct labels that do not match the footage.
• Review quality and incorporate feedback into subsequent annotations.
• Compare two clips and determine which better reaches the requested end state.
• Repair AI-generated action boundaries, descriptions and feedback, noting subtle movement and object interactions.

Profile

This track relies on careful visual reasoning: understanding a written directive, following a sequence of actions and explaining whether the final state satisfies the request. You should apply a rubric consistently and communicate subtle differences clearly; prior AI work is not required.

Deliverables and pay

Outputs are annotated clips, supported scores, corrected boundaries where applicable, and clear uncertainty notes. IXO will agree the scope, schedule and review criteria before work begins.

Pay is $20 • $85/hr in USD. Work is remote.