Product Evaluation Specialist | Remote

• Design and develop robust evaluation rubrics to assess AI model outputs from a user experience (UX) perspective.
• Execute product validation tasks to identify risks that could negatively impact user experience, safety, or accuracy.
• Analyze AI outputs to flag usability issues, inconsistencies, or potential failure modes.
• Collaborate with cross-functional teams to define, refine, and uphold product validation and safety standards.
• Translate user insights and evaluation findings into clear, actionable recommendations for model improvement.
• Document results and recommendations with clarity to ensure stakeholders understand user impact.
• Continuously monitor evolving AI product usage and proactively surface emerging UX risks or concerns.

Requirements

• Exceptional written and verbal communication skills with a strong focus on clarity and precision.
• Strong analytical skills and attention to detail when evaluating user risk and usability issues.
• Experience developing and applying evaluation frameworks balancing UX, safety, and performance.
• Ability to clearly document complex findings in an actionable, user-friendly manner.
• Comfortable collaborating across teams in a fast-paced, evolving project environment.
• Self-directed and reliable in a fully remote setting.