AI Policy Reviewer – Remote

About the role

The AI Policy Reviewer ensures that AI‑generated and user‑generated content complies with internal governance, regulatory standards, and responsible AI principles. Working remotely, you will act as a quality‑assurance gate, safeguarding model integrity by identifying safety risks, bias, misinformation, and policy violations.

Key responsibilities

• Review and score AI responses against detailed policy rubrics, assessing safety, truthfulness, fairness, and alignment with community guidelines.
• Identify and flag edge cases where policy interpretation is ambiguous, including over‑sensitive or under‑sensitive outcomes.
• Analyze data to uncover systematic flaws, bias patterns, or hallucinations and report findings to Product and Engineering teams.
• Collaborate with Policy teams to refine evaluation rubrics and test their teachability to AI models.
• Participate in adversarial testing (red‑team) to expose vulnerabilities before product launch.
• Work closely with Machine Learning Engineers, explaining rating decisions and helping adjust model behavior.
• Create high‑quality prompt‑response examples for “golden sets” used in model training.

Required profile

• Minimum 3 years of experience in Trust & Safety Operations, Content Policy, Risk Analysis, or Legal/Compliance review.
• Deep knowledge of content moderation policies covering hate speech, harassment, misinformation, and graphic violence.
• Strong analytical ability to deconstruct AI outputs, detect logical flaws, hallucinations, and subtle biases.
• Excellent written communication skills to explain findings to engineers and policy experts.
• Emotional resilience and self‑care strategies for exposure to disturbing content.

Required skills

• Familiarity with large language models (e.g., ChatGPT, Gemini).
• Experience using dashboards, spreadsheets, and specialized content‑review tools.