Trust & Safety Evaluator with British English (On-site in Tampere)

*Please note that this is On-site job opportunity based in Tampere

Trust & Safety Evaluator conduct adversarial testing and safety evaluation of generative AI features. Main tasks are crafting queries, evaluating the safety of generated content and providing critical feedback. This role requires creative thinking about potential misuse, deep cultural and linguistic knowledge, and the ability to identify subtle safety risks.

KEY RESPONSIBILITIES

• Write, review and evaluate diverse and challenging queries designed to test the system's limits and expose problematic outputs. Queries will target specific risk topics including explicit and/or offensive content
• Design and execute sequences of queries simulating realistic, unfolding conversations.
• Craft attack scenarios using techniques like crescendo attacks and context manipulation to test the system
• Age-Appropriate Safety Evaluation: to guide adversarial query crafting and s...