Opportunity Description
Overview
The AI Tester is a specialized, senior-level quality engineering position within the Testing work pillar.
Responsibilities- Designing, building, and maintaining scalable, robust end-to-end automation frameworks from scratch, utilizing Playwright as the primary automation engine across web interfaces.
- Authoring and executing comprehensive API testing suites to validate distributed microservices, ensuring strict data integrity, state consistency, and schema compliance.
- Designing validation strategies for asynchronous, event-driven data architectures, tracking messages and auditing system behaviors across Kafka-based streaming pipelines.
- Establishing specialized testing methodologies to evaluate Generative AI and Large Language Model (LLM) outputs, assessing models for hallucination, bias, semantic accuracy, and safety constraints.
- Managing, curating, and versioning baseline prompt validation datasets and gro...