LLM Evaluation Specialist – Cultural and Linguistic Alignment - Mandarin native speaker

We are looking for linguistically and culturally aware professionals to support the evaluation and enhancement of multilingual prompt-response datasets for large language models (LLMs). This role involves rubric design, evaluation of translations and model outputs, prompt creation, and red teaming focused on identifying and surfacing cultural nuances and biases in LLM behaviour.

Key Responsibilities:

Rubric Definition & Prompt Evaluation

• Full-time Counselors, Social Workers, and Other Community and Social Service Specialists