Opportunity Description
About the job
Position: AI Evaluation Specialist
Type: Contract
Pay Rate: $25 - $35/hour
Location: Remote
Working Hours Commitment: 10-40 hrs/week
Key Responsibilities:
- Design and implement self-contained evaluation tasks, including prompts, supporting files, and detailed grading rubrics to assess AI performance on practical computer-based workflows.
- Define clear, unambiguous written criteria for what constitutes successful and unsuccessful task completion across diverse administrative and workflow scenarios.
- Meticulously observe and document AI agent behaviors, producing crisp, precise summaries and reports in high-quality English.
- Iterate and refine evaluation tasks and rubrics based on feedback and team collaboration...
Ready to Apply?
Submit your application for AI Evaluation Specialist at Dataway Project ID
Apply for this Position