Advertisement

AI Agent Evaluator - Remote

YO AI Labs Remoto · United States Publicado 11 days ago
49 days left to apply
Postular en Himalayas
Reportar este empleo
Job type
Remote, Contract / Temporary
Category
Industrial & Engineering

Descripción del empleo

Role Title: AI Agent Evaluator

Role Type: Contractor
Location: United States

We are seeking detail-oriented professionals to evaluate AI agents performing everyday tasks. You'll test two AI agents side by side, assess their performance, and provide feedback to improve their reliability and user experience.

Key Responsibilities

  • Test AI agents on everyday tasks, including shopping, travel, bookings, bill payments, email follow-ups, and forms.
  • Approve or stop agents at key steps.
  • Screen-record each testing session.
  • Score task completion, quality, control issues, user satisfaction, and time.
  • Provide clear written feedback on agent performance and usability.

Required Qualifications

  • Based in the United States with a bachelor's degree.
  • Regularly use AI tools in daily life.
  • 2–3 years of experience, preferably in engineering, business management, or office operations.
  • Strong attention to detail and ability to follow instructions.
  • Excellent written communication and documentation skills.
  • An active personal AI account (Free, Go, or Plus; not Pro) and a smartphone capable of screen recording.

Preferred: Relevant domain expertise. No coding or AI development experience is required.

Selection Process

  1. Submit an application and complete screening questions.
  2. Attend a 15–30-minute interview.
  3. Complete profile review and onboarding.

Project Details

  • Task duration: Approximately 1.5 hours per run, including evidence and scoring.
  • Kickoff: Monday, October 12.
  • Onboarding: Before the project begins, subject to scheduling.

Originally posted on Himalayas

Habilidades requeridas

AI-EvaluatorAI-TesterQA-Specialist
Este empleo está publicado por Himalayas. Al hacer clic en “Postular”, continuarás en el sitio web asociado para completar tu solicitud.
Advertisement
Great Deals. Great Devices. Every Day. Shop the Acer Store Now! Great Deals. Great Devices. Every Day. Shop the Acer Store Now!

Empleos relacionados

SUPPLY TECHNICIAN
Army National Guard Units
Indiantown Gap, Pennsylvania, Pennsylvania, United States 5h ago
Industrial e ingeniería
$51.5K – $66.9K/yr