AI Evaluator - Python Coders
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
0 - 0 years
Not Disclosed
Salary Not Disclosed
Any Nationality
N/A
1 Vacancy
Job Description
- Evaluate AI-generated Solutions:
- Analyze and evaluate the AI assistant step-by-step solution trajectories.
- Assess each action and thought of the Agent using a ternary format (positive, neutral, negative).
- Determine if each step taken by the Agent brings it closer to solving the problem, provides a neutral impact, or contains obvious errors.
- Provide Constructive Feedback:
- Offer detailed comments on negative actions, clearly explaining the mistakes.
- Provide comments on positive actions that add significant value to the solution.
Employment Type
Part-time
