AI Analytics Workflow Evaluator
The work You will test how AI assistants handle realistic data-analysis tasks connected to cloud data warehouses. Your reviews will help identify incorrect figures, SQL, joins, filters, time windows, and other logic problems. The role combines hands-on analytics, Snowflake environment management, product-behavior investigation, and careful evaluation of AI outputs.
- Run evaluation scenarios involving anomaly investigation, KPI reporting, and data refreshes.
- Write and run SQL queries to compare AI-generated results with source data.
- Maintain, reset, and manage seeded Snowflake datasets so test scenarios stay accurate and repeatable.
- Administer warehouse roles, permissions, grants, and access controls.
- Set up and document connectivity and authentication across analytics and SaaS platforms.
- Investigate undocumented product behavior and record your findings clearly.
- Join calibration sessions to keep grading and scoring consistent across evaluators.
What it pays and takes This is a part-time contractor role for people who can carefully audit analytical results and explain their reasoning. The role is marked entry level, while three or more years of hands-on data analyst or analytics engineer experience is preferred.
- Pay: $50 to $60 per hour, paid in USD.
- Time: 20 or more hours per week.
- Work type: Part-time contract.
- Language: Professional fluency in English.
- Location: Open to candidates in Argentina, Austria, Bangladesh, Belgium, Bahrain, Brazil, Canada, Switzerland, Chile, Colombia, Germany, Denmark, Algeria, Egypt, Spain, Ethiopia, France, the United Kingdom, Ghana, Greece, Indonesia, India, Italy, Jordan, Japan, Kenya, Kyrgyzstan, Kuwait, Kazakhstan,
- Required: Advanced SQL skills and expertise with Snowflake warehouses, access control, and query history.
- Required: Ability to audit and reconcile reported metrics against raw data and catch subtle aggregation or logic errors.
- Required: Strong written and verbal communication, careful documentation, and sound judgment when evaluating analytical results.
- Valued experience: Database access administration, roles and grants, authentication or security integrations, and business or finance analytics.
- Helpful background: Claude or ChatGPT connectors, AI-generated SQL review, rubric-based evaluation, quality assurance, or data labeling.
- Also useful: Familiarity with OAuth, security integrations, Slack, Google Workspace, or Microsoft 365.
How it works Apply on OpenTrain with your resume, then complete the application on the hiring site. About AI training work AI training is the human work behind systems that analyze information and generate answers. Evaluators check real outputs against reliable data so AI systems become more accurate and useful.