Remote Position
[Remote] AI and Analytics Quality Engineer
🌍 Remote · United States
💼 Full-time
Note: The job is a remote job and is open to candidates in USA. AAJ Interactive Technologies is recruiting an AI Data Analytics Quality Engineer for its nonprofit client. The role ensures the quality, accuracy, and reliability of AI-enabled solutions, data products, and enterprise reporting platforms through validation, testing, and automation.
Responsibilities
- Test and validate AI-enabled solutions, Microsoft Copilot capabilities, and AI-generated outputs
- Evaluate, pilot, and implement AI-enabled testing solutions to increase automation, improve test efficiency, and strengthen quality validation for AI-powered applications, data platforms, and reporting products
- Validate Microsoft Fabric, Power BI, and enterprise reporting solutions
- Verify data quality, business rules, calculations, KPIs, and report accuracy
- Perform data reconciliation, source-to-target validation, and integration testing
- Design, develop, and maintain automated tests for AI, data, and reporting solutions
- Execute functional, integration, regression, and user acceptance testing
- Partner with Product Owners, Data Engineers, Developers, and business stakeholders to ensure high-quality delivery
Skills
- 5+ years of Quality Assurance, Quality Engineering, or Software Testing experience
- 3+ years testing data, analytics, business intelligence, or reporting solutions
- Experience testing AI-enabled applications, Copilot solutions, or AI-generated outputs
- Experience with Microsoft Fabric, Power BI, or similar analytics platforms
- Experience designing and implementing test automation solutions
- Strong SQL, data validation, and analytical testing skills
- Experience testing APIs and system integrations
- Experience working in Agile environments
- Bachelor's degree in Computer Science, Information Systems, Data Analytics, Engineering, or a related field, or an equivalent combination of education and experience
- Experience with Generative AI, prompt engineering, and AI output evaluation
- Experience with Dynamics 365 CE, Dynamics 365 F&O, Dataverse, and the Power Platform
- Experience with test automation tools such as Playwright, Mabl, or similar frameworks
- Experience supporting CI/CD pipelines and quality engineering practices
- Knowledge of data governance, data lineage, and enterprise reporting
- Microsoft Fabric, Power BI, Data Engineering, or AI certifications
- Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
- Microsoft Certified: Fabric Data Engineer Associate (DP-700)
- Microsoft Certified: Azure AI Fundamentals (AI-900)
- Microsoft Certified: Power BI Data Analyst Associate (PL-300)
- Microsoft Certified: Azure AI Engineer Associate (AI-102)
Benefits
- Candidates may work 100% remotely; they must be readily available and willing to travel to a main office in Virginia or Illinois quarterly.
- Candidates local to Northern Virginia or Chicago (near O’Hare) may be required to work in the office 2 days/week.
- Possibility of conversion to a full-time employee of the client.
Company Overview