[Remote] Sr. Quality Automation Engineer

Note: The job is a remote job and is open to candidates in USA. Authenticx is hiring a Senior Quality Automation Engineer to design, build, maintain, and integrate automated tests across its healthcare conversation intelligence platform. The role owns automation for critical product areas and partners with cross-functional teams to improve product quality, testability, and release confidence.

Responsibilities

• Learn how Authenticx customers use the platform across healthcare quality, coaching, compliance, operations, analytics, and customer experience workflows
• Translate workflows, acceptance criteria, production issues, and known risk areas into meaningful automated test scenarios
• Determine what should be automated, which testing layer is most appropriate, and the level of coverage needed
• Balance UI, API, integration, and data-level testing to create reliable and maintainable coverage
• Design, write, maintain, and troubleshoot automated tests for UI workflows, APIs, backend services, data pipelines, integrations, reporting, and AI-powered features
• Build and maintain smoke, regression, acceptance, integration, and end-to-end test suites
• Use Playwright to automate critical user journeys and product workflows
• Use Bruno/Postman to validate APIs, payloads, integrations, authentication, error handling, and backend behavior
• Use SQL to validate data accuracy, workflow integrity, processing outcomes, reporting outputs, and customer-facing analytics
• Build reusable automation utilities, fixtures, helpers, and test data patterns
• Integrate automated tests into CI/CD pipelines to provide earlier and more reliable quality signals
• Investigate flaky tests, environmental issues, timing problems, and test-data failures, and distinguish them from true product defects
• Identify high-risk coverage gaps and build automation to address them
• Work with Product, Engineering, Data Science, Implementation, and Customer teams to understand requirements, risks, and real-world usage
• Partner with developers to improve testability, observability, logging, test data setup, and API contracts
• Use logs, monitoring tools, database queries, API responses, and product data to investigate failures and validate system behavior
• Communicate defects, automation gaps, and release risks clearly
• Share automation patterns and testing practices that strengthen the broader quality engineering discipline
• Build automated validation for classifications, model outputs, prompt and configuration changes, structured responses, extraction workflows, and downstream behavior
• Develop repeatable test scenarios for deterministic and semi-deterministic AI behaviors
• Validate expected outputs, required fields, edge cases, failure conditions, and downstream workflow impacts
• Use representative test data and known expected outcomes to detect regressions
• Partner with Data Science and Engineering to improve the testability and regression coverage of AI-powered features

Skills

• 5+ years in test automation, SDET, or software engineering, with hands on ownership of automated suites
• Production level coding in at least one of TypeScript, JavaScript, C#, or Python
• Playwright or equivalent modern UI automation on complex web applications
• REST API testing (Bruno, Postman, or code based), covering authentication, payload validation, and error handling
• SQL proficiency to validate data integrity and processing outcomes
• CI/CD integration, including failure triage, flaky test diagnosis, and test data management
• Ability to assess product risk and choose the right test layer (UI, API, or data) without having every case defined for you
• Experience validating asynchronous, multi service workflows
• C#/.NET, PostgreSQL, and Azure
• Experience testing LLM or ML features using representative datasets, expected outcomes, and threshold based regression checks
• Ingestion pipelines, event driven systems, and third party integrations
• Healthcare, contact center, or regulated environment experience
• AI assisted development tools for test creation and debugging

Company Overview