Senior AI Quality Assurance Engineer

Bottomline Technologies

Testing & Validation

• Develop and execute comprehensive test plans for AI models and systems.
• Perform manual and automated tests to validate AI functionality under various scenarios.
• Conduct bias detection, edge-case testing, and stress testing for AI models.

Automation & Tools

• Design and implement automated testing frameworks for AI workflows.
• Utilize AI-powered QA tools and self-healing test scripts to improve efficiency.

Compliance & Governance

• Ensure AI systems adhere to ethical guidelines, regulatory standards, and internal policies.
• Maintain documentation such as Generative AI Bill of Materials (BoM) for transparency and audits.

Collaboration

• Work closely with ML engineers, data scientists, and product managers to resolve defects.
• Participate in code reviews and contribute to continuous improvement initiatives.

Monitoring & Reporting

• Analyze test results, identify defects, and track quality metrics.
• Provide risk assessments and recommendations for AI deployments.

Required Skills & Qualifications

• Education: Bachelor s in Computer Science, Software Engineering, or related field.
• Experience:
• 3 7 years in QA, with at least 2 years in AI/ML testing.
• Familiarity with non-deterministic testing and AI-specific QA challenges.

Technical Expertise:

• Proficiency in Python and testing frameworks (e.g., PyTest, Selenium).
• Knowledge of ML frameworks (TensorFlow, PyTorch) and MLOps tools.
• Experience with CI/CD pipelines and cloud platforms (AWS, Azure, GCP).

Soft Skills:

• Strong analytical and problem-solving abilities.
• Excellent communication and collaboration skills.

Preferred Skills

• Understanding of ethical AI principles and bias testing.
• Familiarity with low-code/no-code automation tools and AI-driven QA platforms.
• Knowledge of regulatory compliance for AI systems.