AI Test Engineer

Requirements: 3

Experience: 2.5 to 4 years

Responsibilities:

• Collaborate with the AI test team to plan and execute test plans, test cases, and test scenarios specifically tailored for AI systems.

• Implement quality assurance standards within the context of AI testing to ensure the accuracy, reliability, and performance of AI solutions.

·         Design and implement benchmarking tests to evaluate the performance of AI systems against industry standards and competitors.

• Develop, execute, maintain, and enhance Automated Test Frameworks and Scripts dedicated to testing AI components, leveraging relevant AI tools and Deep learning frameworks.

• Accurately report and track defects and issues related to AI testing, including writing detailed benchmarking /bugs reports and verifying fixes in collaboration with the development team.

• Analyse benchmarking results to identify strengths, weaknesses, and areas for improvement in AI algorithms and models.

• Expand knowledge in testing deep learning algorithms and model families.

Skills:

• Proficiency in Python and related packages for image processing and data processing and automation testing.

• Familiarity with machine/deep learning frameworks like TensorFlow, Keras, or PyTorch.

• Understanding of Software Development Life Cycle (SDLC) and Software Testing Life Cycle (STLC), with a focus on AI-specific testing phases and activities.

• Understanding on testing AI-driven applications across diverse platforms.

• Experience in API Testing using tools like Postman, essential for testing AI-driven APIs.

• Knowledge of tools like Neptune, Kolena, Weights and Biases, Pytorch ignite, TensorFlow Model Analysis TFMA, Deepdetect

Preferred Skill:

• Proficiency in Machine Learning Pipelines and Continuous Integration/Continuous Deployment (CI/CD) pipelines, tailored for AI development and testing workflows. Knowledge of advanced image processing algorithms.

• Experience with Cloud Computing platforms such as AWS or Azure or on premises server, particularly in the context of testing AI solutions in cloud environments.

• Strong statistical analysis skills to evaluate model performance, validate results, and identify potential issues during AI testing.

Qualification:

• Bachelor’s or Master’s degree in Computer Science, Data Science, Machine Learning, or related fields.

• 2 years of experience in computer vision and/or deep learning or AI testing or Quality assurance.

• ISTQB certified Tester

• ISTQB Certified AI Tester