AI Test Engineer

Job Description

AI Test Engineer:
On behalf of our Technology client, Procom is searching for an AI Test Engineer for an 18-month role. This position is a hybrid position with 4 days onsite at our client’s Ann Arbor, MI office.

AI Test Engineer - Job Description:
We are seeking a Mid-Level AI Software Test Engineer to design, automate, and execute testing strategies for AI-powered applications and systems. This role involves ensuring AI systems are reliable, safe, accurate, and ready for production, combining traditional software quality engineering with emerging AI validation techniques.

AI Test Engineer - Responsibilities:
• Develop comprehensive testing strategies for AI applications, platforms, and services.
• Validate AI model outputs for accuracy, consistency, reliability, and safety.
• Design and execute functional, integration, end-to-end, regression, and performance tests for AI solutions.
• Build and maintain automated test frameworks for AI applications.
• Partner with software engineers, AI engineers, product owners, architects, and security teams.

AI Test Engineer - Mandatory Skills:
• Bachelor's degree in Computer Science, Software Engineering, Information Systems, or related field.
• 3-6 years of software testing, QA automation, or quality engineering experience.
• Experience developing automated test solutions using Python, Java, JavaScript/TypeScript, or C#.
• Experience with API testing and automation tools.
• Strong understanding of test automation, SDLC, Agile methodologies, and CI/CD pipelines.

AI Test Engineer – Nice-to-Have Skills:
• Experience testing Generative AI applications, LLM-based systems, AI agents, RAG applications, and MCP-based integrations.
• Familiarity with OpenAI, Claude, Gemini, and Azure OpenAI.
• Experience testing cloud-native applications on Azure, AWS, or GCP.
• Knowledge of responsible AI, AI governance, and AI risk management practices.

AI Test Engineer – Assignment Length:
This is an 18-month contract position.

AI Test Engineer - Start Date:
ASAP.

AI Test Engineer - Assignment Location:
Ann Arbor, MI. First 6 months are 100% onsite. After 6 months, hybrid with 4 days onsite and 1 remote day; candidate may choose remote day.