Senior AI Engineer

Job Description

Senior AI Engineer

On behalf of our client, Procom is searching for a Senior AI Engineer for a contract role running through January 29, 2027. Location is Calgary, AB (Hybrid).

Senior AI Engineer - Job Description:
Our client is seeking a Senior AI Engineer to design, test, and optimize AI-driven quality monitoring solutions for their Contact Centre. The resource will develop custom prompts and evaluation frameworks that assess customer interactions against business-defined quality standards, working with transcript data, Snowflake, and Power BI to benchmark model performance and deliver actionable insights to Quality Managers.

Senior AI Engineer - Responsibilities:

• Design, test, and optimize custom prompts that assess Contact Centre interactions against defined quality standards
• Translate business requirements and quality scorecards into structured AI evaluation criteria
• Develop business-approved test datasets, benchmarks, and validation methods
• Compare prompting approaches and AI models to identify the optimal balance of quality, scalability, latency, and cost
• Validate AI-generated assessments against human evaluations and refine the solution accordingly
• Integrate AI-generated outputs with Snowflake-based data and analytics workflows
• Partner with Data Visualization SMEs to surface outputs in Power BI
• Document prompt designs, evaluation results, and governance requirements
• Establish a repeatable approach for prompt monitoring, version control, and regression testing

Senior AI Engineer - Mandatory Skills:

• Proven experience designing and deploying custom prompt engineering solutions using Large Language Models
• Experience developing AI evaluation frameworks, benchmarking methodologies, and validation processes
• Ability to compare and optimize multiple AI models for accuracy, consistency, scalability, latency, and cost
• Experience with unstructured conversational data (call transcripts, chat, customer conversations)
• Strong Python, SQL, and data analysis skills
• Experience with Snowflake or a comparable enterprise data platform
• Strong stakeholder engagement skills

Senior AI Engineer - Nice-to-Have Skills:

• Experience in Contact Centre, Customer Experience, or Quality Assurance environments
• Experience with Power BI or comparable visualization tools
• Familiarity with LLM-as-a-Judge, automated evaluation, and AI monitoring tools
• Experience with Retrieval-Augmented Generation architectures
• Airline, travel, hospitality, or customer service industry experience

Senior AI Engineer - Assignment Length:
~4 months (Oct 2026 - Jan 2027)

Senior AI Engineer - Start Date:
October 5, 2026

Senior AI Engineer - Assignment Location:
Calgary, AB (Hybrid)