DataOps/Cloud Data Engineer - Senior

Job Description

DataOps/Cloud Data Engineer - Senior:
On behalf of our Public Sector client, Procom is searching for a DataOps/Cloud Data Engineer - Senior for a 6-month role. This position is onsite 5 days a week at our client’s Toronto office.

DataOps/Cloud Data Engineer - Senior - Job Description:
This is a critical project involving the development and optimization of data pipelines using Azure Data Factory and Databricks. The successful candidate will work on designing and implementing data models using Medallion Architecture principles to support the Ministry of Public and Business Service Delivery and Procurement.

DataOps/Cloud Data Engineer - Senior - Responsibilities:
• Designing, developing, and optimizing Azure Data Factory and Databricks pipelines from Oracle databases to Lakehouses
• Designing and optimizing data models using Medallion Architecture principles
• Designing and developing data connections from Databricks Medallion Architecture to on-premises data sources for downstream consumers
• Translating Informatica ETL to Azure Data Factory and Databricks ELT
• Implementing and enforcing data quality checks and governance practices

DataOps/Cloud Data Engineer - Senior - Mandatory Skills:
• Experience developing ETL processes with Informatica, Azure Data Factory, and Databricks (Python, Lakeflow, and SQL Optimization)
• Experience with solution development in Databricks using Medallion Architecture
• Proficiency in programming languages (Python, SQL, t-SQL, PL/SQL, Informatica, ADF, SSIS, Microsoft Fabric)
• Experience with data pipeline and workflow development, orchestration, deployment, and automation
• Experience with Cloud data platforms and data management
• Experience in Continuous Integration/Continuous Development/Deployment (CI/CD)
• Excellent verbal and written communication skills

DataOps/Cloud Data Engineer - Senior – Nice-to-Have Skills:
• Databricks and/or Microsoft Fabric certifications
• Experience with Azure DevOps
• Experience with AODA/WCAG compliance
• Experience with digital product data analysis and data security
• Previous public sector experience

DataOps/Cloud Data Engineer - Senior – Assignment Length:
This is a 6-month contract position.

DataOps/Cloud Data Engineer - Senior - Start Date:
ASAP

DataOps/Cloud Data Engineer - Senior - Assignment Location:
Toronto, Ontario, Canada, onsite 5 days a week.

This employer uses both human and technology-assisted tools to support candidate screening and assessment. Final hiring decisions are made by people.