Software Developer - ETL - Senior
Job Title: Software Developer - ETL - Senior
Location: Toronto - Hybrid
Duration: Long-Term
 

Description

Deliverables section:

Scope of Services and Deliverables - The Services and Deliverables to be provided by the Vendor will include the following:

 

·         Monitor and analyze incident, provide timely resolution.

·         Participate in the review of project, work request and maintenance release artefacts - Use Case, System Requirement Specification, etc.

·         Deliver detailed system design documents and any other supporting documentation conforming to Ministry standards.

·         Design logical and physical data models using Sybase Power Designer

·         Produce transformation mapping document.

·         Implement solution using Azure Data Factory (ADF) pipeline and stored procedure, and Informatica PowerCenter

·         Develop Azure CI/CD pipeline to automate ADF release.

·         Develop complex Oracle PL/SQL program to fulfill project requirements.

·         Implement complex data conversion, e.g., binary to character, EBCDIC to UTF

·         Implement complex data transformation(s) for derived and calculated values.

·         Integrate data sets from diverse source systems.

·         Implement ADF for initial data load and incremental load.

·         Promote ADF and Informatica ETL/ELT through all Ministry environments including Development, Integration Testing, QA, UAT, Production

·         Debug ADF pipeline and stored procedure, and Informatica workflow to investigate and fix defects.

·         Actively participate, support, and provide feedback to project team during design/development/testing/implementation phase.

·         Produce supporting documentation.

·         Optimize performance of ADF pipeline, Azure SQL and Synapse databases, and Informatica workflow

·         Monitor application functionality and performance on a daily basis.

·         Provide effective knowledge transfer to Ministry staff at all stages of this assignment.

 

Skill Set Requirements:

ETL and BI Development                                                                                                                                             

 

·         Extensive experience with ETL tools Informatica PowerCenter and Microsoft SSIS.

·         Extensive experience with Azure Data Factory, including:

o   Self-Hosted Integration Runtime

o   Data movement, ETL pipelines

o   Performance tuning on large data volumes

o   Complex data transformations

o   ADF Debugger to validate data transformation.

o   Azure Roles

·         Experience with CI/CD (DevOps) pipelines and concepts, including:

o   Azure Resource Management

o   GitHub Repo

o   Source code version control

o   Branching, pull requests, build, release, merging pipeline across multiple parallel development repositories.

·         Experience with Azure DevOps, including:

o   Azure Boards

o   Azure Test Plans

o   Azure Pipelines

o   Azure Repos

o   Azure Artefacts

·         Experience with Informatica, including:

o   Workflow Manager

o   Repository Manager

o   Designer

o   Workflow Monitor

·         Expert experience with Business Intelligence tools IBM Cognos and Microsoft PowerBI.

 

Oracle PL/SQL Development                                                                                                                                                     

·         Extensive experience in designing and developing Oracle PL/SQL programs.

 

Database Technologies                                                                                                                               

·         Experience with Oracle, Microsoft SQL Server database and tools.

·         Extensive knowledge of Azure SQL DB and Synapse platforms, including:

o   Performance tuning on large data volume

 

 Evaluation Table

 

Type/Details

 

ETL and BI Development                                                                                                   50%

 

·        Extensive experience with ETL tools Informatica PowerCenter and Microsoft SSIS.

·        Extensive experience with Azure Data Factory, including:

o  Self-Hosted Integration Runtime

o  Data movement, ETL pipelines

o  Performance tuning on large data volumes

o  Complex data transformations

o  ADF Debugger to validate data transformation.

o  Azure Roles

·        Experience with CI/CD (DevOps) pipelines and concepts, including:

o  Azure Resource Management

o  GitHub Repo

o  Source code version control

o  Branching, pull requests, build, release, merging pipeline across multiple parallel development repositories.

·        Experience with Azure DevOps, including:

o  Azure Boards

o  Azure Test Plans

o  Azure Pipelines

o  Azure Repos

o  Azure Artefacts

·        Experience with Informatica, including:

o  Workflow Manager

o  Repository Manager

o  Designer

o  Workflow Monitor

·        Expert experience with Business Intelligence tools IBM Cognos and Microsoft PowerBI;

 

 

Oracle PL/SQL Development                                                                                             20%

 

·        Extensive experience in designing and developing Oracle PL/SQL programs.

 

Database Technologies                                                                                                      30%

 

·        Experience with Oracle, Microsoft SQL Server database and tools.

·        Extensive knowledge of Azure SQL DB and Synapse platforms, including:

o  Performance tuning on large data volume