Software Developer – ETL
View all jobs

Software Developer – ETL

Posted 5 months ago
Apply Now
Shortlist

Job Description

Software Developer - ETL - Search Latest Jobs - Full Time - Part Time - Casual - Volunteering
Job title: Software Developer – ETL

Company: LanceSoft

Job description: Duration: 12 months with Possibility of extension
Job Type: Hybrid – 3 days a weekMust Haves:

  • Design, build, automate and optimize complex data ETL/ELT processes using Informatica and equivalent
  • Informatica transformations, mappings, and workflows (experience with other ETL tools such as DataStage, ODI or Microsoft SSIS could also be considered)
  • Cloud technologies primary AWS (Azure, Google, AWS)
  • Relational databases (Oracle, MS-SQL), data modelling (relational & dimensional), advanced SQL, query optimization, data replication, administration
  • Data warehouse experience
  • Experience with Informatica

Nice to have:

  • Python experience
  • BI/Reporting (Cognos, SSRS) and Data Visualization tools (Power BI, Tableau)

Responsibilities:

  • Support the Business Intelligence and Business Analytics (BIBA) Unit in developing and implementing the technical solutions needed for data acquisition as well as providing operational support ensuring that any technical glitch is quickly addressed.
  • Design technical solutions for data acquisition and storage into our centralized data repository.
  • Develop ETL scripts, design data-driven logic and conduct unit testing .
  • Conduct database modelling and design as to improve overall performance.
  • Produce design artifacts and documentation which will allow future support of the implemented solutions.
  • Investigate and resolve incidents and identify whether the problem is caused by the data loading code or is due to bad data received from the data provider.
  • Execute service requests related to routine and ad-hoc data loads.
  • Provide the data quality check and report on the data quality issue.
  • Ensure that data collected is in a format which is easy consumable by the business users from Digital and Analytics Strategy Division.
  • Re-engineer ETL processes as to make them suitable for Informatica IDMC migration.

Technical Skills

  • 10+ years’ experience in Data warehousing design and development with focus on extracting, transforming data coming from various data sources and loading into star/snowflake schemas
  • Design, build, automate and optimize complex data ETL/ELT processes using Informatica and equivalent
  • Informatica transformations, mappings and workflows (experience with other ETL tools such as DataStage, ODI or Microsoft SSIS could also be considered)
  • Relational databases (Oracle, MS-SQL), data modelling (relational & dimensional), advanced SQL, query optimization, data replication, administration
  • Scripting languages (Python, Unix shell)
  • Cloud technologies (Azure, Google, AWS)
  • Big data (Hadoop, Spark, Hive)
  • Data analytics/machine learning (integrate AI algorithms in data processing pipelines for detecting anomalies, fraud, or any other kind of outliers)
  • BI/Reporting (Cognos, SSRS) and Data Visualization tools (Power BI, Tableau)

Expected salary:

Location: Toronto, ON

Job date: Fri, 19 Jul 2024 05:56:49 GMT

Apply for the job now!