Senior Data Engineer

Job title: Senior Data Engineer

Company: Lorven technologies

Job description: Role: Senior Data EngineerLocation: Toronto, ON Canada (Onsite)Job Type: ContractResponsibilities

• Manage timelines/deliverables within the team towards the successful delivery of projects.
• Design software solutions by interacting with portfolio managers, traders, operations staff and peers to understand requirements.
• Develop solutions that are in line with client’s technology biases, deliver efficiency and scalability, and enable new trading activities.
• Provide knowledge transfer to team members and support staff through application demos, walkthroughs, and documentation.

Skills To have

• Must have 10+ years of IT experience
• Concepts: Data Mesh, Data Product
• Basic

• Data Pipelines: PySpark, Hudi, Iceberg, Airflow, EMR
• Expert

• Data Operations: Operational Excellence, monitoring, troubleshooting
• Expert

• Data Quality: Great Expectations, AWS Glue DQ, Deequ
• Expert

• Entitlements: AWS Lakeformation
• Expert

• Infrastructure: AWS Data Eng. Services (Glue, EMR, Athena etc.), AWS Compute Services (EC2, Lambda), AWS Storage Service (S3), cross-account IAM, RAM, MWAA, Step Functions, etc.
• Knowledge

• DevOps: Terraform, Git Actions
• Expert

• Metadata: Neptune, OpenLineage, Angular, DataZone
• Knowledge

• Consumption: AWS Athena, Trino
• Expert

• Other Tools: JupyterLab, Databricks
• Good to have

• SQL We are looking for experienced support whereby experience means comfortable working with production-level code and assets with clear understanding of DevOps and DataOps principles.

Project description

• Our client is a professional investment management organization that globally invests the funds to ensure long-term sustainability. The company invests in all major asset classes, including public equity, private equity, real estate, infrastructure and fixed-income instruments
• Client attracts and selects high-caliber individuals from top-tier institutions around the globe.
• Join our team and look forward to:

• Diverse and inspiring colleagues and approachable leaders
• Stimulating work in a fast-paced, intellectually challenging environment
• Accelerated exposure and responsibility
• Global career development opportunities
• Being motivated every day by important social purpose and unshakable principles
• A deeply rooted culture of Integrity, Partnership and High Performance
• If you share a passion for performance, value a collegial and collaborative culture, and approach everything with the highest integrity, here’s an opportunity.

Expected salary:

Location: Toronto, ON

Job date: Sat, 21 Sep 2024 22:23:07 GMT

Apply for the job now!