Data Engineer

Role Name: Data Engineer -

Location: Montreal / Hybrid

Duration: Contract

JOB DESCRIPTION:

Job Description Data Engineer Expert Senior

As Senior Data Engineer you will be a member of the ADE Data development team with specific focus on developing data solutions for NonFinancial Risk Technology. In this role you will be primarily responsible for the design implementation and support of data workflows ETL pipelines using Spark,Scala,PySpark, Python APIs Libraries Views and Stored procedures in addition to performing data and process analysis and monitoring and tuning queries and data loads You will be working closely with data providers data scientists developers and data analytics teams to facilitate the implementation of clientspecific business requirements and requests

YOUR KEY RESPONSIBILITIES

• Design implement and maintain Spark, PySpark, Scala, Python components flows code bases in support of various requirements both from business and technical users
• Design implement and maintain RDBMS databases ensuring optimal performance scalability and data integrity
• Monitor and optimize data access and storage patterns for performance identifying and resolving bottlenecks and implementing performance tuning techniques
• Strong communication skills both verbal and written Capable of collaborating effectively across a variety of IT and Business groups across regions and roles and able to interact effectively with all levels
• Strong analytical skills including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions
• Write complex SQL queries to analyze data and create views for reporting purposes for downstream consumers
• Implement and enforce data security and access controls ensuring compliance with industry standards and regulations
• Selfstarter Proven ability to manage multiple concurrent projects with minimal supervision Can manage a complex ever changing priority list and resolve conflicts to competing priorities
• Strong problemsolving skills Ability to identify where focus is needed and bring clarity to business objectives requirements and priorities
• Conduct database capacity planning forecasting future requirements and implementing necessary scaling strategies
• Troubleshoot and resolve complex databaserelated issues collaborating closely with development and operations teams
• Use GIT and JenkinsCICD pipeline for Automated code deployment
• Experience with Agile development methodologies

Minimum qualifications

• Bachelors degree in engineering technology or computer applications
• Experience in developing data components and pipelines using Python Spark, PySpark, Scala and SQL
• Proficient in SQL query writing
• Solid understanding of relational databases Snowflake
• Familiarity with software development life cycle SDLC
• Excellent communication skills and ability to think independently
• Strong skills in presenting to stakeholders

Additional qualifications skills

• Knowledge and experience with Amazon Web Services AWS S3"