Data Engineer

Hiring: Lead Software Engineer (Data Engineer – Cloudera & Azure)

Location: Toronto, Canada

Duration: 3–6 Months Contract

Experience Required: 7–10 Years

We are looking for an experienced
Lead Data Engineer
to join a high-impact team working on large-scale, cloud-native data platforms in the banking/fintech space. If you have strong hands-on experience with
Spark, Kafka, Python, Cloudera, and Azure
, and have built production-grade data pipelines, this role is a strong fit.

Key Responsibilities

• Design and develop scalable data pipelines using Spark and Kafka
• Build real-time and batch data processing systems
• Work with Cloudera ecosystem (HDFS, Hive) for large-scale data processing
• Develop cloud-native solutions using Azure
• Implement microservices and containerized architectures (Docker)
• Ensure data reliability, performance, and system stability in production
• Collaborate with cross-functional teams and stakeholders

Mandatory Skills

• Hands-on experience with Apache Spark (batch and/or streaming)
• Strong experience with Kafka (event-driven data pipelines)
• Programming expertise in Python (preferred), Scala, or Java
• Experience with Cloudera (HDFS, Hive) in production environments
• Hands-on experience with Azure Native Services
• Experience with Docker and microservices architecture
• Proven experience building end-to-end data pipelines

Preferred Domain Experience

• Banking, Financial Services, or Fintech
• Understanding of payments, ledgers, or financial data systems

Additional Preferred Skills

• SQL Server production support
• Workflow orchestration tools
• Exposure to Vault or smart contract development

Candidate Profile

• Strong hands-on engineer with experience building and owning data systems
• Experience working in production environments
• Comfortable working with stakeholders and delivery teams
• Familiar with Agile, Waterfall, or Hybrid methodologies