Senior Data Engineer (GCP, Databricks) Toronto_hybrid
Role summary
We are seeking a Senior Data Engineer to design and construct scalable batch and real-time data pipelines utilizing modern cloud and big data technologies. The role involves building and maintaining data pipelines, developing streaming solutions with Spark/Kafka/Flink, implementing Data Lakehouse and Medallion architectures, and working with microservices-based data platforms. Additionally, the engineer will set up and manage CI/CD pipelines and DevOps workflows, collaborating with stakeholders to ensure data quality. Expertise in GCP, Databricks, Python, Kubernetes, Apache Spark, Kafka/Flink, and the Hadoop ecosystem is required.
Senior Data Engineer (GCP, Databricks)
Location:
Toronto\_hybrid
Experience Required:
10+ Years
Please share the resumes with me at pranay@burgeonits.com
Role Overview
We are looking for a
Senior Data Engineer
to design and build scalable
batch and real-time data pipelines
using modern cloud and big data technologies.
Key Skills (Must Have)
- GCP (Google Cloud Platform)
- Databricks
- Python
- Kubernetes
- Apache Spark (Spark Streaming)
- Kafka / Flink (real-time streaming)
- Hadoop ecosystem (Hive, Pig, Spark)
Core Responsibilities
- Build and maintain
data pipelines (batch & real-time)
- Develop
streaming solutions
using Spark/Kafka/Flink
- Implement
Data Lakehouse & Medallion architecture
- Work with
microservices-based data platforms
- Set up and manage
CI/CD pipelines & DevOps workflows
- Collaborate with stakeholders and ensure data quality
Nice to Have
- Unity Catalog
- Terraform
- Experience with
AI coding tools
(GitHub Copilot, Claude)