GCP Data Engineer

Hi Rahul,

Hope you are doing good!

This is Rahul
from
Euclid Innovations
. Please find the JD and let me know if you are interested.

GCP Data Engineer

Charlotte, NC

12 Months

We are seeking experienced Data Engineers to support a large-scale data platform transformation for a leading banking client.

This role focuses on building Spark-based data pipelines and enabling data movement between GCP (Google Cloud Platform) and on-prem systems (DPC) based on governance and model requirements.

Key Responsibilities

• Design and build scalable ETL/data pipelines using Spark and Python
• Develop data workflows to ingest, transform, and move large datasets
• Implement data routing logic to direct data to:
• GCP (BigQuery, Dataflow, Dataproc)
• On-prem platforms (DPC)
• Ensure data quality, validation, and reconciliation across systems
• Collaborate with data science and platform teams to support predictive model pipelines
• Optimize performance and scalability for high-volume data processing

Required Skills

• Strong hands-on experience with Apache Spark / PySpark for large-scale data processing
• Proficiency in Python for data engineering (ETL pipelines)
• Experience designing and developing data pipelines / data engineering workflows
• Solid background in ETL, data ingestion, transformation, and data movement
• Experience working with big data technologies and handling large datasets (batch/streaming)
• Experience with cloud platforms – GCP (Google Cloud Platform)
• BigQuery, Dataflow, Dataproc, GCS (Google Cloud Storage)
• Experience with data migration / data integration projects
• Understanding of data pipeline architecture and distributed systems

Preferred Skills

• Experience with GCP (BigQuery, Dataflow, Dataproc, GCS)
• Exposure to hybrid environments (cloud + on-prem)
• Familiarity with ML/data pipelines (supporting models, not building them)
• Experience in financial services / banking domain (nice to have)