Consultant - Data Engineering
Role summary
Seeking a Consultant - Data Engineering with 7-10 years of experience to architect and implement data solutions on Google Cloud Platform (GCP). Responsibilities include designing Data Mesh orchestration, a standardized Data Platform, optimizing BigQuery for BI, building resilient data pipelines for financial data, and creating a Semantic Layer for self-service analytics. The role emphasizes data quality, observability, and performance tuning, requiring deep GCP expertise including BigQuery, GCS, Dataproc, Dataflow, Cloud Composer, Pub/Sub, and Cloud Functions. The ideal candidate will have 10-12 years of data engineering experience, with 3-5 years in a lead capacity, and a proven track record in end-to-end solution architecture.
Designation: Consulatant - Data Engineering
Level: L3
Experience: 7 to 10 years
Location: San Jose, California, United States
Job Description
Key Responsibilities
Architectural Leadership & Delivery
Data Mesh Orchestration: Spearhead the design and implementation of the GCP Data Mesh, championing domain-oriented ownership and decentralized governance.
Platform as a Service: Architect core components of a standardized Data Platform, providing scalable and reusable capabilities across diverse global business units.
Medallion Architecture Mastery: Lead the design of the Gold layer (Fact & Dimension tables), ensuring datasets are highly optimized for executive BI dashboards and downstream consumption.
Pipeline Engineering: Oversee the integration of enterprise domain systems by designing resilient, incremental data pipelines that handle complex financial datasets with high fidelity.
Semantic Layer & Data Products: Build the enterprise Semantic Layer to serve domain-specific Data Products, enabling self-service analytics and an AI-ready data infrastructure.
Governance & Optimization
Observability & Quality: Embed automated data quality checks and comprehensive observability dashboards directly into the platform to ensure "trust by design."
Performance Tuning: Drive advanced BigQuery optimization strategies, including clustering, partitioning, and indexing, to manage high-volume data warehouse performance.
Strategic Collaboration: Act as the lead architectural partner for Domain SMEs, ensuring platform reliability while maintaining alignment with Agile delivery milestones.
Technical Qualifications
Experience Profile
Industry Tenure: 10–12 years in Data Engineering, with at least 3–5 years in a lead or managerial capacity.
Proven Track Record: Demonstrable success in architecting end-to-end business solutions from discovery to production.
Cloud Expertise: Deep, hands-on mastery of the Google Cloud Platform (GCP) ecosystem, including:
Storage/Compute: BigQuery, GCS, Dataproc, Dataflow.
Orchestration & Messaging: Cloud Composer (Airflow), Pub/Sub, Cloud Functions.
Job Snapshot
Updated Date
01-06-2026
Job ID
J\_5291
Location
San Jose, California, United States
Experience
7 - 10 Years
Employee Type
Permanent
