
Sr Data Engineer
Compensation estimateAI
See base, equity, bonus, and total comp estimates for this role — free, no credit card.
Sign up to see compensation estimateWhile technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed.
Company Highlights:
Quantiphi has seen 2.5x growth YoY since its inception in 2013, we don’t just innovate—we lead. Headquartered in Boston, with 4000+ Quantiphi professionals across the globe. As an Elite/Premier Partner for Google Cloud, AWS, NVIDIA, Snowflake, and others, we’ve been recognized with:
- 17x Google Cloud Partner of the Year awards in the last 8 years
- 3x AWS AI/ML award wins
- 3x NVIDIA Partner of the Year titles
- 2x Snowflake Partner of the Year awards
- We have also garnered Top analyst recognitions from Gartner, ISG, and Everest Group.
- We offer first-in-class industry solutions across Healthcare, Financial Services, Consumer Goods, Manufacturing, and more, powered by cutting-edge Generative AI and Agentic AI accelerators.
- We have been certified as a Great Place to Work for the third year in a row- 2021, 2022, 2023.
Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation. Your next big opportunity starts here.
About The Role
As a Senior Data Engineer, you will play a key role in designing, building, and maintaining scalable data pipelines that power analytics, insights, and business decision-making. You will work across both batch and streaming architectures, leveraging PySpark, SQL, and modern data engineering frameworks to deliver reliable, high-performance data solutions.
Key Responsibilities
- Define and own the overall data architecture for ingestion, storage, transformation, and analytics on GCP (focused on BigQuery and Cloud Composer).
- Design data modeling frameworks and best practices for structured and semi-structured insurance data (Policy, Claims, Billing).
- Collaborate with Business Analysts to translate functional Guidewire requirements into conceptual and logical data models.
- Work with Data Modelers and Data Engineers to define physical schemas, transformation strategies, and data lineage standards.
- Design and oversee data ingestion architecture from Guidewire (staging, raw, curated layers) using SQL-based ELT pipelines.
- Establish data governance, metadata management, and data quality frameworks for transparency and compliance.
- Review and optimize BigQuery data structures (partitioning, clustering, query tuning, storage tiering).
- Define naming conventions, security models (IAM/RLS), and access control standards for the data warehouse.
- Ensure architecture alignment with cloud best practices for scalability, cost optimization, and maintainability.
- Provide architectural direction and mentorship to the Data Engineering Lead, Data Modeler, and Data Engineers.
- Partner with enterprise security and infrastructure teams to maintain compliance with data privacy regulations.
Required Skills and Experience
- 10+ years of experience in data architecture/design with at least 6+ years on GCP.
- Deep expertise in Google BigQuery data warehouse design and performance tuning.
- Strong working knowledge of Cloud Composer (Airflow) and orchestration pipelines.
- Solid understanding of insurance data structures, preferably from Guidewire systems (PolicyCenter, BillingCenter, ClaimsCenter).
Experience architecting enterprise-grade ELT frameworks and multi-layered data architectures (staging raw curated- analytics).
- Hands-on proficiency in SQL and schema design for analytical environments (star/snowflake models).
- Familiarity with data governance, cataloging, and metadata management.
- Ability to lead technical teams and guide design decisions with both functional and technical stakeholders.
What is in it for you:
- Be part of the fastest-growing AI-first digital transformation and engineering company in the world
- Be a leader of an energetic team of highly dynamic and talented individuals
- Exposure to working with fortune 500 companies and innovative market disruptors
- Exposure to the latest technologies related to artificial intelligence and machine learning, data and cloud
*If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us**!*
Similar roles
- Senior Data EngineerExperion Technologies · Plano, Texas, United States · Hybrid
- Lead Data EngineerSmart IT Frame LLC · Los Angeles, California, United States · Hybrid
Principal Data EngineerRS21: A Data Science and Visualization Company · United States · Remote
Senior Data EngineerRaag Solutions · Bellevue, Washington, United States · Onsite- Lead Data EngineerRetail Insight Ltd · Illinois, United States · Hybrid