RiseMe
LoginSign Up
Andiamo logo
Andiamo Verified
["Healthtech","MedTech","AI","3D Printing","SaaS"]

Big Data Software Engineer - Intelligent DataOps Software Leader

California, United StatesOnsiteFull TimePosted 2 months agoVisa sponsorship available

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Role summary

This Big Data Software Engineer role focuses on building and optimizing batch processing pipelines and analytical stores for large-scale reporting, experimentation, and ML feature generation. The engineer will develop cost-efficient batch processing using Spark/Dataproc/EMR and orchestration with Airflow/Dagster. Responsibilities include designing lakehouse tables (Iceberg/Delta/Hudi), implementing semantic/metrics layers and OLAP acceleration (BigQuery/Snowflake/ClickHouse), and enforcing data governance policies. The role requires 4+ years of big data experience, expert SQL, and strong understanding of storage formats, file layout, and query engines.

Big Data Software Engineer — Batch & OLAP
About The Role
Build robust batch pipelines and analytical stores for large-scale reporting, experimentation, and ML feature generation.
Responsibilities

  • Develop cost-efficient batch processing (Spark/Dataproc/EMR) and orchestration (Airflow/Dagster).
  • Design lakehouse tables (Iceberg/Delta/Hudi) with compaction, partitioning, and Z-ordering.
  • Implement semantic/metrics layers and OLAP acceleration (BigQuery/Snowflake/ClickHouse).
  • Enforce governance: lineage, access controls, PII handling, and retention policies.

Requirements

  • 4+ years in big data; expert SQL and performance tuning.
  • Strong understanding of storage formats, file layout, and query engines.

About Andiamo
Talent Partners for the AI Revolution. As a globally recognized staffing and consulting firm, we specialize in placing the top 2% of technology and go-to-market professionals with the world’s largest and most well-known companies.
For over 20 years, we've maintained the status of tier-one vendor for firms such as Palantir, Amazon, Fluidstack, Bloomberg, Relativity Space, Firefly, MasterCard, Visa, Two Sigma, Citadel, as well as other major financial services firms, elite hedge funds, Google-backed tech start-ups, and major software firms.
Our talent solutions include Permanent Placement, Contract Staffing, Executive Search, and Dedicated Recruiting Services (RPO). Find out more at www.andiamogo.com

Ready to apply?
You'll be redirected to Andiamo's application page.

Similar roles