Senior Data Engineer
Role summary
84.51° is seeking a Senior Data Engineer to build and maintain scalable data pipelines for ingesting, transforming, and distributing big data. This role involves using technologies like PySpark, Python, Databricks, and Azure-based tools to support data scientists and products. Responsibilities include designing and implementing data solutions, ensuring data quality through testing, collaborating with engineering teams, and driving improvements in data engineering practices. The position requires a strong understanding of ETL, data warehousing, and Agile principles, with a 5-day in-office work schedule.
84.51° Overview:
84.51° is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliates create more personalized and valuable experiences for shoppers across the path to purchase.
Powered by cutting-edge science, we utilize first-party retail data from more than 62 million U.S. households sourced through the Kroger Plus loyalty card program to fuel a more customer-centric journey using 84.51° Insights, 84.51° Loyalty Marketing and our retail media advertising solution, Kroger Precision Marketing.
*84.51° follows a 5‑day in‑office work schedule to support collaboration, alignment, and team connection.*
Join us at 84.51°!
\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_
\*\*PLEASE NOTE\*\*
Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United Stated and with the Kroger Family of Companies (i.e. H1-B visa, F-1 visa (OPT), TN visa or any other non-immigrant status).
Senior Data Engineer
Cincinnati, OH or Chicago, IL
84.51° Overview:
84.51° is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliates create more personalized and valuable experiences for shoppers across the path to purchase.
Powered by cutting-edge science, we utilize first-party retail data from more than 62 million U.S. households sourced through the Kroger Plus loyalty card program to fuel a more customer-centric journey using 84.51° Insights, 84.51° Loyalty Marketing and our retail media advertising solution, Kroger Precision Marketing. Join us at 84.51°!
As a Senior Data Engineer, you will have the opportunity to build solutions that ingest, transform, store, and distribute our big data to be consumed by data scientists and our products.
Our data engineers use PySpark/Python, Databricks, and other Azure based data engineering technologies and visualization tools to deliver data capabilities and services to our scientists, products, and tools.
Responsibilities
Take ownership of features and drive them to completion through all phases of the entire 84.51° SDLC. This includes internal and external facing applications as well as process improvement activities:
- Design, build, and maintain scalable, efficient, and reliable data pipelines to support data ingestion, transformation, and integration across diverse sources and destinations, using tools such as Kafka, Databricks, and similar toolsets
- Implement automated unit and integration testing
- Collaborate with architecture and lead engineers to ensure consistent development practices
- Provide mentoring to junior engineers
- Participate in retrospective reviews
- Participate in the estimation process for new work and releases
- Collaborate with other engineers to solve and bring new perspectives to complex problems
- Drive improvements in data engineering practices, procedures, and ways of working
- Embrace new technologies and an ever-changing environment
Requirements
- 3+ years proven ability of professional Data Development experience
- 2+ years proven ability of developing with Databricks or Hadoop/HDFS
- 2+ years of experience with PySpark/Spark
- 3+ years of experience developing with either Python or Java
- 3+ years of experience with SQL and NoSQL technologies.
- Full understanding of ETL concepts and Data Warehousing concepts
- Experience with Pipeline Orchestration
- Experience with CI/CD
- Experience with version control software
- Strong understanding of Agile Principles (Scrum)
- Bachelor's Degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM)
Bonus Points for experience in the following
- Experience with Azure
- Experience with Databricks Delta Tables, Delta Lake, Delta Live Tables
- Proficient with Relational Data Modeling
- Experience with CI/CD pipelines
- Experience with Python Library Development
- Experience with Structured Streaming (Spark or otherwise)
- Experience with Kafka and/or Azure Event Hub
- Experience with Github SaaS / Github Actions
- Experience with Snowflake
- Exposure to BI Tooling (Tableau, Power BI, Cognos, etc.)
#LI-SSS
Similar roles
- Senior Data EngineerExperion Technologies · Plano, Texas, United States · Hybrid
- Lead Data EngineerSmart IT Frame LLC · Los Angeles, California, United States · Hybrid
Principal Data EngineerRS21: A Data Science and Visualization Company · United States · Remote
Senior Data EngineerRaag Solutions · Bellevue, Washington, United States · Onsite- Lead Data EngineerRetail Insight Ltd · Illinois, United States · Hybrid