Senior Software Engineer - PIMS2
Role summary
Publix is seeking a Senior Software Engineer to join their PIMS2 Data Service team. This role focuses on setting up Azure APIM and Data Lake/Databricks. Responsibilities include ingesting data from Kafka into a data lake using a Lakehouse architecture, designing and building optimized PySpark pipelines for ingestion and transformations, and implementing performance optimization patterns (Bronze/Silver/Gold). The engineer will also implement Spark declarative pipelines, enforce data quality gates, configure data governance in Databricks (Unity Catalog), and deliver curated datasets ensuring data contracts and consistency.
Publix Super Markets, Inc., the largest employee-owned company in the U.S., is driven by a dynamic technology team of 2,300+ professionals delivering innovative solutions to 1,400+ stores and 200,000+ associates across 8 states.
From IT security and platform engineering to architecture, software development, and infrastructure, we offer career opportunities at every level—internships through technical leadership.
Join a company consistently ranked among Fortune’s “100 Best Companies to Work For” and help us build more than great subs—build the future of technology at Publix.
Join the PIMS2 Data Service as a Senior Software Engineer opportunity. In this role the Senior Software Engineer will be responsible for the setup of Azure APIM and Data Lake/Databricks. Within the team, daily responsibilities include: data ingestion from Kafka topics into data lake (Lakehouse architecture). This also includes design, builing optimized PySpark pipelines for ingestion and transformations. We are also implementing patters for bronze/silver and gold performance optimization.
Location: Hybrid (Lakeland, FL)
Work Model: Enjoy the best of both worlds—collaborate in person and innovate remotely.
Why Join Us?
- Hybrid Flexibility: Work remotely when you need focus time and join us onsite for high-impact collaboration and brainstorming sessions.
- Operational Efficiency: Ensure technology solutions support efficient workflows and enable automation to improve operational effectiveness.
- Empowered Culture: We value autonomy, creativity, and continuous learning—your ideas shape the future of technology in our organization.
Your Impact
- Design, build, and optimize PySpark pipelines in Azure Databricks for ingestion, transformation, and publishing.
- Implement Delta Lake Lakehouse patterns (Bronze/Silver/Gold) and drive performance/cost optimization.
- Implement Spark declarative pipelines (Databricks declarative pipeline patterns; formerly DLT) and enforce data quality gates (expectations/validation) to ensure trusted datasets.
- Configure and support governance practices in Databricks (Unity Catalog permissions/access control concepts, auditability).
- Deliver curated/semantic datasets for analytics and downstream consumers; ensure data contracts and consistency.
#LI-JB1