Senior Staff Software Engineer, Data Infrastructure
Role summary
The Senior Staff Software Engineer, Data Infrastructure will define the strategic and technical direction for the company's core data platform, impacting how large-scale data is processed, stored, and utilized. This role involves creating multi-year architecture roadmaps, guiding investment decisions, and leading innovation in data infrastructure. Key responsibilities include designing a modern data lakehouse, optimizing compute capabilities, overseeing real-time streaming infrastructure, and integrating AI/LLM tools for automation and cost optimization. The position requires extensive experience in data infrastructure architecture, cloud platforms (AWS), and technologies like Apache Iceberg, Flink, Kafka, Spark, Snowflake, and Databricks, along with strong technical leadership and collaboration skills.
- About Our Client:
The organization operates within the grocery delivery industry, addressing the complex needs of customers seeking convenient access to groceries and household goods. It serves millions of people by providing an essential service that supports daily shopping needs. The company also offers flexible earning opportunities for personal shoppers, positioning itself as a critical player in grocery commerce. Its approach emphasizes flexibility in work arrangements and a commitment to serving a broad community with reliable, scalable technology infrastructure.
- About the Opportunity:
The Senior Staff Software Engineer, Data Infrastructure is responsible for setting the strategic and technical direction of the company’s core data platform. This role influences how the organization processes and uses large-scale data—from storage and compute to real-time streaming and governance—to power key business functions. The position requires defining multi-year architecture roadmaps, guiding major investment decisions, and acting as a technical leader who drives company-wide impact through data infrastructure innovation and collaboration. This role ensures the data platform scales efficiently and supports critical business priorities such as monetization and compliance.
- Responsibilities:
• Define and drive the multi-year technical vision and roadmap for the core data platform, including storage, compute, streaming, orchestration, and analytical serving
• Architect platform ownership strategy, balancing build versus buy decisions and managing risk and cost-benefit analyses for major investments
• Lead the design and delivery of the modern data lakehouse including unified table formats, compute engine portfolios, and storage governance
• Expand and optimize multi-engine compute capabilities across interactive, batch, and stream processing workloads
• Oversee architecture for real-time and streaming data infrastructure supporting critical use cases like advertising, fraud detection, and machine learning
• Lead adoption and integration of AI and large language model tools across the data platform lifecycle to enhance automation and cost optimization
• Serve as a senior technical authority, leading architecture reviews, mentoring engineers, and contributing to hiring and cross-organizational alignment
• Collaborate with stakeholders across data science, machine learning, product engineering, advertising infrastructure, finance, and security to build reliable, self-serve infrastructure
• Represent data infrastructure in architectural decision forums to ensure alignment with business priorities
- Requirements:
• Extensive experience in data infrastructure architecture, including data lakes, streaming, and analytics platforms
• Proven ability to develop multi-year technical roadmaps and lead platform strategy decisions
• Strong understanding of cost modeling, risk analysis, and phased migration planning
• Experience with technologies such as Apache Iceberg, Flink, Kafka, Spark, Snowflake, Databricks, and cloud platforms (AWS)
• Expertise in real-time data processing and event-driven systems
• Knowledge of AI/LLM integration in data platforms and automation workflows
• Demonstrated leadership skills in mentoring senior engineers and influencing cross-functional teams
• Ability to translate complex technical concepts into actionable plans aligned with business goals
- Pay Range and Compensation Package:
• The pay range and compensation package for this role will be determined based on the candidate’s experience, skills, and other relevant factors.
Equal Opportunity Statement: Our client is an equal opportunity employer. They celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, or national origin.
Note:
RemoteHunter is not the Employer of Record (EOR) for this role. Our purpose in this opportunity is to connect exceptional candidates with leading employers. We help job seekers worldwide discover roles that match their goals and guide them to complete their full application directly through the hiring company’s career page or ATS.