Lead Cloud Data Platform Engineer

Title: Lead Cloud Data Platform Engineer

Locations: (Hybrid onsite)

• Plano, TX
• Charlotte, NC
• Iselin, NJ
• Chandler, AZ
• Des Moines, IA
• Minneapolis, MN

Duration: 12-month W2 contract

We are currently seeking a Lead Cloud Data Platform Engineer to apply deep technical skills to create data products, develop AI-based automation tools, and build a world-class cloud analytics capability for a Cyber Security Data Ecosystem on a Hybrid cloud. The successful candidate will continually innovate and pioneer the use of new technologies, and drive adoption of these amongst a team of talented data engineers. You will be an integral part of our migration from our on-premises systems to the Google Azure cloud. You will be a vital member of an agile team helping to lead the design and hands-on implementation of modern data processing capabilities. This is a visible role that allows you to share your knowledge and skills with other developers and product teams in a collaborative environment.

Responsibilities:

• Implement and operationalize modern AI-enabled data capabilities on Google Cloud to ingest, transform, and distribute data for a variety of big data apps
• Leverage AI/Agentic frameworks to automate data management, governance, and data consumption capabilities - data pipelines, data quality, metadata, data compliance, etc.
• Work within a matrix org. with principal engineers, product managers, and data engineers to roadmap, plan, and deliver key data capabilities based on priority

Required Qualifications:

• Demonstrable skills (recent) using AI tools such as LangChain, LangGraph/ADK, agentic frameworks, RAG, GraphRAG, and using MCP to build agent-based data capabilities
• 5+ years of experience in data engineering including hands-on experience working with Cloud data solutions: creating/supporting Spark based ingestion and processing
• 3+ years of experience with Data Lakehouse architecture and design, including hands-on experience with Python, PySpark, Kafka, Airflow, Google Cloud Storage, BigQuery, Data Proc, Cloud Composer
• Hands-on experience developing data flows using Kafka, Flink, and Spark streaming

Desired Qualifications:

• Proven experience using AI to auto-generate data engineering related code, context engineering and prompt engineering
• Deep background on cloud-based data lakes and warehouses, and automated data pipelines
• Public cloud certifications such as GCP Professional Data Engineer, Azure Data Engineer, or AWS Specialty Data Analytics
• Web based UI development using React and Node JS is a plus