Principal Data Engineer (AWS)
Role summary
A Principal Data Engineer is sought for a full-time, onsite position in Chicago. The role involves end-to-end ownership of data pipelines, including design, build, and operation of batch and streaming pipelines using AWS services like Glue, Redshift, Spark, Kinesis, and Lambda. Responsibilities include defining data architecture and modeling for specific business domains, optimizing AWS services for performance and cost, ensuring production reliability, quality, and security, and providing technical leadership through mentorship and setting engineering standards.
Principal Data Engineer (AWS)
Chicago IL- 5 Days Onsite
Full Time position
1.End to End Ownership of Data Pipelines
Designs, builds, and operates critical batch and streaming pipelines (Glue, Redshift, Spark, Kinesis, Lambda), handling complex edge cases like schema evolution, CDC, late data, and high-volume workloads.
2.Data Architecture & Modeling
Owns the data architecture for a specific business domain, defining Lakehouse patterns, data models, partitioning strategies, and storage/query choices (S3, Redshift, Athena) based on real usage and performance needs aligning with Enterprise standards.
3.Hands On AWS Optimization & Troubleshooting
Actively tunes Spark jobs, Glue configurations, Redshift performance, and S3 layouts; investigates production issues, reduces pipeline latency, and controls cloud cost through code and configuration changes.
4.Production Reliability, Quality & Security
Implements domain level data quality checks, monitoring, and alerting; ensures secure access; owns production incidents and drives permanent fixes.
5.Technical Leadership Within the Team
Leads by example through coding, PR reviews, and design guidance; mentors senior engineers, sets engineering standards, and translates business requirements into scalable, reliable data solutions.
Kindly reply with your resume to Email- jnehru@nam-it.com
