Lead Data Engineer
Role summary
A global technology consulting firm seeks a Lead Data Engineer for a 3-month remote contract, with likely extensions. The role focuses on spearheading the Data Quality Strategy and Data QA for a challenging SQL to AWS migration. Responsibilities include developing strategies, ensuring high-volume data scalability, optimizing database retrieval, and structuring data for manageability. The ideal candidate will possess strong skills in Data Quality Strategy, root cause analysis, Python, Pytest, SQL, Airflow, dbt, AWS, Redshift, and S3, along with exceptional communication abilities.
Lead Data Engineer
- 3 month contract with likely extension
- remote
- $80 to $100 per hour for incorporated consultants
Our client is a global leader in technology consutling. They are seeking a visionary
Lead Data Engineer
to spearhead the Data Quality Strategy & Data QA for a SQL to AWS migration that is not going well. You will leverage your Data Engineering and QA Background to do strong root cause analysis to diagnose and fix pipeline failures.
Responsibilities
- Develop the Data Quality Strategy and Data QA for the SQL to AWS migration
- Scalabilty & High Volume Data - strong permant coding that can handle millions of records without latency
- Database Optimization - optimize data retrieval. Reduce search complexity from linear scans to logarithmic lookups.
- Physcially structure data to ensure the system remains managemable as it grows.
Requirements
- Demonstrated strength in Data Quality Strategy
- Exceptional communication skills
- Demonstrated strenght in Python, Pytest, SQL, Airlfow, dbt, AWS, Redshift & S3
- Strong root cause analysis to diagnose and fix data pipeline failures
Similar roles
- Senior Data EngineerExperion Technologies · Plano, Texas, United States · Hybrid
- Lead Data EngineerSmart IT Frame LLC · Los Angeles, California, United States · Hybrid
Principal Data EngineerRS21: A Data Science and Visualization Company · United States · Remote
Senior Data EngineerRaag Solutions · Bellevue, Washington, United States · Onsite- Lead Data EngineerRetail Insight Ltd · Illinois, United States · Hybrid