Senior Data Engineer
Role summary
Seeking a Senior Data Engineer with over 10 years of experience, specializing in Microsoft Purview for enterprise data environments. The role requires deep, hands-on expertise in implementing, configuring, and operating Purview components such as Collections, Scanners, Metadata catalog, Classifications, Glossary, and Lineage. Responsibilities include maintaining and enhancing existing deployments, resolving issues, developing automation using Purview APIs/SDKs, and leveraging Purview Data Quality and Workflow features. The ideal candidate will also have experience with Azure and AWS data services, Python, building custom Fabric reports, and enabling AI-driven insights. Experience working within data engineering and governance teams is essential.
Job Title - Senior Data Engineer
Location - Newark, NJ – Hybrid 3days/week onsite (local candidates only
Duration - 12+ Months contract
Interview Process - Video
Job Description:
10+ years of experience
Senior Data Engineer (Microsoft Purview) with deep, hands-on experience implementing and operating Microsoft Purview in enterprise data environments.
Required Skills and Qualifications:
· 10+ years of experience in data engineering, analytics engineering, or data governance
· 7+ years Hands-on production experience implementing and configuring Microsoft Purview components including Collections, Scanners, Metadata catalog, Classifications, Glossary, and Lineage
· Demonstrated ability to maintain and enhance existing Purview deployments by resolving scan, lineage, and metadata issues
· Experience developing automation using Microsoft Purview REST APIs and SDKs
· Experience with Purview Data Quality including profiling, rules, thresholds, and monitoring
· Experience with Purview Workflow for approval processes and governance
· automation
· Ability to build custom Fabric reports and dashboards using data from Microsoft Purview
· Ability to implement solutions that enable AI-driven insights and automation
· Strong knowledge of Azure and AWS data services
· Proficiency in Python
Additional information:
· Agile experience
· Financial services tech experience is plus
· Ability to document technical implementations clearly for technical and non-technical audiences
· Experience working embedded with data engineering and governance teams
· Comfortable participating in team syncs and presenting technical solutions to stakeholders
Similar roles
- Senior Data EngineerExperion Technologies · Plano, Texas, United States · Hybrid
- Lead Data EngineerSmart IT Frame LLC · Los Angeles, California, United States · Hybrid
Principal Data EngineerRS21: A Data Science and Visualization Company · United States · Remote
Senior Data EngineerRaag Solutions · Bellevue, Washington, United States · Onsite- Lead Data EngineerRetail Insight Ltd · Illinois, United States · Hybrid