Senior Data Engineer (Tech Lead) – Databricks / Azure
Role summary
Seeking a Senior Data Engineer / Tech Lead with 5+ years of experience in Databricks, Azure Data Factory, and SQL to lead enterprise data initiatives. This contract role focuses on designing, developing, and optimizing scalable data pipelines within the Azure ecosystem, ensuring data quality and reliability. Responsibilities include moving and transforming data, providing technical leadership and mentorship, and working with Unity Catalog and Delta Tables. Availability during EST business hours is required. Experience with Apache Spark, data validation, and Power BI is preferred.
Compensation:
$65.00-$70.00 hourly
Location:
Remote
Duration:
Contract through December 2026
We are seeking a Senior Data Engineer / Tech Lead to support enterprise data initiatives, focusing on building and optimizing scalable data pipelines within the Azure ecosystem. This is a nearshore role requiring availability during EST business hours (8–5 or 9–6).
This individual will play a key leadership role in designing, developing, and ensuring the reliability of data solutions that power business reporting and analytics.
Key Responsibilities
- Lead the design and development of scalable data pipelines using Databricks and Azure services
- Move and transform data from source systems into Azure Data Lake for reporting and analytics
- Ensure data quality through proper unit testing and system/integration testing
- Validate that all required files and transactions are accurately captured and processed
- Collaborate with cross-functional teams in an Agile environment
- Provide technical leadership, mentorship, and best practices to the engineering team
- Work with Unity Catalog and implement/manage Delta Tables within Databricks
Required Qualifications (Must-Haves)
- 5+ years of Databricks experience (Certification required)
- 5+ years of Azure Data Factory experience
- 5+ years of strong SQL development experience
- Proven experience in a Tech Lead or senior-level engineering role
- Strong understanding of Agile methodologies
- Excellent verbal communication skills
Additional Requirements (Select Roles)
- Experience with Power BI development
- Ability to support performance testing and optimization of reporting solutions
Preferred Experience
- Strong experience with Apache Spark programming
- Hands-on experience with data validation, testing frameworks, and pipeline monitoring
- Familiarity with enterprise-scale data platforms and governance practices
Category Code: JN008