Databricks Data Engineer-4

Deerfield, Illinois, United StatesOnsiteTemporary$131,900–$131,900 /yrPosted 2 months ago

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Role summary

This full-time, onsite Databricks Data Engineer role in Deerfield, IL, focuses on building and managing data products within the Azure cloud environment. The engineer will be responsible for developing data pipelines using Databricks, Spark, Scala, and PySpark, ingesting data from various sources into ADLS Gen2 using Delta or Apache Iceberg. Key responsibilities include implementing CI/CD pipelines, setting up monitoring and alerting, and performing end-to-end validation. Experience with Azure services, SQL, and Git-based workflows is mandatory. Familiarity with Spark Structured Streaming and data quality frameworks is preferred.

Deerfield, Illinois 60015 Posted March 29th, 2026

Looking for more job opportunities? Click here!

Job Type: Full Time

Job Category: IT

Job Description

Job Title : Databricks Data Engineer
Location : Deerfield IL (ONSITE)
FTE ONLY

Job Description

Mandatory skills: Databricks, Spark, Azure, Python, Cosmos DB, Azure DevOps (GitHub, CI/CD pipelines, Boards etc.), Docker & Azure Kubernetes Service, Graffana, JUnit, Postman, SonarQube
Additional Skills: 3–6 years of experience in data engineering on cloud data platforms. Hands‑on experience building Spark jobs with Scala/Spark and/or PySpark on Databricks. Experience ingesting data from batch and streaming sources into ADLS Gen2 using Delta or Apache Iceberg tables. Good SQL skills for joins, aggregations, and data quality checks. Understanding of core Azure data services (Event Hubs/Kafka, Data Factory/Databricks Workflows, Key Vault). Experience working with Git‑based workflows and CI/CD in Azure DevOps or GitHub.
Good to have skills: Exposure to Spark Structured Streaming for near real‑time use cases. Experience with data quality tools or frameworks and writing unit/integration tests for data pipelines. Familiarity with data modeling and performance considerations in Lakehouse environments.

Roles & Responsibilities:

Responsible for building data products in Databricks using Scala/Spark

Responsible for Ops work managing production for the data products developed and deployed to production

Responsible for testing data products based on product specification and end to end validation

Set up monitoring, logging, and alerting Spark jobs and data pipelines using Azure Monitor/Log Analytics or similar tools

Coordinate with offshore team in India

Required Skills

DEVOPS ENGINEER

SENIOR EMAIL SECURITY ENGINEER

Ready to apply?

You'll be redirected to Realign's application page.