Databricks Data Engineer

Deerfield, Illinois, United StatesOnsiteFull Time$131,900–$131,900 /yrPosted 2 months ago

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Role summary

Deerfield, Illinois-based company seeks a full-time, onsite Databricks Data Engineer. The role involves building and managing data products using Databricks, Spark, Python, and Azure services. Responsibilities include data ingestion from batch and streaming sources, SQL-based data quality checks, CI/CD pipeline implementation, containerization with Docker and AKS, and setting up monitoring and alerting. Experience with Azure data services, Git workflows, and testing data pipelines is essential. Familiarity with Spark Structured Streaming, data modeling, and data quality tools is preferred.

Deerfield, Illinois 60015 Posted March 25th, 2026

Looking for more job opportunities? Click here!

Job Type: Full Time

Job Category: IT

Job Description

Job Title : Databricks Data Engineer
Location : Deerfield IL (ONSITE)
FTE ONLY

Job Description

Mandatory skills: Databricks, Spark, Azure, Python, Cosmos DB, Azure DevOps (GitHub, CI/CD pipelines, Boards etc.), Docker & Azure Kubernetes Service, Graffana, JUnit, Postman, SonarQube
Additional Skills: 3–6 years of experience in data engineering on cloud data platforms. Hands‑on experience building Spark jobs with Scala/Spark and/or PySpark on Databricks. Experience ingesting data from batch and streaming sources into ADLS Gen2 using Delta or Apache Iceberg tables. Good SQL skills for joins, aggregations, and data quality checks. Understanding of core Azure data services (Event Hubs/Kafka, Data Factory/Databricks Workflows, Key Vault). Experience working with Git‑based workflows and CI/CD in Azure DevOps or GitHub.
Good to have skills: Exposure to Spark Structured Streaming for near real‑time use cases. Experience with data quality tools or frameworks and writing unit/integration tests for data pipelines. Familiarity with data modeling and performance considerations in Lakehouse environments.

Roles & Responsibilities:

Responsible for building data products in Databricks using Scala/Spark

Responsible for Ops work managing production for the data products developed and deployed to production

Responsible for testing data products based on product specification and end to end validation

Set up monitoring, logging, and alerting Spark jobs and data pipelines using Azure Monitor/Log Analytics or similar tools

Coordinate with offshore team in India

Required Skills

DEVOPS ENGINEER

SENIOR EMAIL SECURITY ENGINEER

Ready to apply?

You'll be redirected to Realign's application page.

Is this role right for you?

Role summary

Similar roles