Azure Data Engineer
Role summary
We are seeking an experienced Azure Data Engineer to join our team. The primary focus will be on leveraging Azure Databricks, Python, Pyspark, and SQL to design, develop, and implement robust data solutions. You will be responsible for building and optimizing data pipelines, managing data lakes, and implementing ETL processes for data warehousing and business intelligence. The ideal candidate will have 7-10 years of experience with various Azure data services and related technologies, a strong understanding of data lake best practices, and a proven ability to write clean, modular code. Experience with DevOps, CI/CD, and agile methodologies is also valuable.
*JOB Description:*
- Primary Skill :
Azure Databricks
- Secondary skills:
Python, Pyspark & SQL
- 7-10 years of data engineering experience leveraging technologies such as Snowflake, Azure Data Factory, ADLS Gen 2, Logic Apps, Azure Functions, Databricks, Apache Spark, Scala, Synapse, SQL Server
- Understanding the pros and cons, and best practices of implementing Data Lake, using Microsoft Azure Data Lake Storage
- Experience structuring Data Lake for the reliability, security and performance.
- Experience implementing ETL for Data Warehouse and Business intelligence solutions.
- Skills to read and write effective, modular, dynamic, parameterized and robust code, establish and follow already established code standards, and ETL framework.
- Strong analytical, problem solving, and troubleshooting abilities.
- Good understanding of unit testing, software change management, and software release management
- Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as Code fundamentals
- Experience performing root cause analysis on data and processes to answer specific business questions and identify opportunities for improvement.
- Experience working within an agile team.
- Excellent communication skills
Similar roles
Sr. Azure Data EngineerNTT DATA North America · Atlanta, Georgia, United States · Onsite- Azure Data EngineerGoWin Search LLC · United States · Remote
- Azure Data EngineerInterEx Group · Atlanta, Georgia, United States · Remote
Senior Azure Data EngineerPrecision Technologies · Mutual, Ohio, United States · Onsite- Senior Azure Data EngineerExperion Technologies · Cochin, Saskatchewan, Canada · Onsite