Senior DevOps Engineer – Azure, Terraform & Databricks

Role : Senior DevOps Engineer – Azure, Terraform & Databricks

Must : Onsite for F2F client interview required : Only local candidate (Alpharetta, Georgia)

Must have skills : Data Brick/Kafka

Location: Alpharetta GA

Key Responsibilities:

- Design, implement, and manage Azure
cloud infrastructure
for scalable and reliable applications.
- Develop and maintain
Terraform scripts
for automated infrastructure provisioning and configuration.
- Build and manage big data clusters, including
Azure Databricks
and
On-Premise Hadoop
, for advanced analytics and data processing workloads.
- Set up and maintain
CI/CD pipelines
using
GitLab CI
and
Harness
, ensuring robust and automated deployment processes.
- Integrate connectivity between
Gitlab CI
,
Nexus Repository
and
Harness CD
to allow seamless delivery.
- Collaborate with cross-functional teams to improve infrastructure performance, security, and scalability.
- Monitor infrastructure and applications for performance issues, troubleshooting, and resolving incidents.
- Participate in
on-call rotations
to address critical issues and ensure system reliability.

Key Skills and Experience:

- Cloud Expertise:
Proficiency in
Azure cloud services
, including virtual networks, storage accounts, WebApp services, Spring Apps, Databricks and Kubernetes (AKS).
- Infrastructure as Code:
Deep knowledge of
Terraform
for IaC implementation and best practices.
- Big Data Technologies:
Hands-on experience with
Databricks
and
On-Premise Hadoop
for big data workloads.
- CI/CD Tools:
Advanced experience with
GitLab CI
for continuous integration and
Harness
for deployment automation.
- Artifact Management:
Familiarity with
Nexus Repository
for managing build artifacts.
- Scripting and Automation:
Proficiency in Python, Bash, or PowerShell for automation tasks.
- Version Control:
Expertise in Git workflows and best practices.