AgileGrid Solutions logo
AgileGrid Solutions Verified
IT Services, Software Development, Consulting

Lead Azure Data Engineer

United StatesOnsiteFull TimeLeadPosted 2 months agoVisa sponsorship available

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Role summary

Robotics Process Automation, LLC is seeking a Lead Azure Data Engineer to design, develop, and implement scalable data platforms and pipelines on Azure and Databricks. This role involves building robust data ingestion, transformation, and processing workflows for batch and real-time data streams using technologies like ADLS, Delta Lake, and Spark (Python). The ideal candidate will have 5+ years of experience in large-scale data platforms, strong data modeling skills, and expertise in Azure cloud services. Responsibilities include architecting solutions, ensuring data quality and performance, defining best practices, troubleshooting issues, and mentoring junior engineers. The company offers a comprehensive benefits package and a collaborative work environment.

About The Company
Robotics Process Automation, LLC is a leading technology firm dedicated to delivering innovative automation solutions that enhance operational efficiency and drive digital transformation for organizations across various industries. With a focus on cutting-edge technologies and a commitment to excellence, the company specializes in developing scalable data platforms, intelligent automation tools, and advanced analytics solutions. Our team comprises passionate professionals who are committed to pushing the boundaries of what's possible in automation and data engineering. We foster a collaborative and inclusive work environment that encourages continuous learning, innovation, and professional growth. At Robotics Process Automation, LLC, we believe in empowering our employees to make meaningful contributions that shape the future of automation technology.
About The Role
We are seeking a highly skilled and motivated Data Platform Architect to join our dynamic team. In this role, you will be responsible for designing, developing, and implementing scalable data platforms and pipelines on Azure and Databricks. Your expertise will be pivotal in building robust data ingestion, transformation, and processing workflows that handle both batch and real-time data streams efficiently. You will work extensively with technologies such as ADLS, Delta Lake, and Spark (Python), ensuring the delivery of high-quality, reliable, and high-performance data solutions. The ideal candidate will have a strong background in data engineering, data modeling, and system architecture, with a passion for solving complex data challenges and driving continuous improvement in data platforms.
Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Technology, or a related field.
  • Proven experience (5+ years) in designing and implementing large-scale data platforms and pipelines.
  • Deep expertise in Azure cloud services, particularly Azure Data Lake Storage (ADLS), Azure Databricks, and related tools.
  • Strong proficiency in Spark (Python) for data processing and engineering tasks.
  • Hands-on experience with Delta Lake, relational databases such as PostgreSQL, and lakehouse architectures.
  • Solid understanding of data modeling concepts, including conceptual, logical, and physical models.
  • Knowledge of data governance, data security, and data quality best practices.
  • Excellent problem-solving skills and ability to troubleshoot complex production issues.
  • Strong collaboration skills to work effectively with cross-functional teams including data scientists, analysts, and business stakeholders.
  • Experience mentoring junior engineers and contributing to engineering standards and reusable components.

Responsibilities

  • Architect, design, and implement scalable data platforms and pipelines on Azure and Databricks to meet evolving business needs.
  • Build and optimize data ingestion, transformation, and processing workflows across batch and real-time data streams.
  • Work extensively with ADLS, Delta Lake, and Spark (Python) for large-scale data engineering tasks.
  • Lead the development of complex ETL/ELT pipelines, ensuring data quality, reliability, and performance standards are met.
  • Design and implement data models—including conceptual, logical, and physical models—for analytics and operational workloads.
  • Collaborate with data architects, scientists, analysts, and business teams to translate requirements into scalable technical solutions.
  • Define and enforce best practices in data governance, security, and architecture to ensure compliance and data integrity.
  • Troubleshoot production issues, optimize system performance, and support ongoing platform enhancements.
  • Mentor junior data engineers, promote engineering standards, and contribute to the development of reusable components and frameworks.

Benefits
Robotics Process Automation, LLC offers a comprehensive benefits package designed to support our employees' well-being and professional growth. Our offerings include competitive salary packages, health insurance plans, and retirement savings options. We provide ample opportunities for training and development, including certifications and workshops, to help you stay ahead in the rapidly evolving field of data engineering and automation. Our flexible work arrangements and supportive work environment foster a healthy work-life balance. Additionally, employees enjoy paid time off, performance bonuses, and recognition programs that acknowledge outstanding contributions. We are committed to creating a workplace where every individual feels valued, empowered, and motivated to succeed.
Equal Opportunity
Robotics Process Automation, LLC is an equal opportunity employer committed to fostering an inclusive workplace. We do not discriminate based on race, color, religion, sex, sexual orientation, gender identity, age, disability, veteran status, or any other protected characteristic. Our hiring, promotion, transfer, compensation, benefits, discipline, and termination policies are all conducted without bias and in accordance with applicable laws. We believe diversity and inclusion are essential to our success and are dedicated to providing equal employment opportunities to all qualified individuals. We do not require U.S. citizenship or lawful permanent residency as a condition of employment unless mandated by law or specific contractual obligations.

Ready to apply?
You'll be redirected to AgileGrid Solutions's application page.

Similar roles