Data Engineer (Remote)
Role summary
A remote Data Engineer is sought to design, develop, and maintain data pipelines using Azure Data Factory, build and optimize data models on Azure SQL, and manage ETL/ELT processes. The role involves integrating data via APIs, utilizing Azure Data Lake Storage Gen2 for storage and processing, and developing reports with Power BI. Responsibilities also include writing complex SQL queries, automating workflows with Azure Logic Apps, implementing analytics solutions with Azure Analysis Services, managing source code with Azure Repos, and setting up CI/CD pipelines with Azure Pipelines and Releases. Ensuring data quality, integrity, and security is paramount. Collaboration with Business Analysts, Data Analysts, and Developers is expected.
Responsibilities
- Design, develop, and maintain data pipelines using Azure Data Factory
- Build and optimize data models and data warehousing solutions on Azure SQL
- Develop and maintain ETL/ELT processes to ensure efficient data flow
- Integrate data from various sources via API Integration
- Work with Azure Data Lake Storage Gen2 for large-scale data storage and processing
- Develop dashboards and reports using Power BI
- Write and optimize complex SQL queries and Stored Procedures
- Automate workflows and integrations using Azure Logic Apps
- Implement data models and analytics solutions using Azure Analysis Services
- Manage source code and version control using Azure Repos
- Set up and maintain CI/CD pipelines using: Azure Pipelines, Azure Releases
- Ensure data quality, integrity, and security across all data systems
- Collaborate with cross-functional teams including Business Analysts, Data Analysts, and Developers
Requirements
- Strong experience in Python development
- Hands-on experience with: Azure Data Factory, Azure SQL, Azure Data Lake Storage Gen2
- Strong expertise in SQL and Stored Procedures
- Experience with API Integration
- Proficiency in Power BI for data visualization and reporting
- Experience with: Azure Logic Apps, Azure Analysis Services
- Familiarity with Azure DevOps tools: Azure Repos, Azure Pipelines, Azure Releases
- Solid understanding of data warehousing and ETL/ELT concepts
- Strong problem-solving and analytical skills
- Ability to communicate effectively in English (B2 level or above)
Benefits
- Competitive salary package
- Opportunity to work on modern tech stack
- Professional growth and learning opportunities
- Dynamic and collaborative working environment
How useful was this post?
Click on a star to rate it!
Average Rating / 5. Vote Count
No votes so far! Be the first to rate this post.
