Azure Data Engineer - Full Remote - Contractor in USD
Required skills
- Azure Data Factory
- Azure Storage
- Data Lake
- Data Warehouse
- Azure Synapse Analytics
- execution of test plans
- testing scripts
- testing tools
Nice to have
- Python
- Scala
- Java
- Azure DevOps
- Azure Purview
Role summary
An international organization in New York is seeking a REMOTE Azure Data Engineer on a contract basis. The role involves designing and implementing data infrastructure using a hub and spoke model, focusing on data connectivity, storage, pipelining, and integration. Responsibilities include collecting and processing large datasets, optimizing infrastructure for scalability, automating processes, and building analytical tools. The engineer will collaborate with various stakeholders to deliver data solutions. A Bachelor's or Master's degree and significant experience with Azure cloud technologies, data warehousing, ETL/ELT, and database architecture testing are required. Proficiency in Azure Data Factory, Azure Storage/Data Lake/Data Warehouse, and Azure Synapse Analytics is essential. Experience with Python, Scala, Java, Azure DevOps, and Azure Purview is a plus.
- Collecting large, complex sets of data that meet non-functional and functional business requirements;
- Identifying, designing, and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes;
- Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using Azure and SQL technologies;
- Building analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition;
- Working with stakeholders including cloud infrastructure teams, data teams, governance, and information management officers, to collaboratively design, develop and deploy and support data solutions and related infrastructure;
- Bachelor or Master degree;
- +5 years of relevant experience with detailed knowledge of data warehouse technical architectures, infrastructure components, ETL/ ELT and reporting/analytic tools;
- +3 years of experience with Azure Cloud portal;
- Proficiency in working with Azure Data Factory - Extraction, Transformation and Loading is required;
- Proficiency in working with Azure Storage/ Data Lake / Data Warehouse is required;
- Experience with Database architecture testing methodology, including execution of test plans, debugging, and testing scripts and tools is required;
- Working knowledge of Azure Synapse analytics is required;
- Strong experience in coding languages like Python, Scala & Java is a plus;
- Experience with Azure DevOps and Azure Purview are a plus;
- Fluent in English;
Originally posted on Himalayas
Similar roles
- (Senior) IT Recruiter - USD - Contractor - Full remotegoPro Consultancy Group ltd. · Remote · Remote
- 10x PeopleSoft Developer/Consultant v9.2 - Full RemotegoPro Consultancy Group ltd. · Remote · Remote
Azure Data Engineer - FabricData Elephant · Calgary, AB · Hybrid- Azure Data EngineerOrion Innovation · Montvale, NJ · Onsite
- Senior Consultant/Manager - Data EngineerElectric Mind · Downtown Toronto · Hybrid
- Senior Data EngineerClarity Innovations · Macdill Afb, FL · Hybrid
