Senior Fabric Data Engineer

Job title:
Senior Fabric Data Engineer

Location:
Remote

Employment Type:
Full-time (W2 only, No C2C)

Experience:
10+ Years

Job Summary:
We are seeking an experienced
Microsoft Fabric Data Engineer with 10+ years of professional experience
in building modern data platforms, scalable data pipelines, and enterprise analytics solutions using
Microsoft Fabric and Azure data services
. The ideal candidate will have strong expertise in
data engineering, big data processing, ETL/ELT pipelines, lakehouse architecture, data warehousing, and business intelligence integration
. The candidate will collaborate with
data architects, analytics teams, and business stakeholders
to design and implement robust data solutions supporting advanced analytics and reporting.

Key Responsibilities:

- Design, develop, and maintain
scalable data pipelines and data integration workflows
using
Microsoft Fabric Data Factory, Dataflows Gen2, and Azure Data Factory
, enabling efficient ingestion and transformation of large-scale enterprise data.
- Build and manage
Lakehouse architectures using Microsoft Fabric Lakehouse, OneLake, and Delta Lake
, ensuring efficient storage and processing of structured and unstructured data.
- Develop and optimize
data transformation processes
using
Apache Spark, PySpark, Spark SQL, and Fabric Notebooks
, enabling high-performance distributed data processing.
- Implement
data warehousing solutions
using
Microsoft Fabric Warehouse, Azure Synapse Analytics, and SQL-based analytical models
to support enterprise reporting and business intelligence.
- Develop
data ingestion frameworks
to integrate data from multiple sources such as
databases, APIs, streaming platforms, flat files, SaaS applications, and third-party systems
into Microsoft Fabric environments.
- Design and implement
ETL/ELT pipelines
using
Fabric Data Pipelines, Azure Data Factory, and orchestration workflows
, ensuring reliable and automated data processing.
- Implement
data modeling techniques
such as
star schema, snowflake schema, and dimensional modeling
to support analytics and reporting workloads.
- Integrate data engineering solutions with
Power BI, Microsoft Fabric Semantic Models, and reporting tools
to enable advanced business intelligence and data visualization.
- Implement
real-time and streaming data processing
using
Azure Event Hub, Azure Stream Analytics, or Apache Kafka
, supporting near real-time analytics and event-driven architectures.
- Optimize
data performance, partitioning strategies, indexing, and query execution plans
across Fabric Lakehouse and Warehouse environments.
- Implement
data governance, security, and compliance frameworks
using
Microsoft Purview, role-based access control (RBAC), data encryption, and data masking techniques
.
- Develop and maintain
CI/CD pipelines
for data engineering solutions using
Azure DevOps, GitHub Actions, or Jenkins
, enabling automated deployment and version control.
- Monitor and troubleshoot
data pipelines and Fabric workloads
using
Azure Monitor, Log Analytics, and Fabric monitoring tools
to ensure reliability and performance.
- Collaborate with
data scientists, analysts, DevOps engineers, and cross-functional Agile teams
to design scalable data platforms aligned with enterprise data strategies.
- Mentor junior data engineers and promote
best practices in data engineering, data architecture, and cloud-based analytics solutions
.

Technical Skills:

- Cloud & Data Platform:
Microsoft Fabric, Microsoft Azure
- Fabric Components:
OneLake, Fabric Lakehouse, Fabric Data Factory, Dataflows Gen2, Fabric Warehouse, Fabric Notebooks, Fabric Pipelines
- Big Data Technologies:
Apache Spark, PySpark, Spark SQL, Delta Lake
- Programming Languages:
Python, SQL
- Data Warehousing:
Microsoft Fabric Warehouse, Azure Synapse Analytics, Dimensional Modeling, Star Schema, Snowflake Schema
- ETL / Data Integration:
Microsoft Fabric Data Pipelines, Azure Data Factory (ADF), Dataflows Gen2
- Streaming Technologies:
Azure Event Hub, Azure Stream Analytics, Apache Kafka
- Databases:
SQL Server, Azure SQL Database, PostgreSQL, MySQL, NoSQL Databases
- Data Visualization & BI:
Power BI, Fabric Semantic Models
- Data Governance & Security:
Microsoft Purview, RBAC, Data Encryption, Data Masking
- Version Control:
Git, GitHub, Bitbucket, GitLab
- CI/CD Tools:
Azure DevOps, Jenkins, GitHub Actions
- Containerization:
Docker, Kubernetes
- Operating Systems:
Windows, Linux
- Methodologies:
Agile, Scrum, DevOps, DataOps