Endsight Verified
Cybersecurity, Artificial Intelligence, SaaS
Senior Data Platform Engineer
RemoteRemoteFull TimeSenior$150,000–$175,000 /yrPosted 1 month agoVisa sponsorship availableHidden Gem · Himalayas
Required skills
- Microsoft Fabric
- lakehouse
- warehouse
- medallion architecture
- PySpark
- Python
- ingestion pipelines
- semantic models
- deployment pipelines
- API integration
Nice to have
- Azure Data Factory
- Synapse
- Purview
- Key Vault
- Entra application registration
- Azure DevOps
Role summary
Endsight, a growing IT Managed Service Provider, seeks a Senior Data Platform Engineer to build and standardize their data integration platform, primarily within the Microsoft Fabric environment. This role involves designing medallion architectures, developing API-based data ingestion methods, building MCP servers, and authoring engineering standards. The ideal candidate has 2+ years of experience with Microsoft Fabric, demonstrated API integration skills, experience building MCP servers, strong Python and SQL, and a track record of establishing and promoting technical standards. Preferred qualifications include breadth across the Azure data platform and experience in MSP environments.
Location | Napa, CA or US remote. Pacific-hours overlap required. You’re the kind of person who helps others succeed. You’re sharp, resourceful, and calm under pressure. You’re the one people count on when technology misbehaves. You love solving problems, restoring order, and creating moments where others can breathe again because you’ve got it handled. But lately, you might be craving a team that matches your standards, where doing great work and helping others thrive go hand in hand. That’s where Endsight comes in.
Who We Are | Endsight is a fast-growing IT Managed Service Provider built on one core belief: When we help others thrive, we thrive too.We partner with small and mid-sized organizations, including nonprofits, to ensure their technology performs flawlessly so they can focus on what they do best. We’re a team that learns fast, leans in, and looks out for one another. Life here feels like being part of a great university. You’ll grow quickly, connect deeply, and do work that truly matters.
Purpose: What You’ll Do
You’ll build and standardize the data integration platform that Endsight and its clients run on, working mainly across the Microsoft Fabric environment with architecture, API-based data ingestion, and Model Context Protocol (MCP) server development, turning what the team learns into published, adopted engineering standards. Your days will include:- Designing and refining medallion-layered architecture in Microsoft Fabric for Endsight and client environments
- Evaluating and building reference implementations for data ingestion and API integration methods, including incremental and change-data-capture patterns, schema-drift handling, and secrets management
- Building MCP servers to Endsight's internal security and reliability standards, covering authorization scope, fault handling, and injection resistance
- Authoring, publishing, and maintaining engineering standards, enabling other engineers to implement these standards through documentation, review, and pairing
- Taking a share of the team's research and evaluation queue and co-authoring the decision framework for what belongs in the central data platform
- Collaborating with existing domain owners to raise the technical bar
- Take pride in helping others succeed
- Love mastering your tools and improving your craft
- Communicate clearly and stay composed under pressure
- Are energized by teamwork and mutual respect
- Want to grow in a place where your success helps everyone win
Qualifications
Required:- Two or more years of hands-on production experience with Microsoft Fabric, including lakehouse and warehouse design, medallion architecture, notebooks (PySpark and/or Python), ingestion pipelines, semantic models, and deployment pipelines
- Demonstrated API integration experience: REST and OAuth2, pagination, rate limiting, incremental and change-data-capture patterns, idempotent retries, and secrets management, in systems running unattended in production
- Demonstrated experience building and shipping MCP servers, including tool design, authorization scoping, structured error handling, and resistance to prompt injection
- Strong Python and SQL, infrastructure-as-code, and Git-based workflow
- A documented record of evaluating competing technical methods, writing the standard, and getting other engineers to adopt it
- A documented record of raising technical standards working in coordination with a team
- Comfort working with incompletely defined requirements and pushing back constructively on scope
- Breadth across the Azure data platform: Data Factory, Synapse, Purview, Key Vault, Entra application registration, Azure DevOps
- MSP or professional services background, including familiarity with PSA/RMM data models (ConnectWise, HaloPSA, NinjaOne) and multi-tenant data isolation
- Experience with other Orchestration Platforms (n8n, Rewst)
- Power Platform and Power Automate
- Experience migrating off a legacy business intelligence or reporting estate
- Experience integrating financial systems data (QuickBooks, Business Central, Adaptive Planning)
- Relevant Microsoft certifications (DP-600, DP-700, or equivalent)
Benefits & Compensation
Benefits- Medical: Company pays 100% of the base plan for the employee and family
- Dental & Vision
- 401(k) with employer matching
- Accrued Paid Time Off
- 9 Paid Holidays
- Career Development support and programs
- $150,000 – $175,000 base salary
Originally posted on Himalayas
Similar roles
- Senior Data Platform EngineerEndsight · Napa, CA · Hybrid
- System AdministratorEndsight · Remote · Remote
- Teleop Platform Engineer, Real-Time Systems & UImecka · Richmond Hill, ON · Hybrid
Security Platform Engineer - PolyHP · Austin, TX · Onsite- Staff Data Platform Engineer - VirtualAlight Solutions · Remote · Remote
Senior Software Engineer - Database Automation and Platform EngineeringPNC · Strongsville, OH · Onsite
