Data Engineer Associate
Role summary
CRISP Shared Services (CSS) is seeking a Data Engineer Associate to join their Data Insights Team. This role will focus on maintaining and improving the reliability of their Azure Data Lake/Factory/Spark/Databricks infrastructure, which handles batch and real-time healthcare data. Key responsibilities include monitoring data pipelines, troubleshooting issues, supporting data quality validation, and implementing enhancements to existing workflows. The position is crucial for ensuring the stability, accuracy, and operational efficiency of CSS's production data systems, supporting improved patient care and outcomes.
Company Description
CRISP Shared Services (CSS) serves as the technology partner for health information exchange (HIE) affiliates in Maryland, DC, West Virginia, Connecticut, Alaska, Virginia and other jurisdictions. CSS facilitates the electronic transfer of clinical information between disparate information systems in order to positively impact the healthcare system through improved patient care and outcomes, reduced costs, and data-driven understanding of regional public health concerns.
Job Summary
CRISP Shared Services (CSS) serves as the technology partner for health information exchange (HIE) partners in Maryland, DC, West Virginia, Connecticut, Alaska, Virginia, Kentucky, Florida, and other jurisdictions. CSS facilitates the electronic transfer of clinical information between disparate information systems in order to positively impact the healthcare system through improved patient care and outcomes, reduced costs, and data-driven understanding of regional public health concerns.
The CSS Data Insights Team is running an Azure Data Lake / Azure Data Factory / Spark / Databricks infrastructure with production use cases that consolidate streams of healthcare data for delivery in scheduled intervals (batch processing) and in real-time (streaming).
The Data Engineer Associate will support the Data Insights Team by maintaining and improving the reliability of our production data platform. This role focuses on monitoring data pipelines, troubleshooting data issues, supporting data quality validation, and implementing enhancements to existing workflows. The position plays an important role in ensuring the stability, accuracy, and operational efficiency of data
systems that support our production data systems.
Essential Duties and Responsibilities
Include the following. Other duties may be assigned.
- Monitor production data jobs and workflows, investigate failures, perform re-runs when appropriate, and escalate issues as needed maintain reliable data delivery
- Troubleshoot data issues reported by internal teams or external clients, investigate root causes, and implement fixes
- Maintain and enhance existing data pipelines and workflows, including implementing updates for performance, adding new recipients or outputs, and supporting operational improvements
- Support data quality validation and QA testing for new and existing automations, including validating outputs against source systems and business requirements
- Collaborate with Data Engineers, Analysts, and Team Leadership to support ongoing platform reliability
- Build and implement new data jobs to support operational data delivery, reporting, and client data needs
Qualifications
To perform this job successfully, the incumbent must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.
- Strongly proficient in SQL and Python for querying, transforming, and analyzing data
- Understanding of data pipeline and ETL concepts, including data ingestion, transformation, validation and movement between systems
- Ability to read, understand, troubleshoot, and modify existing code and data workflows, working collaboratively with senior team members to support production pipelines and data assets
Experience and/or Education Requirements
- 1+ years of experience working with data pipelines, ETL processes, or data engineering workflows in a professional, internship, or project-based environment (required)
- 1+ years of experience writing advanced SQL and Python queries (required)
- 4+ year college degree in Computer Science, Information Systems, Data Engineering, Software Engineering, or a related technical field (preferred)
Compensation and Benefits Package
- Targeted base salary: $75k - $90k per year, based on experience and qualifications, plus benefits and bonuses.
- Benefits include the following but are not limited to health, dental, vision, life and disability insurance. CSS also has a 403(b) plan with discretionary employer match and contributions. You will be eligible for 20 days of Paid Time Off per year (accrued in accordance with CSS' policies). PTO is in addition to 8 company designated holidays. If you are not PTO eligible, you may be eligible for applicable state and/or local sick and safe leave in accordance with the provisions of any applicable state and/or local sick and safe leave laws.
Website: www.crispsharedservices.org
Location: Hybrid, Columbia, MD - required in-office every Thursday
CRISP Shared Services, Inc. is an equal opportunity employer. This means that CRISP Shared Services Inc. is dedicated to providing equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, age, marital status, genetic information, disability, military or veteran status, or any other status protected by federal, state, or local law. We celebrate diversity and are committed to creating an inclusive environment for all team members.