
Senior Data Engineer
Role summary
We are seeking a Senior Data Engineer with a strong blend of technical expertise and business acumen, particularly experienced in healthcare data. This role involves leading data modeling, designing and maintaining end-to-end data pipelines, and building scalable data infrastructure within AWS. The ideal candidate will be a proactive problem-solver, committed to improving data quality and accessibility, and capable of translating business needs into robust data solutions. Responsibilities include collaborating with cross-functional teams and ensuring adherence to healthcare data regulations like HIPAA and PHI.
OUR IDEAL CANDIDATE
We are looking for a Senior Data Engineer who is a self-starter and detail-oriented with a strong blend of technical expertise and business acumen. The ideal candidate has a strong foundation in data engineering and analytics, experience working with healthcare data, and the ability to build scalable data-driven solutions. You are a proactive problem-solver who takes ownership of your work, continuously seeks to improve data quality and accessibility, and is committed to delivering high-quality data solutions.
RESPONSIBILITIES
- Lead data modeling efforts to create optimized data structures for reporting and analytical purposes.
- Design, develop, and maintain end-to-end data pipelines that transform raw source data into high-quality, actionable datasets.
- Build data infrastructure and data catalog for the company, from data ingestion to the semantic layer, ensuring robust and scalable architecture in the AWS Cloud.
- Collaborate with cross-functional teams (product, technology, operations, etc.) to understand data needs, align them with business goals, and translate them into technical solutions.
QUALIFICATIONS
- Bachelor's or Master's (preferred) degree in Computer Science, Engineering, or a related quantitative field (Data Science, Statistics).
- 5+ years of experience as a Data Engineer, Analytics Engineer, or similar role, with a strong focus on the development of end-to-end data solutions and products.
- 5+ years of hands-on experience with AWS cloud technologies is required, including designing, building, and maintaining cloud-based data infrastructure.
- Proficiency in building and managing data infrastructure and ETL pipelines within AWS, leveraging services like AWS Glue, Athena, Redshift, Aurora, RDS, DynamoDB, EMR, Lambda, IAM, s3, EC2, CLI.
- Demonstrated experience in designing and implementing robust data models for analytical purposes.
- Strong proficiency in SQL and experience with various database systems (e.g., MySQL, NoSQL, Snowflake, Vector Databases).
- Strong proficiency in Python and PySpark for data engineering and analytics, and extensive experience with data pipeline development and orchestration tools (e.g., Airflow, dbt).
- Experience with Power BI or Tableau for data reporting and dashboard development.
- Experience shipping data products to production and understanding software development lifecycle best practices.
- Strong problem-solving skills and the ability to work independently, good communication and collaboration skills.
- Ability to learn new technologies and adapt to a fast-paced environment.
- Awareness of HIPAA, PHI, and other healthcare-specific regulations related to data and AI.
Similar roles
- Senior Data EngineerExperion Technologies · Plano, Texas, United States · Hybrid
- Lead Data EngineerSmart IT Frame LLC · Los Angeles, California, United States · Hybrid
Principal Data EngineerRS21: A Data Science and Visualization Company · United States · Remote
Senior Data EngineerRaag Solutions · Bellevue, Washington, United States · Onsite- Lead Data EngineerRetail Insight Ltd · Illinois, United States · Hybrid