Lead Data Platform Engineer - Contract to Hire - Remote Work

Lead Data Platform Engineer - Databricks, PySpark, Terraform, Python, Apache Spark, Data Lake and Data Lake House architectures and SDLC

100% Remote Position

Contract to Hire

- 15+ years relevant experience
- Collaborate with data platform architects to design and specify platform tooling, services, and integrations
- Build data lake and lake house architectures
- Build
streaming data architectures to support data platform tooling and services
- Degree in Computer Science, Software Engineering, Information Systems, Information Technology or a related computer degree or equivalent experience. Master’s degree is a plus
- Must know and have proficiency in one object or object/functional programing language.
Preferably Python, Scala, or Java
- Must know common object and object/functional design patterns. Builder, factory, fa?ade, context, etc.
- Must have
proficiency with Apache Spark
- Must know
data lake and lake house design principles
, OLTP (Online Transaction Processing) design principles, document data stores, and graph
- Must know and understand how to
build ELT/ETL
patterns in a distributed compute system. Preferably
Databricks
- Must know and have proficiency with common data quality tooling and the design of configurable systems to front end that tooling
- Must know and have proficiency with common systems and data observability tooling
- Must know standard practices of the Software Development Lifecycle (SDLC)
- Must have proficiency in standard SDLC concepts and tooling including unit and integration testing frameworks like Pytest, IDE features like debugging, testing practices like mocking, CICD tooling like Github actions, build tooling (poetry), GIT
- Must have proficiency in creating and using basic Restful or GRPC services
- Must have proficiency in message bus and streaming technologies and understand common event stream architectures
- Knowledge of the health care industry is a plus