Sr. Data Engineer

Role: Sr. Data Engineer

Location: Reading, PA

Type: Contract Roles

Role 1: Sr.Data Engineer
-- Must have
Python & PySpark.

Role 2: Sr.Data Engineer
-- Must have
Talend 8 version
.

- Design, develop, and maintain large-scale batch and streaming pipelines using
PySpark
and
Python
.
- Build real-time and near real-time streaming applications with stateful processing, windowing, and checkpointing.
- Develop production-grade Python microservices for complex data transformations and business logic.
- Design and manage modern data lake architectures using
Apache Iceberg
on
AWS S3
, implementing schema evolution, partitioning, compaction, and time travel.
- Develop and deploy pipelines across
AWS services including S3, EMR, Glue, Lambda, Athena, Redshift, and Aurora
.
- Optimize Spark workloads for performance, scalability, and cost efficiency.
- Implement monitoring, logging, alerting, and recovery mechanisms for robust production operations.
- Contribute to CI/CD pipelines, participate in architecture discussions, and uphold engineering best practices.

Lenora Systems upholds the policy of equal employment opportunity. We commit to consider all eligible candidates for employment without discrimination on the grounds of age, lineage, nationality, hue, family or medical leave, gender identity or expression, genetic data, immigration status, marital circumstance, medical status, national origin, physical or psychological disability, political alignment, veteran or military status, race, ethnicity, faith, sex (including maternity), sexual preference, or any other attribute safeguarded by relevant local statutes, directives, and ordinances.