AWS Data Migration Engineer

Philadelphia, PAOnsiteFull TimePosted 1 month ago

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Required skills

AWS
Databricks
Glue
EMR
Step-functions
Lambda
PySpark
Python
Scala
Data Migration

Nice to have

Cloud Data Warehousing
ETL

Role summary

Seeking an AWS Data Migration Engineer with 8+ years of experience to support, migrate, automate, and monitor existing data pipelines and develop Big Data Analytics solutions on AWS and Databricks. The role involves working with complex Customer TV and Digital Ad viewing data for pre-campaign planning and post-campaign performance measurement. Key technologies include Databricks, PySpark, Python, Scala, and various AWS services like Glue, EMR, Step-functions, and Lambda. Collaboration with cross-functional teams and stakeholders to translate business requirements into technical solutions is essential.

Description of the Project

To integrate complex real-world Customer TV and Digital Ad viewing data to perform pre- campaign planning and post-campaigns performance measurements using Big Data Platform (Databricks, Glue, EMR, Step-functions, Lambda, PySpark and other AWS services to support existing workloads, Automate and monitor and based on requirement develop an elastic, scalable, high performance and cost-effective solution in collaboration with cross functional teams.

Key Goals Specified by Manthan / Client(s)

Position is responsible for the support, migration, automation and monitoring of existing data pipelines and based on new requirements, design, develop, test, and deploy the Big Data Analytics solutions on cloud (AWS) and Databricks.
Collaborate with key stake holders and translate business requirements to technical requirements & implement solutions.
Dive into large, noisy, and complex real-world customer TV and Digital Ad viewing data to do pre-campaign planning and post campaigns performance measurement using Big data Platform (Databricks, PySpark, Glue, EMR).
Responsible for support, migration, automation and monitoring of data pipelines to ingest data, integrate data from multiple data sources (On-Premise & Cloud) and create aggregated data sets for reporting needs and appropriate notifications.
Job Description
8+ years of overall software development
Experience on Big Data Technologies, Hadoop Eco system and Technologies with experience programming in Scala, PySpark and Python
Requirement gathering, design and Support, Migration, Automation
Monitoring of data pipelines with PySpark, AWS services

Location States ( NJ, NY, MA, CT, NC, PA preferred)

Ready to apply?

You'll be redirected to Algonomy's application page.