
Data Engineer II
Role summary
We are seeking a Data Engineer II to join our remote team, focusing on building and maintaining critical data systems for our Platform Ventures business. This role involves contributing to the design, development, testing, scaling, and maintenance of data pipelines from various sources. You will collaborate with engineers and product managers, participate in Agile ceremonies, and troubleshoot production issues. The ideal candidate has 5+ years of data engineering experience, proficiency in Python, SQL, and AWS data services, and experience with data warehousing and data modeling. A Bachelor's degree in a technical field or equivalent experience is required.
Role: Data Engineer II
Location: 100% Remote
Salary: $125k-$140k
Medical, Dental, and 401K
AWS data management (S3, Redshift, DynamoDB) and related tools (Athena, EMR, Glue, Lambda).
Additional Requirements:
Must currently live in USA, Required Technical assessment, and 3rd interview is onsite.
MUST LIVE in EST or CST only
*NOT open to C2Cs. Candidates on visas are not eligible with this company.*
As a Data Engineer II, you will be working on our data systems and services with other data engineers to deliver projects and systems critical to our Platform Ventures business. We expect our data engineers to be versatile, display leadership qualities and be enthusiastic about taking on new problems across our businesses as we continue to build great things.
Responsibilities
- Contribute to and help team in design, build, testing, scaling, and maintaining data pipelines from a variety of source systems and streams (Internal, third party, cloud based, etc.), according to business and technical requirements.
- Continually work on improving the codebase and have active participation and oversight in all aspects of the team, including agile ceremonies.
- Collaborate with engineers and product managers to understand data needs. Participate in Agile ceremonies (standups, retros, sprint planning, etc.)
- Troubleshoot and fix production issues as they occur.
Qualifications
- Bachelor's degree in Computer Science, Computer Engineering, or related technical field, or equivalent practical experience.
- 5+ years of applied experience in Data Engineering, including but not limited to: building Data Pipelines, Orchestration, Data Modeling & Data Lake.
- Programming skills in one or more of the following: Python, Java, Scala, plus SQL and experience in writing reusable/efficient code to automate analysis and data processes.
- Experience in Data Warehousing (Relational and dimensional data modeling).
- Strong working experience with a variety of data sources such as APIs, real-time feeds, structured and semi-structured file formats.
- Experience with processing large datasets and building code using Glue, Apache Airflow / Amazon MWAA, SQL, Python, and pySpark. Experience of near Real Time & Batch Data Pipeline development.
- Experience with AWS data management (S3, Redshift, DynamoDB) and related tools (Athena, EMR, Glue, Lambda).
- Experience working in an agile/scrum environment.
Desired Characteristics
- Familiar with software build, release, deployment and monitoring tools and practices.
- Experience with Talend, Informatica, or other off-the-shelf ETL tools.
- Experience working with Terraform.
- Strong Test-Driven Development background, with understanding of levels of testing required to continuously deliver value to production.
- Team-oriented and collaborative approach with a demonstrated aptitude, enthusiasm, and willingness to learn new methods, tools, practices, and skills.
- Ability to work effectively across functions, disciplines, and levels.
Equal Opportunity Employer/Veterans/Disabled
Military connected talent encouraged to apply
To read our Candidate Privacy Information Statement, which explains how we will use your information, please navigate to
https://www-uat.lhh.com/us/en/candidate-privacy
The Company will consider qualified applicants with arrest and conviction records in accordance with federal, state, and local laws and/or security clearance requirements, including, as applicable:
- The California Fair Chance Act
- Los Angeles City Fair Chance Ordinance
- Los Angeles County Fair Chance Ordinance for Employers
- San Francisco Fair Chance Ordinance
Massachusetts Candidates Only:
It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
- Seniority Level
- Director
- Industry
- Technology, Information and Media
- Employment Type
- Full-time
- Job Functions
- Information Technology
- Skills
- API Development
- Extract, Transform, L
Similar roles
- Senior Data Engineer IICyOpsPath - Job Marketplace · Chantilly, Virginia, United States · Hybrid
- Data Engineer IICyOpsPath - Job Marketplace · Chantilly, Virginia, United States · Hybrid
Data Engineer IISCP Health · Atlanta, Georgia, United States · Onsite
Data Engineer IIPOOLCORP · Covington, Louisiana, United States · Onsite- Data Engineer IIpropio · Kansas, United States · Onsite