Sr Data Engineer
Role summary
This client requires a background check for all candidates. The Sr Data Engineer will contribute to maintaining, updating, and expanding existing Core Data platform data pipelines. Responsibilities include building and maintaining APIs, developing real-time streaming data pipelines, and collaborating with product managers, architects, and other engineers. The role ensures high operational efficiency and quality of datasets, meeting SLAs and project reliability and accuracy for various stakeholder teams.
Job ID: 29659
Job Title: Sr Data Engineer
Location: Glendale, CA - Onsite 4 days a week
Work Type: Onsite Position
Client: CP - CTP Consulting - Clarity Technology Partners
Domain: Entertainment/Media/Publishing
Duration: 12 Months of Contract
Experience: 5 - 20 Years
Visa: Candidates must work W2, no Corp 2 Corp. US Citizen, Green Card Holder, H4-EAD, TN-Visa
Salary: $70 - $80 Hourly
Summary
This client requires that a background check be completed. A background check is required to protect our company/client and its stakeholders by ensuring that we hire individuals with a trustworthy history, which helps maintain a safe and secure workplace. This proactive measure minimizes potential risks and promotes a culture of integrity within the organization.
Platform / Stack
You will work with technologies that include Python, AWS, Spark, Snowflake, Databricks, and Airflow.
What You//'ll Do As a Sr Data Engineer:
Contribute to maintaining, updating, and expanding existing Core Data platform data pipelines
Build and maintain APIs to expose data to downstream applications
Develop real-time streaming data pipelines
Tech stack includes Airflow, Spark, Databricks, Delta Lake, and Snowflake
Collaborate with product managers, architects, and other engineers to drive the success of the Core Data platform
Contribute to developing and documenting both internal and external standards and best practices for pipeline configurations, naming conventions, and more
Ensure high operational efficiency and quality of the Core Data platform datasets to ensure our solutions meet SLAs and project reliability and accuracy to all our stakeholders (Engineering, Data Science, Operations, and Analytics teams)
Qualifications:
You could be a great fit if you have:
5+ years of data engineering experience developing large data pipelines
Proficiency in at least one major programming language (e.g. Python, Java, Scala)
Hands-on production environment experience with distributed processing systems such as Spark
Hands-on production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelines
Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Databricks, Big Query).
Experience in developing APIs with GraphQL
Advanced understanding of OLTP vs OLAP environments
Strong background in at least one of the following: distributed data processing or software engineering of data services, or data modeling
Must-Haves :
5+ years of data engineering experience specifically developing large-scale data pipelines Spark, Airflow, Databricks or Snowflake, SQL, Python
Vishal (Victor) Verma | Assistant Manager
vishal@nsitsolutions.com
NS IT Solutions
www.nsitsolutions.com
Similar roles
- Senior Data EngineerExperion Technologies · Plano, Texas, United States · Hybrid
- Lead Data EngineerSmart IT Frame LLC · Los Angeles, California, United States · Hybrid
Principal Data EngineerRS21: A Data Science and Visualization Company · United States · Remote
Senior Data EngineerRaag Solutions · Bellevue, Washington, United States · Onsite- Lead Data EngineerRetail Insight Ltd · Illinois, United States · Hybrid