Tata Consultancy Services logo
Tata Consultancy Services Verified
Information Technology & Services

Sr Data Engineer

Phoenix, Arizona, United StatesOnsiteFull TimeSenior$90,000–$120,000 /yrPosted 2 months agoVisa sponsorship available

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Role summary

We are seeking a Senior Data Engineer with over 6 years of experience to design, develop, and maintain scalable Big Data pipelines. The role requires strong proficiency in Python, Apache Spark (PySpark/Spark SQL), and ETL/ELT processes for both batch and real-time data. Experience with Google Cloud Platform (GCP) services like BigQuery, Dataflow, and Dataproc is essential. The ideal candidate will have a solid understanding of data warehousing, data lake architectures, CI/CD, and DevOps practices. Responsibilities include building data solutions, optimizing SQL queries, monitoring production issues, and collaborating with cross-functional teams in an Agile/Scrum environment.

Job Description
Role - Sr Data Engineer
Experience Required - 6+ Years
Must Have Technical/Functional Skills

  • Strong hands-on experience in Big Data technologies and distributed data processing frameworks.
  • Proficiency in Python for data engineering, scripting, and performance optimization.
  • Extensive experience with Apache Spark (PySpark/Spark SQL) for large-scale data transformation and processing.
  • Solid experience in designing and developing ETL/ELT pipelines for batch and real-time data processing.
  • Experience working with Google Cloud Platform (GCP) services such as BigQuery, Cloud Storage, Dataflow, Dataproc, Composer, and Pub/Sub.
  • Strong understanding of data warehousing concepts, dimensional modeling, and data lake architectures.
  • Experience with CI/CD pipelines and DevOps practices for data engineering workflows.
  • Proficiency in version control systems (Git) and build/release management.
  • Experience with workflow orchestration tools such as Apache Airflow or Cloud Composer.
  • Experience working in Agile/Scrum environments with cross-functional teams.
  • Strong analytical and problem-solving skills
  • Strong collaboration and stakeholder communication skills

Roles & Responsibilities

  • Design, develop, and maintain scalable Big Data pipelines using Spark (PySpark/Spark SQL) for batch and real-time processing.
  • Build and optimize robust ETL/ELT workflows to ingest, transform, and load data from multiple structured and unstructured sources.
  • Develop high-performance SQL queries and implement efficient data models to support analytics and reporting needs.
  • Architect and implement data solutions on Google Cloud Platform (GCP) using services such as BigQuery, Dataproc, Dataflow, Cloud Storage, Pub/Sub, and Composer.
  • Monitor, troubleshoot, and resolve production issues in distributed and cloud environments.
  • Automate operational processes and enforce coding standards, version control, and documentation practices.
  • Automate operational processes and enforce coding standards, version control, and documentation practices.
  • Collaborate with cross-functional teams including business stakeholders, data engineers, and product teams
  • Drive analytics initiatives to provide actionable insights.
  • Participate in Agile ceremonies including sprint planning, design reviews, and retrospectives.
  • Continuously improve reporting frameworks and data processes in alignment with Agile delivery practices

Base Salary Range : $90,000 to $120,000 Per Annum
TCS Employee Benefits Summary
Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Ready to apply?
You'll be redirected to Tata Consultancy Services's application page.

Similar roles