Data Engineer - Python/PySpark

Job description:
Job Description

Role: Data Engineer - Python/PySpark
Location: Irving TX (3 Days onsite/week)

Job Description:
•    Strong hands-on development experience in Python, PySpark, and SQL.
•    Experience building large-scale ETL/ELT pipelines for structured and unstructured data.
•    Deep understanding of Spark and distributed computing fundamentals (transformations, shuffles, optimization).
•    Experience with big data frameworks such as Hadoop and Spark.
•    Proficiency with Git-based repositories (Bitbucket / GitHub).
•    Experience working with AWS, Azure, or GCP environments.
•    Strong understanding of database design, data modeling, warehouse schemas (star/snowflake).
•    Experience with CI/CD automation and pipeline development.
•    Strong analytical and troubleshooting skills for resolving complex data issues.
•    Ability to collaborate with cross-functional teams and convert business requirements into technical solutions.
•
•  Design, develop, and maintain robust, scalable ETL/ELT pipelines.
•  Write efficient, reusable, and scalable code in Python and PySpark for distributed data processing.
•  Review existing data engineering code and identify opportunities for refactoring or performance improvement.
•  Implement data validation, cleansing, reconciliation, and quality checks across the data lifecycle.
•  Collaborate with IT and business stakeholders to understand data requirements and translate them into solutions.
•  Monitor pipeline performance, troubleshoot failures, and optimize for latency, throughput, and cost.
•  Participate in code reviews, enforce coding standards, and contribute to engineering best practices.
•  Build and maintain CI/CD pipelines for testing, packaging, and deployment of data pipelines.
•  Ensure data reliability, security, and consistency across environments.
•  Work with cloud services and big data platforms to support modern data architecture.

Experience: 5-8 Years
.

The expected compensation for this role ranges from $60,000 to $135,000 .

Final compensation will depend on various factors, including your geographical location, minimum wage obligations, skills, and relevant experience. Based on the position, the role is also eligible for Wipro's standard benefits including a full range of medical and dental benefits options, disability insurance, paid time off (inclusive of sick leave), other paid and unpaid leave options.

Applicants are advised that employment in some roles may be conditioned on successful completion of a post-offer drug screening, subject to applicable state law.

Wipro provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Applications from veterans and people with disabilities are explicitly welcome.

Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.