
Specialist - Data Engineering
Role summary
This role focuses on Data Engineering with a strong emphasis on large-scale data warehousing and data lake concepts. The specialist will be responsible for ETL/ELT engineering using Ab Initio and migrating patterns to Spark, with hands-on PySpark proficiency for batch and streaming data. Expertise in the Hadoop ecosystem, Oracle SQL mastery, and data ingestion architecture using CDC and Kafka are crucial. The role also involves data quality engineering, cloud and lakehouse engineering on Databricks, metadata-driven pipeline design, and performance engineering across various platforms. A mandatory Karat technical interview clearance is required.
Role description
HARD SKILLS
Sound Concepts of Large DatawarehouseData Lake Concepts ETLELT Ab Initio Apache Spark PySpark SQL Oracle HADOOP
Advanced dimensional modeling data vault and schema design for large scale Data Warehouses and Data Lakes
Deep expertise in ETLELT engineering using Ab Initio graphs plans PDL metadata driven design and migration of those patterns to Spark
Hands on PySparkSpark proficiency for batch streaming joins windowing partitioning and performance tuning on large datasets
Strong command of Hadoop ecosystem components HDFS Hive YARN OozieAirflow Ranger Atlas and securitygovernance frameworks
Oracle SQL mastery including performance tuning partitioning materialized views and implementingdecoding Virtual Private Database VPD policies
Data ingestion architecture using CDC Kafka file based ingestion and incremental load frameworks for high volume HR and financial data
Data quality engineering reconciliation frameworks validation rules audit controls lineage and automated regression testing
Cloud and lakehouse engineering on Databricks Delta Lake Unity Catalog cluster optimization job orchestration and CICD
Metadata driven pipeline design reusable transformation frameworks and parameterized job orchestration patterns
Performance engineering across platforms skew mitigation partition strategy broadcast vs shuffle decisions and storage format optimization ParquetORCDelta
SOFT SKILLS
Good Attitude
Team Player
Independent
Handon Coder Designer
Coachable
Ability to learn adapt adopt
Mandatory Karat technical interview clearance is required
Other details
Actual compensation within the range will be dependent upon the individual's skills, experience, performance and internal equity.
Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (“LTIM”):
Benefits and Perks:
- Comprehensive Medical Plan Covering Medical, Dental, Vision
- Short Term and Long-Term Disability Coverage
- 401(k) Plan with Company match
- Life Insurance
- Vacation Time, Sick Leave, Paid Holidays
- Paid Paternity and Maternity Leave
The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training.
Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.
Disclaimer
: The compensation and benefits information provided herein is accurate as of the date of
this posting.
LTIMindtree
is an equal opportunity employer that is committed to diversity in the workplace. Our
employment decisions are made without regard to race, color, creed, religion, sex (including
pregnancy, childbirth or related medical conditions), gender identity or expression, national origin,
ancestry, age, family-care status, veteran status, marital status, civil union status, domestic
partnership status, military service, handicap or disability or history of handicap or disability, genetic
information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation
or preference, or any other characteristic protected by applicable federal, state, or local law, except
where such considerations are bona fide occupational qualifications permitted by law.
Similar roles
Senior Specialist - Data EngineeringLTIMindtree · Hartford, Connecticut, United States · Onsite
Specialist - Data EngineeringLTIMindtree · Dallas, Texas, United States · Hybrid
Specialist - Data EngineeringLTM · Tampa, Florida, United States · Onsite
Senior Specialist - Data EngineeringLTM · Ontario, Ontario, Canada · Onsite
Specialist - Data EngineeringLTIMindtree · Irving, Texas, United States · Onsite